24
Software Quality Engineering

Software Quality Assurance on VLC

Embed Size (px)

Citation preview

Page 1: Software Quality Assurance on VLC

Software Quality Engineering

Page 2: Software Quality Assurance on VLC

Our Team:

Shoaib HaseebMakshif TanveerMuneer Ahmed

Ehsan Elahi

Page 3: Software Quality Assurance on VLC

VLC media player

VLC is a free and open source cross-platform multimedia player and framework that plays most multimedia files as well as DVDs, Audio CDs, VCDs, and various streaming protocols.

Page 4: Software Quality Assurance on VLC

Background

• Initial release in Feb.2001.• Written in C, C++,Objective–C Lua.• Platform IA-32,Arm,MIPS.• Available in 48 languages.• VLC media player is downloaded at an approximate monthly rate of 5

millions from the main website and that's not including third-party distributions

Page 5: Software Quality Assurance on VLC

Application's:

VLC media player is a cross-platform media player, with versions for Windows, OS X, iOS, Linux, Android, BSD, BeOS, OS/2..

Page 6: Software Quality Assurance on VLC

Testing Criterion:

• Functionality & UI (UI & System Storyboards, Automated Acceptance Tests).• System Design(Guided Inspections, Simulated Execution).• Implementation(Unit Tests, Code Quality Analysis, Performance Tests).• Configuration & Integration(Continuous Integration, Smoke Tests

End-to-end Tests).

Page 7: Software Quality Assurance on VLC

Testing Criterion:

• VLC is not very easy to test, as it does not provide "parsable" results.What we could test quite easily:• Playlist operation• Core operation• Media control• VLM• Check that the streams appears to play (we can't assess the result)• Stream output: check size of output• to be completed.

Page 8: Software Quality Assurance on VLC

Repo of Methodologies :

• Inspect and adapt.• Black Box testing.• Smoke Testing.• White Box Testing.• Unit testing.• Automated Testing.• Agile / Extreme Testing

Page 9: Software Quality Assurance on VLC

Our focus:

• Bug # 1: We can forward video while converting it to some other format.• Suggested fix: Forward option should be disabled while converting.

Page 10: Software Quality Assurance on VLC

Our focus:

• Bug # 2: When we navigate to video option and then to zoom option, video does not zoom.

Suggested fix: video should zoom when we are in the video options.

Page 11: Software Quality Assurance on VLC

Our focus:

• Bug # 3: After changing the skin, complete functionality is not visible.• Suggested fix: all the functionality should remain in vlc even after

switching to any skin

Page 12: Software Quality Assurance on VLC

Our focus:

• Bug # 4: After changing skin, skin is not changed instantly, if we play video again only then we can know about the change in skin..... user is not even given the confirmation message that skin has been changed.

• suggested fix: skin should be changed immediately or user should be told that he needs to play video again to see the changed skin

Page 13: Software Quality Assurance on VLC

Our focus:

• Bug # 5: In some versions, If we are recording a video from web cam, we cannot know that our video is being recorded, we can see only the vlc home screen in front of us.• Suggested Fix: Recording Screen should have its own working

interface.

Page 14: Software Quality Assurance on VLC

Our Focus:

• Bug # 6 : In some versions which we have tested, on clicking the record button it shows message that the webcam is not supported but still the video gets recorded.• Suggested Fix: Integration issue between the two functionalities

should be removed.

Page 15: Software Quality Assurance on VLC

Our focus:

• Bug # 7: While in recording mode, either we have initiated recording or not, time of video keeps on changing.• Suggested fix: time should only go forward when we have clicked on

record button.

Page 16: Software Quality Assurance on VLC

Tests to run

• You want to help by testing VLC ? There are a few tests that you can handle:• VLC playback tests (codecs and files related) Win32 and MacOS

focused.• VLC functionality tests• VLC transcode and streaming tests• VLC fundamental tests in src/test (run make check)• There is a small test suite for the Android port located at Android test

suite.

Page 17: Software Quality Assurance on VLC

External Dependencies:

• Data feeds from Social network servers like facebook, Google, yahoo mails etc.• Data migration from any of the db servers for testing purpose.• External interfaces document.• There are no significant changes in priorities that require

redeployment of resources• No direct or virtual interaction (Through Bugzilla).• No approved requirement document available.• No arch/design doc available

Page 18: Software Quality Assurance on VLC

What we suggest

• The idea is to develop test protocols, regroup test files, and at the end improve the whole quality of VLC, to avoid regressions and check roadmaps.• The bugs should be tracked down and killed using trac.• The community of VideoLAN's numerous users and developers can

enforce the project by doing systematic tests and reporting bugs and regressions. Some projects rely on a lot of external code that evolves a lot. Being numerous can help to make it better.

Page 19: Software Quality Assurance on VLC

Test Suite

• This project aims at making automatic tests to improve VLC quality.• Write a series of tests for vlc-internal• Integrate a framework for automated plugins testing with the

automake build system• Automate the different codec playback/mux/etc tests• Automate the subtitles tests• Write tests for the different bindings: Mac OS X Framework/Python

Bindings... etc.

Page 20: Software Quality Assurance on VLC

Goals:

• VideoLAN’s was originally designed to stream MPEG videos on high bandwidth networks, but VideoLAN's main software, VLC media player, has evolved to become a full-featured, cross-platform media player.

Page 21: Software Quality Assurance on VLC

Improvements:

• Improved audio quality, improvements to the material design interface, including the black theme and switch to audio mode. Further, it is a major update for Android TV adding support for media discovery via UPnP, with improvements for recommendations and gamepads.• VLC for Windows Phone accelerated decoding allowing playback of HD

contents of certain formats as well as further iterations on the user interface.• Focused on improved cloud integration adding support for iCloud Drive,

OneDrive and Box.com, a 10-band equalizer as well as sharing of the media library on the local network alongside an improved playback experience.

Page 22: Software Quality Assurance on VLC

Dark Testing :

• Its a structural testing method, i.e. we use the structure of the code to guide the test process. In a small change in a program. Such small changes are intended to model low level defects that arise in the process of coding systems. Ideally itshould model low-level defect creation.

Page 23: Software Quality Assurance on VLC
Page 24: Software Quality Assurance on VLC

References:

• http://nightlies.videolan.org/• http://www.videolan.org/news.html• https://wiki.videolan.org/Quality/\