QA/Platform/Graphics/Firefox 38

The following documents testing of graphics in Firefox 38 across a wide range of test environments. For more information on the methodology please consult our wiki.

Approach

Suggested tests on Youtube.com

• basic video playback functionality
• clicking around a lot in the seek bar (near, far, ahead, behind, near the end)
• verify you get video suggestions when playthrough completes
• verify you get the next video in a playlist when playthrough completes
• check going in and out of fullscreen mode
• check video resume after putting the machine to sleep

Other test suggestions

• detaching and reattaching a video tab
• switching between normal mode, theatre mode, and fullscreen mode playback
• playing video on a secondary screen
• video resumes from session restore

Tests informed by top tracked bugs

• ???

What to look for

• significant buffering pauses
• black video
• spike in CPU usage

Videos for stress testing 1080p60 or 4k

• https://www.youtube.com/watch?v=Jp59FElhOTw
• https://www.youtube.com/watch?v=79ImZE0K7xc
• https://www.youtube.com/watch?v=7SRTEXSpcyI

Instructions

Setting up the test environment

1. Install Firefox

• Download https://ftp.mozilla.org/pub/firefox/nightly/latest-mozilla-aurora/firefox-38.0a2.en-US.win32.installer.exe
• Run installer and select customize
• Put the install in a known directory (C:\Aurora for purposes of this example)
• Do NOT allow it to launch Firefox at the end of the install

2. Disable the automatic updater

• Open C:\Aurora\defaults\pref\channel-prefs.js in a text editor
• Change the line reading pref("app.update.channel", "release"); to pref("app.update.channel", "foobar");
• Save and Close the text file

3. Launch Firefox with a clean profile

• Run cmd.exe
• Change directory to the folder where you installed Firefox: cd C:\Aurora
• Run firefox.exe: firefox.exe -P -no-remote - This will bring up our profile selector window.
• Use the "Create Profile" button to create a profile new profile
• Once the profile is created, select it, and then click "Start Firefox"

Reporting a crash

If you encounter a crash you will see a crash reporter dialog. Use this to report the crash to Mozilla.

• Enter a comment to describe the circumstances of the crash
• Click submit on the crash reporter dialog
• Restart Firefox
• Load the about:support page and copy all of the information on that page to a text file, upload it to the Google drive location
• Load the about:crashes page and copy the link of the crash report you submitted (it will be the one at the top of the list)
• Report the link to the about:support page in Google drive as well as the link to your crash report

Reporting Memory Usage

• Please continue reporting memory usage as you have
• Naming convention: <machinename>_<firefoxbuild>_<driverlevel>_<testnumber>_memory_report.json
• You can upload the report to the Google drive (link to be provided via email)

Tests

1. Crash with http://www.detik.com/, https://www.irctc.co.in/eticketing/home, and http://www.prothom-alo.com/

• Load each of the URLs above
• Resize the window smaller and larger to random sizes
• Click a link on the page and resize the window some more
• Switch into responsive design view (CTRL + Shift + M), change resolution, and refresh the page
• If you encounter a crash then proceed with reporting a crash instructions
• If you do NOT encounter a crash then this test is a PASS, move on to the next test

2. Switch video quality and seek intermittently

• Load the about:config and click I'll be careful.
• Search for dxva and set media.windows-media-foundation.use-dxva to true then restart Firefox
• Load https://www.youtube.com/watch?v=hicBgE6XndM
• Use gear icon to set to highest quality (1080HD)
• Open full screen and play video
• Use the bottom bar of the video to reset different quality levels (using gear icon)
• Use the arrow keys (or the slider at the bottom of the page) to seek forward and back through the video
• Make at least three changes to quality level and seeking then stop the video
• Open a second tab and load about:memory, copy this page to a text file
• On about:memory, click both the GC and CC buttons to free up memory
• Close both tabs