QA/Platform/Graphics/Firefox 38

From MozillaWiki
< QA‎ | Platform‎ | Graphics
Revision as of 21:14, 10 March 2015 by Ashughes (talk | contribs) (→‎Approach)
Jump to navigation Jump to search

The following documents testing of graphics in Firefox 38 across a wide range of test environments. For more information on the methodology please consult our wiki.

Approach

Suggested tests on Youtube.com

  • basic video playback functionality
  • clicking around a lot in the seek bar (near, far, ahead, behind, near the end)
  • verify you get video suggestions when playthrough completes
  • verify you get the next video in a playlist when playthrough completes
  • check going in and out of fullscreen mode
  • check video resume after putting the machine to sleep

Other test suggestions

  • detaching and reattaching a video tab
  • switching between normal mode, theatre mode, and fullscreen mode playback
  • playing video on a secondary screen
  • video resumes from session restore

Tests informed by top tracked bugs

  • ???

What to look for

  • significant buffering pauses
  • black video
  • spike in CPU usage

Videos for stress testing 1080p60 or 4k

Instructions

Setting up the test environment

1. Install Firefox
2. Disable the automatic updater
  • Open C:\Aurora\defaults\pref\channel-prefs.js in a text editor
  • Change the line reading pref("app.update.channel", "release"); to pref("app.update.channel", "foobar");
  • Save and Close the text file
3. Launch Firefox with a clean profile
  • Run cmd.exe
  • Change directory to the folder where you installed Firefox: cd C:\Aurora
  • Run firefox.exe: firefox.exe -P -no-remote - This will bring up our profile selector window.
  • Use the "Create Profile" button to create a profile new profile
  • Once the profile is created, select it, and then click "Start Firefox"

Reporting a crash

If you encounter a crash you will see a crash reporter dialog. Use this to report the crash to Mozilla.

  • Enter a comment to describe the circumstances of the crash
  • Click submit on the crash reporter dialog
  • Restart Firefox
  • Load the about:support page and copy all of the information on that page to a text file, upload it to the Google drive location
  • Load the about:crashes page and copy the link of the crash report you submitted (it will be the one at the top of the list)
  • Report the link to the about:support page in Google drive as well as the link to your crash report

Reporting Memory Usage

  • Please continue reporting memory usage as you have
  • Naming convention: <machinename>_<firefoxbuild>_<driverlevel>_<testnumber>_memory_report.json
  • You can upload the report to the Google drive (link to be provided via email)

Tests

1. Crash with http://www.detik.com/, https://www.irctc.co.in/eticketing/home, and http://www.prothom-alo.com/
  • Load each of the URLs above
  • Resize the window smaller and larger to random sizes
  • Click a link on the page and resize the window some more
  • Switch into responsive design view (CTRL + Shift + M), change resolution, and refresh the page
  • If you encounter a crash then proceed with reporting a crash instructions
  • If you do NOT encounter a crash then this test is a PASS, move on to the next test
2. Switch video quality and seek intermittently
  • Load the about:config and click I'll be careful.
  • Search for dxva and set media.windows-media-foundation.use-dxva to true then restart Firefox
  • Load https://www.youtube.com/watch?v=hicBgE6XndM
  • Use gear icon to set to highest quality (1080HD)
  • Open full screen and play video
  • Use the bottom bar of the video to reset different quality levels (using gear icon)
  • Use the arrow keys (or the slider at the bottom of the page) to seek forward and back through the video
  • Make at least three changes to quality level and seeking then stop the video
  • Open a second tab and load about:memory, copy this page to a text file
  • On about:memory, click both the GC and CC buttons to free up memory
  • Close both tabs
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Platform/Graphics/Firefox_38&oldid=1061107"