Confirmed users
372
edits
TestEngineering/Performance/Raptor: Difference between revisions
Jump to navigation
Jump to search
m
→raptor-tp6 more details
| Line 100: | Line 100: | ||
* contact: :rwood, :jmaher | * contact: :rwood, :jmaher | ||
* type: pageload | * type: pageload | ||
* browsers: Firefox | * browsers: Firefox only (for now) | ||
* measuring: time-to-first-non-blank-paint | * measuring: time-to-first-non-blank-paint, and hero element load time | ||
* reporting: | * reporting: For each test page both fnbpaint and time to hero element display are measured. Each pagecycle reports the mean of those two values. There are 25 pagecycles, with the first pagecycle being dropped due to the initial extra loading time/noise. The overall result reported for each test page is the median of the 24 values reported for each pagecycle (in MS). | ||
The raptor-tp6 test loads four pages (amazon, facebook, google, youtube) 25x each and measures their load performance (fnbpaint). To test all of the pages, run 'raptor-tp6'. To only test one of the individual pages, run the corresponding raptor test ('raptor-tp6-amazon-firefox', 'raptor-tp6-google-firefox', 'raptor-tp6-facebook-firefox', or 'raptor-tp6-youtube-firefox'). | The raptor-tp6 test loads four pages (amazon, facebook, google, youtube) 25x each and measures their load performance (fnbpaint). To test all of the pages, run 'raptor-tp6'. To only test one of the individual pages, run the corresponding raptor test ('raptor-tp6-amazon-firefox', 'raptor-tp6-google-firefox', 'raptor-tp6-facebook-firefox', or 'raptor-tp6-youtube-firefox'). | ||
The pages are played back from [[https://wiki.mozilla.org/Performance_sheriffing/Raptor/Mitmproxy Mitmproxy]] recordings. If you need the HTML page source (outside of the Mitmproxy recording) for debugging, the HTML can be found in our [https://github.com/mozilla/perf-automation/tree/master/pagesets perf-automation github repo]. | The pages are played back from [[https://wiki.mozilla.org/Performance_sheriffing/Raptor/Mitmproxy Mitmproxy]] recordings. If you need the HTML page source (outside of the Mitmproxy recording) for debugging, the HTML can be found in our [https://github.com/mozilla/perf-automation/tree/master/pagesets perf-automation github repo]. | ||
| Line 119: | Line 117: | ||
raptor-tp6-youtube: YouTube logo on the top left | raptor-tp6-youtube: YouTube logo on the top left | ||
To see the specific google document URLs and other raptor test settings, you can view the [https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/raptor-tp6.ini raptor-tp6.ini]. | |||
=== raptor-webaudio === | === raptor-webaudio === | ||