Confirmed users
372
edits
TestEngineering/Performance/Raptor: Difference between revisions
Jump to navigation
Jump to search
m
→raptor-gdocs add more details
| Line 49: | Line 49: | ||
* type: pageload | * type: pageload | ||
* browsers: Firefox | * browsers: Firefox | ||
* measuring: time-to-first-non-blank-paint | * measuring: time-to-first-non-blank-paint, and hero element load time | ||
* reporting: | * reporting: For each test page both fnbpaint and time to hero element display are measured. Each pagecycle reports the mean of those two values. There are 25 pagecycles, with the first pagecycle being dropped due to the initial extra loading time/noise. The overall result reported for each test page is the median of the 24 values reported for each pagecycle. | ||
The raptor-gdocs test loads three pages (a google document, a google sheets spreadsheet, and a google shares presentation) 25x each and measures their load performance (fnbpaint). To test all of the pages, run 'raptor-gdocs'. To only test one of the individual pages, run the corresponding raptor test ('raptor-google-docs-firefox', 'raptor-google-sheets-firefox', or 'raptor-google-slides-firefox'). | The raptor-gdocs test loads three pages (a google document, a google sheets spreadsheet, and a google shares presentation) 25x each and measures their load performance (fnbpaint, and hero element). To test all of the pages, run 'raptor-gdocs'. To only test one of the individual pages, run the corresponding raptor test ('raptor-google-docs-firefox', 'raptor-google-sheets-firefox', or 'raptor-google-slides-firefox'). | ||
In each of the test page (doc/slides/sheets) recordings, there is a [[https://wiki.mozilla.org/Performance_sheriffing/Raptor/Mitmproxy#Adding_Hero_Elements hero element]] located as part of the blue 'Sign In' button on the top right. | In each of the test page (doc/slides/sheets) recordings, there is a [[https://wiki.mozilla.org/Performance_sheriffing/Raptor/Mitmproxy#Adding_Hero_Elements hero element]] located as part of the blue 'Sign In' button on the top right. | ||
The pages are played back from [[https://wiki.mozilla.org/Performance_sheriffing/Raptor/Mitmproxy Mitmproxy]] recordings. If you need the HTML page source (outside of the Mitmproxy recording) for debugging, the HTML can be found in our [https://github.com/mozilla/perf-automation/tree/master/pagesets perf-automation github repo]. | |||
To see the specific google document URLs and other raptor test settings, you can view the [https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/raptor-gdocs.ini raptor-gdocs.ini]. | |||
=== raptor-motionmark === | === raptor-motionmark === | ||