Confirmed users
372
edits
TestEngineering/Performance/Talos/Tests: Difference between revisions
TestEngineering/Performance/Talos/Tests (view source)
Revision as of 18:19, 22 January 2018
, 22 January 2018→tp6 update
| Line 1,010: | Line 1,010: | ||
** suite: identical to subtest; each tp6_* test is reported individually (they're NOT aggregated) | ** suite: identical to subtest; each tp6_* test is reported individually (they're NOT aggregated) | ||
The talos tp6 (also known as 'quantum-pageload') test suite loads various pages and reports their load times. Each test page/URL is reported individually | The talos tp6 (also known as 'quantum-pageload') test suite loads various pages and reports their load times. Each test page/URL is reported individually. | ||
Instead of loading the page sets from a local file, a tool called [http://docs.mitmproxy.org/en/latest/introduction.html mitmproxy] is used to playback page archives via an https proxy. When the tp6 suite is run via ./mach talos-test, mozharness automatically downloads and installs the mitmproxy tool and pageset archives. | Instead of loading the page sets from a local file, a tool called [http://docs.mitmproxy.org/en/latest/introduction.html mitmproxy] is used to playback page archives via an https proxy. When the tp6 suite is run via ./mach talos-test, mozharness automatically downloads and installs the mitmproxy tool and pageset archives. | ||
The mitmproxy tool is started, the proxy setup in Firefox, and the mitmproxy https security certificate is loaded into Firefox, all automatically. The pagesets are made available for playback via the proxy, at which point each of the tp6 test pages are ready for load and measurement. | The mitmproxy tool is started, the proxy setup in Firefox, and the mitmproxy https security certificate is loaded into Firefox, all automatically. The pagesets are made available for playback via the proxy, at which point each of the tp6 test pages are ready for load and measurement. | ||
Note: For local debugging purposes, the tp6 pageset archives are also stored in their raw html (non-mitmdump archive) format on [https://github.com/rwood-moz/talos-pagesets github here]. If you wish to debug with the pagesets outside of mitmproxy then just clone that repo and you'll find them in the /talos-pagesets/tp6 folder. | |||
The tp6 suite currently consists of these individual pageload tests: | The tp6 suite currently consists of these individual pageload tests: | ||
| Line 1,024: | Line 1,026: | ||
|- | |- | ||
| tp6_amazon | | tp6_amazon | ||
| Measures page load of an amazon search result for the keyword "laptop" | | Measures page load (first non-blank paint) of an amazon search result for the keyword "laptop" | ||
|- | |- | ||
| tp6_facebook | | tp6_facebook | ||
| Measures page load of a facebook timeline (post-login) | | Measures page load (first non-blank paint) of a facebook timeline (post-login) | ||
|- | |- | ||
| tp6_google | | tp6_google | ||
| Measures page load of a google search result for the keywords "barack obama" | | Measures page load (hero element) of a google search result for the keywords "barack obama" | ||
|- | |- | ||
| tp6_youtube | | tp6_youtube | ||
| Measures page load of the youtube home page | | Measures page load (first non-blank paint) of the youtube home page | ||
|} | |} | ||