Confirmed users
2,205
edits
TestEngineering/Performance/Raptor: Difference between revisions
Jump to navigation
Jump to search
→Page-Load Tests
| Line 32: | Line 32: | ||
* The test URL is loaded; measurements taken | * The test URL is loaded; measurements taken | ||
* The tab is reloaded 24 more times; measurements taken each time | * The tab is reloaded 24 more times; measurements taken each time | ||
* The measurements from the first page-load are not included in overall results metrics b/c of first load noise; however they are listed in the | * The measurements from the first page-load are not included in overall results metrics b/c of first load noise; however they are listed in the JSON artifacts | ||
'''Raptor warm page-load test process when running on Firefox android browser apps:''' | '''Raptor warm page-load test process when running on Firefox android browser apps:''' | ||
* The android app data is cleared (via | * The android app data is cleared (via <code>adb shell pm clear firefox.app.binary.name</code>) | ||
* The new browser profile is copied onto the android device sdcard | * The new browser profile is copied onto the android device sdcard | ||
* The Firefox android app is started up | * The Firefox android app is started up | ||
| Line 42: | Line 42: | ||
* The test URL is loaded; measurements taken | * The test URL is loaded; measurements taken | ||
* The tab is reloaded 14 more times; measurements taken each time | * The tab is reloaded 14 more times; measurements taken each time | ||
* The measurements from the first page-load are not included in overall results metrics b/c of first load noise; however they are listed in the | * The measurements from the first page-load are not included in overall results metrics b/c of first load noise; however they are listed in the JSON artifacts | ||
==== Cold Page-Load ==== | ==== Cold Page-Load ==== | ||
For cold page-load tests, the | For cold page-load tests, the browser is shut down and restarted between page load cycles; so the browser is cold on each page-load. This is what happens for Raptor cold page-load tests: | ||
'''Raptor cold page-load test process when running on Firefox/Chrome/Chromium desktop:''' | '''Raptor cold page-load test process when running on Firefox/Chrome/Chromium desktop:''' | ||
| Line 73: | Line 73: | ||
==== Using Live Sites ==== | ==== Using Live Sites ==== | ||
It is possible to use live web pages for the page-load tests instead of using the | It is possible to use live web pages for the page-load tests instead of using the mitmproxy recordings. | ||
To run a particular Raptor tp6 page-load test with live sites, open the raptor-tp6*.ini file ([https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests Raptor tests folder]), and for the test default (or under a single page/subtest) just add this attribute: | To run a particular Raptor tp6 page-load test with live sites, open the raptor-tp6*.ini file ([https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests Raptor tests folder]), and for the test default (or under a single page/subtest) just add this attribute: | ||