Changes

Jump to: navigation, search

TestEngineering/Performance/Talos/Tests

No change in size, 19:38, 26 September 2019
Mass edit #page_sets entries to #Page_sets for proper linking.
** suite: [[../Data#geometric_mean|geometric mean]] of the 36 subtest results.
To run this locally, you'll need to pull down the [[#page_setsPage_sets|tp5 page set]] and run it in a local web server. See the [[#tp5|tp5 section]].
{| class="mw-collapsible mw-collapsed wikitable"
== tp5 ==
* contact: :davehunt
* source: [[#page_setsPage_sets|tp5n.zip]]
* type: [[TestEngineering/Performance/Talos#Page_Load_Tests|PageLoader]]
* data: we load each of the 48 tp5o pages 25 times, resulting in 48 sets of 25 data points.
* '''To run it locally''', you'd need [[#page_setsPage_sets|tp5n.zip]].
* summarization:
** subtest: [[../Data#ignore_first|ignore first]] '''5''' data points, then take the [[../Data#median|median]] of the remaining 20; [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/test.py#l449 source: test.py]
|}
Tests the time it takes Firefox to load the [[#page_setsPage_sets|tp5 web page test set]]. The web set was culled from the Alexa top 500 April 8th, 2011 and consists of 51 pages.
Here are the broad steps we use to create the test set:
== tp5o_scroll ==
* contact: :kats
* source: [[#page_setsPage_sets|tp5n.zip]]
* type: [[TestEngineering/Performance/Talos#Page_Load_Tests|PageLoader]]
* data: we load each of the 51 tp5o pages 12 times, resulting in 51 sets of 12 data points.
* '''To run it locally''', you'd need [[#page_setsPage_sets|tp5n.zip]].
* summarization:
** subtest: [[../Data#ignore_first|ignore first]] data point, then take the [[../Data#median|median]] of the remaining 11; [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/test.py#l470 source: test.py]
* reporting:
* data: we load 50 web pages 5 times each, resulting in 50 sets of 5 data points.
* '''To run it locally''', you'd need [[#page_setsPage_sets|tp5n.zip]].
* summarization:
** subtest: [[../Data#ignore_first|ignore first]] data point, then take the [[../Data#median|median]] of the remaining 4 data points; [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/test.py#l305 source: test.py]
83
edits

Navigation menu