MozillaWiki

Buildbot/Talos/Tests: Difference between revisions

Page Discussion

Buildbot/Talos/Tests (view source)

Revision as of 16:47, 24 August 2015

813 bytes removed ,  24 August 2015
m
→‎Talos Tests: - cleaned up ts based subtests
m (→‎Talos Tests: - cleaned up ts based subtests)
Line 371: Line 371:
* summarization:
* summarization:
** subtest: [https://wiki.mozilla.org/Buildbot/Talos/DataFormat#ignore_first ignore first] data point, then take the [https://wiki.mozilla.org/Buildbot/Talos/DataFormat#median median] of the remaining 19 data points; [http://hg.mozilla.org/build/talos/file/3625fcaa75ea/talos/test.py#l135 source: test.py]
** subtest: [https://wiki.mozilla.org/Buildbot/Talos/DataFormat#ignore_first ignore first] data point, then take the [https://wiki.mozilla.org/Buildbot/Talos/DataFormat#median median] of the remaining 19 data points; [http://hg.mozilla.org/build/talos/file/3625fcaa75ea/talos/test.py#l135 source: test.py]
** suite: [https://wiki.mozilla.org/Buildbot/Talos/DataFormat#geometric_mean geometric mean] of the 1 subtest results (which is identical to that of the subtest result).
** suite: identical to subtest
*** NOTE: graphserver collects all 20 data points, removes the max value (all tests matching the max value) and returns a geometric mean of the remaining points


Launches tspaint_test.html with the current timestamp in the url, waits for [[Buildbot/Talos/Tests#Paint_Tests|MozAfterPaint and onLoad]] to fire, then records the end time and calculates the time to startup.
Launches tspaint_test.html with the current timestamp in the url, waits for [[Buildbot/Talos/Tests#Paint_Tests|MozAfterPaint and onLoad]] to fire, then records the end time and calculates the time to startup.
Line 472: Line 471:
* summarization:
* summarization:
** subtest: [https://wiki.mozilla.org/Buildbot/Talos/DataFormat#ignore_first ignore first] '''5''' data points, then take the [https://wiki.mozilla.org/Buildbot/Talos/DataFormat#median median] of the remaining 15; [http://hg.mozilla.org/build/talos/file/3625fcaa75ea/talos/test.py#l190 source: test.py]
** subtest: [https://wiki.mozilla.org/Buildbot/Talos/DataFormat#ignore_first ignore first] '''5''' data points, then take the [https://wiki.mozilla.org/Buildbot/Talos/DataFormat#median median] of the remaining 15; [http://hg.mozilla.org/build/talos/file/3625fcaa75ea/talos/test.py#l190 source: test.py]
** suite: [https://wiki.mozilla.org/Buildbot/Talos/DataFormat#geometric_mean geometric mean] of the 1 subtest results.
** suite: identical to subtest


{| cellspacing="1" cellpadding="1" border="1"
{| cellspacing="1" cellpadding="1" border="1"
Line 618: Line 617:
* summarization:
* summarization:
** subtest: [https://wiki.mozilla.org/Buildbot/Talos/DataFormat#ignore_first ignore first] '''5''' data points, then take the [https://wiki.mozilla.org/Buildbot/Talos/DataFormat#median median] of the remaining 15 data points; [http://hg.mozilla.org/build/talos/file/3625fcaa75ea/talos/test.py#l205 source: test.py]
** subtest: [https://wiki.mozilla.org/Buildbot/Talos/DataFormat#ignore_first ignore first] '''5''' data points, then take the [https://wiki.mozilla.org/Buildbot/Talos/DataFormat#median median] of the remaining 15 data points; [http://hg.mozilla.org/build/talos/file/3625fcaa75ea/talos/test.py#l205 source: test.py]
** suite: [https://wiki.mozilla.org/Buildbot/Talos/DataFormat#geometric_mean geometric mean] of the 1 subtest results (which is identical to that of the subtest result).
** suite: same as subtest result
*** NOTE: graphserver collects all 20 data points, removes the max value (all tests matching the max value) and returns a geometric mean of the remaining points


A purer form of paint measurement than tpaint. This test opens a single window positioned at 10,10 and sized to 300,300, then resizes the window outward |max| times measuring the amount of time it takes to repaint each resize. Dumps the resulting dataset and average to stdout or logfile.
A purer form of paint measurement than tpaint. This test opens a single window positioned at 10,10 and sized to 300,300, then resizes the window outward |max| times measuring the amount of time it takes to repaint each resize. Dumps the resulting dataset and average to stdout or logfile.
Line 869: Line 867:
* summarization:
* summarization:
** subtest: [https://wiki.mozilla.org/Buildbot/Talos/DataFormat#ignore_first ignore first] data point, then take the [https://wiki.mozilla.org/Buildbot/Talos/DataFormat#median median] of the remaining 9 data points; [http://hg.mozilla.org/build/talos/file/3625fcaa75ea/talos/test.py#l305 source: test.py]
** subtest: [https://wiki.mozilla.org/Buildbot/Talos/DataFormat#ignore_first ignore first] data point, then take the [https://wiki.mozilla.org/Buildbot/Talos/DataFormat#median median] of the remaining 9 data points; [http://hg.mozilla.org/build/talos/file/3625fcaa75ea/talos/test.py#l305 source: test.py]
** suite: [https://wiki.mozilla.org/Buildbot/Talos/DataFormat#geometric_mean geometric mean] of the 1 subtest results (which is equal to the subtest result).
** suite: identical to subtest


Both tests measure the time spent reading and restoring the session from a valid sessionstore.js. Time starts ticking during event sessionRestoreInit and stops during event sessionRestored.
Both tests measure the time spent reading and restoring the session from a valid sessionstore.js. Time starts ticking during event sessionRestoreInit and stops during event sessionRestored.
Jmaher
Confirmed users
3,376

edits

Retrieved from "https://wiki.mozilla.org/Special:MobileDiff/1091579"