TestEngineering/Performance/Talos/Tests: Difference between revisions

update links
(update links)
(update links)
Line 87: Line 87:
* data: we load 2 pages 25 times each, collect 2 sets of 25 data points
* data: we load 2 pages 25 times each, collect 2 sets of 25 data points
* summarization
* summarization
** subtest: [https://wiki.mozilla.org/Buildbot/Talos/Data#ignore_first ignore first] data point, then take the [https://wiki.mozilla.org/Buildbot/Talos/Data#median median] of the remaining 24; [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/test.py#l627 source: test.py]
** subtest: [https://wiki.mozilla.org/Performance_sheriffing/Talos/Data#ignore_first ignore first] data point, then take the [https://wiki.mozilla.org/Performance_sheriffing/Talos/Data#median median] of the remaining 24; [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/test.py#l627 source: test.py]
** suite: [https://wiki.mozilla.org/Buildbot/Talos/Data#geometric_mean geometric mean] of the 2 subtest results.
** suite: [https://wiki.mozilla.org/Performance_sheriffing/Talos/Data#geometric_mean geometric mean] of the 2 subtest results.


* reporting: test time in ms (lower is better)
* reporting: test time in ms (lower is better)
160

edits