Buildbot/Talos/Tests: Difference between revisions

m (Add new perf-reftests to the talos test list)
Line 202: Line 202:
2;2.WebGL-terrain-alpha-yes-AA-no;24.01795;23.889449;24.2683;24.34649;23.0562;24.02275;23.54819;24.1874;23.93545;23.53629;23.305149;23.62459;24.01589;24.06405;24.143449;23.998549;24.08205;24.26989;24.0736;24.2346;24.01145;23.7817;23.90785;24.7118;24.2834
2;2.WebGL-terrain-alpha-yes-AA-no;24.01795;23.889449;24.2683;24.34649;23.0562;24.02275;23.54819;24.1874;23.93545;23.53629;23.305149;23.62459;24.01589;24.06405;24.143449;23.998549;24.08205;24.26989;24.0736;24.2346;24.01145;23.7817;23.90785;24.7118;24.2834
3;3.WebGL-terrain-alpha-yes-AA-yes;25.91375;25.87005;25.64875;25.15615;25.5475;24.497449;24.56385;25.57529;25.54889;26.31559;24.143949;25.09895;24.75049;25.2087;25.52385;25.9017;25.4439;24.3495;25.9269;25.734449;26.4126;25.547449;25.667249;25.679349;25.9565
3;3.WebGL-terrain-alpha-yes-AA-yes;25.91375;25.87005;25.64875;25.15615;25.5475;24.497449;24.56385;25.57529;25.54889;26.31559;24.143949;25.09895;24.75049;25.2087;25.52385;25.9017;25.4439;24.3495;25.9269;25.734449;26.4126;25.547449;25.667249;25.679349;25.9565
</pre>
|}
==== Possible regression causes ====
* None listed yet. If you fix a regression for this test and have some tips to share, this is a good place for them.
=== glvideo ===
* contact: :daoshengmu
* source: [[https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/tests/webgl/benchmarks/video glvideo]]
* type: [https://wiki.mozilla.org/Buildbot/Talos#Page_Load_Tests PageLoader]
* data: 5 cycles of the entire benchmark, each subtest will have 5 data points (see below)
* summarization:
** subtest: [https://wiki.mozilla.org/Buildbot/Talos/Data#ignore_first ignore first] data point, then take the [https://wiki.mozilla.org/Buildbot/Talos/Data#median median] of the remaining 4; [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/test.py#l522 source: test.py]
** suite: [https://wiki.mozilla.org/Buildbot/Talos/Data#geometric_mean geometric mean] of the 4 subtest results.
* '''Lower is better'''
* unit: ms/100 ticks
{| cellspacing="1" cellpadding="1" border="1"
|-
| Talos test name
| Description
|-
|glvideo
|WebGL video texture update with 1080p video. Measures mean tick time across 100 ticks.
|}
{| class="mw-collapsible mw-collapsed wikitable"
! Example data
|-
| <pre>
0;Mean tick time across 100 ticks: ;54.6916;49.0534;51.21645;51.239650000000005;52.44295
</pre>
</pre>
|}
|}
85

edits