Buildbot/Talos/Tests: Difference between revisions

Jump to navigation Jump to search
Add new twinopen test.
(Update sessionrestore description to match new test meaning (counting time from process start))
(Add new twinopen test.)
Line 1,287: Line 1,287:


Tests the amount of time it takes the open a new window. This test does not include startup time. Multiple test windows are opened in succession, results reported are the average amount of time required to create and display a window in the running instance of the browser. (Measures ctrl-n performance.)
Tests the amount of time it takes the open a new window. This test does not include startup time. Multiple test windows are opened in succession, results reported are the average amount of time required to create and display a window in the running instance of the browser. (Measures ctrl-n performance.)
{| class="mw-collapsible mw-collapsed wikitable"
! Example data
|-
| <pre>
[209.219, 222.180, 225.299, 225.970, 228.090, 229.450, 230.625, 236.315, 239.804, 242.795, 244.5, 244.770, 250.524, 251.785, 253.074, 255.349, 264.729, 266.014, 269.399, 326.190]
</pre>
|}
==== Possible regression causes ====
* None listed yet. If you fix a regression for this test and have some tips to share, this is a good place for them.
=== twinopen ===
* contact: :bdahl, :jimm, :jmaher
* source: [[https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/tests/twinopen twinopen]]
* type: Startup
* data: we open a new browser window  20 times, resulting in 1 set of 20 data points.
* summarization:
** subtest: [https://wiki.mozilla.org/Buildbot/Talos/Data#ignore_first ignore first] '''5''' data points, then take the [https://wiki.mozilla.org/Buildbot/Talos/Data#median median] of the remaining 15; [https://dxr.mozilla.org/mozilla-central/source/testing/talos/talos/test.py#l190 source: test.py]
** suite: identical to subtest
{| cellspacing="1" cellpadding="1" border="1"
|-
|Talos test name
|Description
|-
|twinopen
|Time from calling OpenBrowserWindow until the chrome of the new window has [https://developer.mozilla.org/en-US/docs/Web/Events#MozAfterPaint painted].
|}
Tests the amount of time it takes the open a new window from a currently open browser. This test does not include startup time. Multiple test windows are opened in succession, results reported are the average amount of time required to create and display a window in the running instance of the browser. (Measures ctrl-n performance.)


{| class="mw-collapsible mw-collapsed wikitable"
{| class="mw-collapsible mw-collapsed wikitable"
Confirmed users
13

edits

Navigation menu