TestEngineering/Performance/Raptor: Difference between revisions

Line 221: Line 221:
* type: page-load
* type: page-load
* browsers: Firefox desktop, Google Chrome desktop (Windows and OSX only at the moment)
* browsers: Firefox desktop, Google Chrome desktop (Windows and OSX only at the moment)
* measuring on Firefox: time-to-first-non-blank-paint, dom-content-flushed, hero element, time-to-first-interactive
* measuring on Firefox: time-to-first-non-blank-paint, dom-content-flushed, hero element, time-to-first-interactive, loadtime
* measuring on Chrome: first-contentful-paint, hero element
* measuring on Chrome: first-contentful-paint, hero element, loadtime
* page-cycles: 25
* page-cycles: 25
* reporting: Each pagecycle measures all the values (in MS). The first page-cycle is dropped due to the initial extra loading time/noise. The overall result reported for each test page is the median of the values reported for each pagecycle (in MS).
* reporting: Each pagecycle measures all the values (in MS). The first page-cycle is dropped due to the initial extra loading time/noise. The overall result reported for each test page is the median of the values reported for each pagecycle (in MS).
Line 249: Line 249:
* type: page-load
* type: page-load
* browsers: Firefox desktop, Google Chrome desktop (Windows and OSX only at the moment)
* browsers: Firefox desktop, Google Chrome desktop (Windows and OSX only at the moment)
* measuring on Firefox: time-to-first-non-blank-paint, dom-content-flushed, hero element, time-to-first-interactive
* measuring on Firefox: time-to-first-non-blank-paint, dom-content-flushed, hero element, time-to-first-interactive, loadtime
* measuring on Chrome: first-contentful-paint, hero element
* measuring on Chrome: first-contentful-paint, hero element, loadtime
* page-cycles: 25
* page-cycles: 25
* reporting: Each pagecycle measures all the values (in MS). The first page-cycle is dropped due to the initial extra loading time/noise. The overall result reported for each test page is the median of the values reported for each pagecycle (in MS).
* reporting: Each pagecycle measures all the values (in MS). The first page-cycle is dropped due to the initial extra loading time/noise. The overall result reported for each test page is the median of the values reported for each pagecycle (in MS).
Line 273: Line 273:
* type: page-load
* type: page-load
* browsers: Firefox desktop, Google Chrome desktop (Windows and OSX only at the moment)
* browsers: Firefox desktop, Google Chrome desktop (Windows and OSX only at the moment)
* measuring on Firefox: time-to-first-non-blank-paint, dom-content-flushed, time-to-first-interactive
* measuring on Firefox: time-to-first-non-blank-paint, dom-content-flushed, time-to-first-interactive, loadtime
* measuring on Chrome: first-contentful-paint
* measuring on Chrome: first-contentful-paint, loadtime
* page-cycles: 25
* page-cycles: 25
* reporting: Each pagecycle measures all the values (in MS). The first page-cycle is dropped due to the initial extra loading time/noise. The overall result reported for each test page is the median of the values reported for each pagecycle (in MS).
* reporting: Each pagecycle measures all the values (in MS). The first page-cycle is dropped due to the initial extra loading time/noise. The overall result reported for each test page is the median of the values reported for each pagecycle (in MS).
Line 294: Line 294:
* type: page-load
* type: page-load
* browsers: Firefox desktop, Google Chrome desktop (Windows and OSX only at the moment)
* browsers: Firefox desktop, Google Chrome desktop (Windows and OSX only at the moment)
* measuring on Firefox: time-to-first-non-blank-paint, dom-content-flushed, time-to-first-interactive
* measuring on Firefox: time-to-first-non-blank-paint, dom-content-flushed, time-to-first-interactive, loadtime
* measuring on Chrome: first-contentful-paint
* measuring on Chrome: first-contentful-paint, loadtime
* page-cycles: 25
* page-cycles: 25
* reporting: Each pagecycle measures all the values (in MS). The first page-cycle is dropped due to the initial extra loading time/noise. The overall result reported for each test page is the median of the values reported for each pagecycle (in MS).
* reporting: Each pagecycle measures all the values (in MS). The first page-cycle is dropped due to the initial extra loading time/noise. The overall result reported for each test page is the median of the values reported for each pagecycle (in MS).
Line 312: Line 312:
* type: page-load
* type: page-load
* browsers: Firefox desktop, Google Chrome desktop (Windows and OSX only at the moment)
* browsers: Firefox desktop, Google Chrome desktop (Windows and OSX only at the moment)
* measuring on Firefox: time-to-first-non-blank-paint, dom-content-flushed, time-to-first-interactive
* measuring on Firefox: time-to-first-non-blank-paint, dom-content-flushed, time-to-first-interactive, loadtime
* measuring on Chrome: first-contentful-paint
* measuring on Chrome: first-contentful-paint, loadtime
* page-cycles: 25
* page-cycles: 25
* reporting: Each pagecycle measures all the values (in MS). The first page-cycle is dropped due to the initial extra loading time/noise. The overall result reported for each test page is the median of the values reported for each pagecycle (in MS).
* reporting: Each pagecycle measures all the values (in MS). The first page-cycle is dropped due to the initial extra loading time/noise. The overall result reported for each test page is the median of the values reported for each pagecycle (in MS).
Line 330: Line 330:
* type: page-load
* type: page-load
* browsers: Firefox desktop, Google Chrome desktop (Windows and OSX only at the moment)
* browsers: Firefox desktop, Google Chrome desktop (Windows and OSX only at the moment)
* measuring on Firefox: time-to-first-non-blank-paint, dom-content-flushed, time-to-first-interactive
* measuring on Firefox: time-to-first-non-blank-paint, dom-content-flushed, time-to-first-interactive, loadtime
* measuring on Chrome: first-contentful-paint
* measuring on Chrome: first-contentful-paint, loadtime
* page-cycles: 25
* page-cycles: 25
* reporting: Each pagecycle measures all the values (in MS). The first page-cycle is dropped due to the initial extra loading time/noise. The overall result reported for each test page is the median of the values reported for each pagecycle (in MS).
* reporting: Each pagecycle measures all the values (in MS). The first page-cycle is dropped due to the initial extra loading time/noise. The overall result reported for each test page is the median of the values reported for each pagecycle (in MS).
Line 340: Line 340:
[raptor-tp6-reddit-*]
[raptor-tp6-reddit-*]
* URL: https://www.reddit.com/r/technology/comments/9sqwyh/we_posed_as_100_senators_to_run_ads_on_facebook/
* URL: https://www.reddit.com/r/technology/comments/9sqwyh/we_posed_as_100_senators_to_run_ads_on_facebook/
[raptor-tp6-yahoo-news-*]
* URL: https://www.yahoo.com/lifestyle/police-respond-noise-complaint-end-playing-video-games-respectful-tenants-002329963.html


==== raptor-tp6-7 ====
==== raptor-tp6-7 ====
Line 345: Line 348:
* type: page-load
* type: page-load
* browsers: Firefox desktop, Google Chrome desktop (Windows and OSX only at the moment)
* browsers: Firefox desktop, Google Chrome desktop (Windows and OSX only at the moment)
* measuring on Firefox: time-to-first-non-blank-paint, dom-content-flushed, time-to-first-interactive
* measuring on Firefox: time-to-first-non-blank-paint, dom-content-flushed, time-to-first-interactive, loadtime
* measuring on Chrome: first-contentful-paint
* measuring on Chrome: first-contentful-paint, loadtime
* page-cycles: 25
* page-cycles: 25
* reporting: Each pagecycle measures all the values (in MS). The first page-cycle is dropped due to the initial extra loading time/noise. The overall result reported for each test page is the median of the values reported for each pagecycle (in MS).
* reporting: Each pagecycle measures all the values (in MS). The first page-cycle is dropped due to the initial extra loading time/noise. The overall result reported for each test page is the median of the values reported for each pagecycle (in MS).
Line 356: Line 359:
* URL: https://www.instagram.com/
* URL: https://www.instagram.com/


[raptor-tp6-twitter-*]
* URL: https://twitter.com/BarackObama
==== raptor-tp6-8 ====
* contact: :rwood, :jmaher, :bebe
* type: page-load
* browsers: Firefox desktop, Google Chrome desktop (Windows and OSX only at the moment)
* measuring on Firefox: time-to-first-non-blank-paint, dom-content-flushed, time-to-first-interactive, loadtime
* measuring on Chrome: first-contentful-paint, loadtime
* page-cycles: 25
* reporting: Each pagecycle measures all the values (in MS). The first page-cycle is dropped due to the initial extra loading time/noise. The overall result reported for each test page is the median of the values reported for each pagecycle (in MS).
* test INI: [https://searchfox.org/mozilla-central/source/testing/raptor/raptor/tests/raptor-tp6-7.ini raptor-tp6-7.ini].
''' Test pages in tp6-8 (* = firefox or chrome):'''
[raptor-tp6-ebay-*]
* URL: https://www.ebay.com/
[raptor-tp6-wikipedia-*]
* URL: https://en.wikipedia.org/wiki/Barack_Obama


=== Benchmark Tests ===
=== Benchmark Tests ===
Confirmed users
132

edits