Mozilla2:Trender: Difference between revisions
| (5 intermediate revisions by the same user not shown) | |||
| Line 1: | Line 1: | ||
=== | === Render Benchmark === | ||
Trender is a new performance metric intended to evaluate page rendering speed as we work on moving to a Cairo world. It calcualtes the average redraw time (wall clock) of a page using a new method in nsIDOMWindowUtils over a wide set of pages; various combinations of these results are then turned into one or more composite results. | Trender is a new performance metric intended to evaluate page rendering speed as we work on moving to a Cairo world. It calcualtes the average redraw time (wall clock) of a page using a new method in nsIDOMWindowUtils over a wide set of pages; various combinations of these results are then turned into one or more composite results. | ||
| Line 6: | Line 5: | ||
The full Trender package cannot be made public due to potential copyright issues with the test content; however, the test harness and certain tests can be public. | The full Trender package cannot be made public due to potential copyright issues with the test content; however, the test harness and certain tests can be public. | ||
Results are reported on [http://tinderbox.mozilla.org/showbuilds.cgi?tree=Firefox | Results are reported on [http://tinderbox.mozilla.org/showbuilds.cgi?tree=Firefox the Firefox tinderbox]. | ||
==== What do Tr/Tgfx/Tsvg mean? ==== | |||
* ''Trender'' numbers are the real-world HTML results. | |||
* ''Tgfx'' are the synthetic test results, designed to stress a particular aspect of gfx (e.g. transparency rendering or text rendering). | |||
* ''Tsvg'' will be a svg-only number that measures SVG rendering performance, with the current SVG test pulled out of Tgfx. | |||
==== Test Code ==== | ==== Test Code ==== | ||
| Line 14: | Line 19: | ||
Single-page test bookmarklet: [http://blog.vlad1.com/archives/2005/10/28/74/] | Single-page test bookmarklet: [http://blog.vlad1.com/archives/2005/10/28/74/] | ||
Trender, version | Trender, version 20060131 (inside firewall only): [http://fs/public/Users/vladimir/misc/Trender-20060131.zip] | ||
==== Running ==== | |||
Open Trender.xml in the toplevel directory in the Trender zip file. The test will start automatically. Results will be displayed both in the browser and via dump(). You should enable JavaScript window resizing (it will resize to 1024x1024), and disable the info bars (for blocked popups and the like) for consistent results. If you enable JS window closing, you can load Trender.xml#tinderbox=1 to have it close the window at the end; this is useful for running from the command line. | |||
==== Test Contents ==== | ==== Test Contents ==== | ||
* Real-world HTML tests, and reference URLs (the actual page in the test is a static page) | * Real-world HTML tests, and reference URLs (Tr -- the actual page in the test is a static page) | ||
** <s>en-amazon1 -- [http://www.amazon.com/ http://www.amazon.com/]</s> | ** <s>en-amazon1 -- [http://www.amazon.com/ http://www.amazon.com/]</s> | ||
** en-apple1 -- [http://store.apple.com/ http://store.apple.com/] | ** en-apple1 -- [http://store.apple.com/ http://store.apple.com/] | ||
| Line 68: | Line 77: | ||
** thai-bbc | ** thai-bbc | ||
* Synthetic tests | * Synthetic tests (Tgfx) | ||
** svg-gearflowers -- [http://www.kde-look.org/content/files/19524-gearflowers.svg.gz http://www.kde-look.org/content/files/19524-gearflowers.svg.gz] | ** svg-gearflowers -- [http://www.kde-look.org/content/files/19524-gearflowers.svg.gz http://www.kde-look.org/content/files/19524-gearflowers.svg.gz] | ||
** misc-trans -- [http://www.vlad1.com/~vladimir/trender/misc-trans.html http://www.vlad1.com/~vladimir/trender/misc-trans.html] | ** misc-trans -- [http://www.vlad1.com/~vladimir/trender/misc-trans.html http://www.vlad1.com/~vladimir/trender/misc-trans.html] | ||
Latest revision as of 18:01, 13 June 2007
Render Benchmark
Trender is a new performance metric intended to evaluate page rendering speed as we work on moving to a Cairo world. It calcualtes the average redraw time (wall clock) of a page using a new method in nsIDOMWindowUtils over a wide set of pages; various combinations of these results are then turned into one or more composite results.
The full Trender package cannot be made public due to potential copyright issues with the test content; however, the test harness and certain tests can be public.
Results are reported on the Firefox tinderbox.
What do Tr/Tgfx/Tsvg mean?
- Trender numbers are the real-world HTML results.
- Tgfx are the synthetic test results, designed to stress a particular aspect of gfx (e.g. transparency rendering or text rendering).
- Tsvg will be a svg-only number that measures SVG rendering performance, with the current SVG test pulled out of Tgfx.
Test Code
Harness: [1]
Single-page test bookmarklet: [2]
Trender, version 20060131 (inside firewall only): [3]
Running
Open Trender.xml in the toplevel directory in the Trender zip file. The test will start automatically. Results will be displayed both in the browser and via dump(). You should enable JavaScript window resizing (it will resize to 1024x1024), and disable the info bars (for blocked popups and the like) for consistent results. If you enable JS window closing, you can load Trender.xml#tinderbox=1 to have it close the window at the end; this is useful for running from the command line.
Test Contents
- Real-world HTML tests, and reference URLs (Tr -- the actual page in the test is a static page)
en-amazon1 -- http://www.amazon.com/- en-apple1 -- http://store.apple.com/
- en-bbc1 -- http://www.bbc.co.uk/
- en-blago1 -- http://blago.serbianunity.net/
- en-cnn1 -- http://www.cnn.com/
- en-craigslist1 -- http://www.craigslist.com/
- en-ebay2 -- http://www.ebay.com/
- en-ebgames1 -- http://www.ebgames.com/
- en-espn1 -- http://www.espn.com/
- Page is slightly misrendered, but that's by design; it looks the same when you have JS disabled. It's horrible HTML. Also stripped of its popunders and other similiar crap.
- en-gamespot -- http://www.gamespot.com/
- Flash-neutered
- en-imdb1 -- http://www.imdb.com/
- en-lxr1 -- http://lxr.mozilla.org/seamonkey/search?string=nsACString
- en-mozilla1 -- http://www.mozilla.org/
- en-planet1 -- http://planet.mozilla.org/
- en-slashdot1 -- http://www.slashdot.org/
- en-yahoo1 -- http://www.yahoo.com/
- en-icq -- http://www.icq.com/
- en-toms -- http://www.tomshardware.com/
- en-cnet -- http://www.cnet.com/
- arabic-aljazeera -- http://www.aljazeera.net/
- arabic-bbc -- http://www.bbc.co.uk/arabic/
- arabic-fares
- arabic-maktoob
- bengali-bbc
- burmese-bbc
- chinese-bbc
- chinese-msn
- chinese-pchome
- chinese-sina
- french-bbc
- hebrew-msn
- hebrew-walla
- hebrew-ynet
- hindi-bbc
- japanese-amazon
- japanese-msn
- japanese-rakuten
- persian-bbc
- polish-bbc
- russian-narod
- Weird charset issues; renders correctly under win32, fails on mac/linux
- russian-rambler
- serbian-bbc
- serbian-beograd
- tamil-bbc
- thai-bbc
- Synthetic tests (Tgfx)
- svg-gearflowers -- http://www.kde-look.org/content/files/19524-gearflowers.svg.gz
- misc-trans -- http://www.vlad1.com/~vladimir/trender/misc-trans.html
- misc-borders -- http://www.vlad1.com/~vladimir/trender/misc-borders.html
- misc-text1 -- http://www.vlad1.com/~vladimir/trender/misc-text1.html
- misc-tile -- http://www.vlad1.com/~vladimir/trender/misc-tile.html