Mozilla2:Trender

Render Benchmark

Trender is a new performance metric intended to evaluate page rendering speed as we work on moving to a Cairo world. It calcualtes the average redraw time (wall clock) of a page using a new method in nsIDOMWindowUtils over a wide set of pages; various combinations of these results are then turned into one or more composite results.

The full Trender package cannot be made public due to potential copyright issues with the test content; however, the test harness and certain tests can be public.

Results are reported on the Firefox tinderbox.

What do Tr/Tgfx/Tsvg mean?

• Trender numbers are the real-world HTML results.
• Tgfx are the synthetic test results, designed to stress a particular aspect of gfx (e.g. transparency rendering or text rendering).
• Tsvg will be a svg-only number that measures SVG rendering performance, with the current SVG test pulled out of Tgfx.

Test Code

Harness: [1]

Single-page test bookmarklet: [2]

Trender, version 20060131 (inside firewall only): [3]

Running

Open Trender.xml in the toplevel directory in the Trender zip file. The test will start automatically. Results will be displayed both in the browser and via dump(). You should enable JavaScript window resizing (it will resize to 1024x1024), and disable the info bars (for blocked popups and the like) for consistent results. If you enable JS window closing, you can load Trender.xml#tinderbox=1 to have it close the window at the end; this is useful for running from the command line.

Test Contents

• Real-world HTML tests, and reference URLs (Tr -- the actual page in the test is a static page)
  • en-amazon1 -- http://www.amazon.com/
  • en-apple1 -- http://store.apple.com/
  • en-bbc1 -- http://www.bbc.co.uk/
  • en-blago1 -- http://blago.serbianunity.net/
  • en-cnn1 -- http://www.cnn.com/
  • en-craigslist1 -- http://www.craigslist.com/
  • en-ebay2 -- http://www.ebay.com/
  • en-ebgames1 -- http://www.ebgames.com/
  • en-espn1 -- http://www.espn.com/
    • Page is slightly misrendered, but that's by design; it looks the same when you have JS disabled. It's horrible HTML. Also stripped of its popunders and other similiar crap.
  • en-gamespot -- http://www.gamespot.com/
    • Flash-neutered
  • en-imdb1 -- http://www.imdb.com/
  • en-lxr1 -- http://lxr.mozilla.org/seamonkey/search?string=nsACString
  • en-mozilla1 -- http://www.mozilla.org/
  • en-planet1 -- http://planet.mozilla.org/
  • en-slashdot1 -- http://www.slashdot.org/
  • en-yahoo1 -- http://www.yahoo.com/
  • en-icq -- http://www.icq.com/
  • en-toms -- http://www.tomshardware.com/
  • en-cnet -- http://www.cnet.com/
  • arabic-aljazeera -- http://www.aljazeera.net/
  • arabic-bbc -- http://www.bbc.co.uk/arabic/
  • arabic-fares
  • arabic-maktoob
  • bengali-bbc
  • burmese-bbc
  • chinese-bbc
  • chinese-msn
  • chinese-pchome
  • chinese-sina
  • french-bbc
  • hebrew-msn
  • hebrew-walla
  • hebrew-ynet
  • hindi-bbc
  • japanese-amazon
  • japanese-msn
  • japanese-rakuten
  • persian-bbc
  • polish-bbc
  • russian-narod
    • Weird charset issues; renders correctly under win32, fails on mac/linux
  • russian-rambler
  • serbian-bbc
  • serbian-beograd
  • tamil-bbc
  • thai-bbc

• Synthetic tests (Tgfx)
  • svg-gearflowers -- http://www.kde-look.org/content/files/19524-gearflowers.svg.gz
  • misc-trans -- http://www.vlad1.com/~vladimir/trender/misc-trans.html
  • misc-borders -- http://www.vlad1.com/~vladimir/trender/misc-borders.html
  • misc-text1 -- http://www.vlad1.com/~vladimir/trender/misc-text1.html
  • misc-tile -- http://www.vlad1.com/~vladimir/trender/misc-tile.html