Benchmarks

Information related to commonly used benchmarks and compliance measures for the web

Benchmarks

Bold means commonly used in media

Compliance

• HTML5Test
  • Targeted for "HTML5 Ready" apps/usage
  • Widely used in the media
• Ringmark
  • Targeted for mobile HTML5 app capabilities
  • Initiated by Facebook
  • https://bugzilla.mozilla.org/show_bug.cgi?id=748248
  • includes some WebKit-specific tests
• Acid3
  • All major browsers pass this
• Test262
  • Javascript compliance
• CSS3 Selectors Test
  • All major browsers should pass
• Browserscope
  • community driven project initiated by Google
  • includes Ringmark
  • the rich-text numbers are somewhat arbitrary and a higher score doesn't necessarily mean a better implemenation
• W3C CSS Test Suites
  • hard to run, but results from others, for some of the test suites, are available (but separated by browser engine but not by version)
  • test suites in-development aren't separated from the stable ones
• Content Security Policy Compliance Test Suite
  • CSP is a way for documents to restrict where their content can come from
  • test suite is hosted at http://csptesting.herokuapp.com/
  • test suite source at https://github.com/eoftedal/csp-testing
  • Webkit and Gecko have implementations of CSP, IE 10 only implements the CSP sandbox directive (optional in CSP 1.0, required in CSP 1.1)

Performance

General

• Futuremark Peacekeeper
• BrowserMark
• Vellamo
  • Targeted for Android
  • Only tests built-in browser
  • No source code or detailed description of tests available

Graphics

• GUIMark2
  • Vector Charting Test
    • Dominated by line stroking performance
    • 2D canvas
  • Bitmap Gaming Test
    • 2D canvas
  • Text Column Test
• GUIMark3
  • Bitmap Test
    • 2D canvas
  • Vector Test
    • 2D canvas
    • Dominated by radial gradient performance.
  • Compute Test
  • Video Test

Javascript

• V8
• Octane
  • Essentially V8 version 8
  • Alon is working on an emscripten generated alternative
• Kraken
  • Mozilla developed
  • Essentially unmaintained
• Sunspider
  • Tests run very fast which makes measurement error significant and means that the tasks are not scaled to a significant amount of work.

DOM

• Dromaeo
  • Mozilla developed

Page Load

• iBench
  • uses onLoad() which is not credible for performance
  • not available anymore.

Pan/Zoom

• Eideticker
  • Mozilla developed

Other

• MazeSolver
  • bug 776190
  • Not clear it tests anything useful for end users
• JSGamebench
  • Initiated by Facebook
• Asteroids

Benchmark Aggregators

• Tom's Hardware Guide