Firefox OS/Performance/Benchmark: Difference between revisions
< Firefox OS | Performance
Jump to navigation
Jump to search
Bobbychien (talk | contribs) (→Platform/Browser/Gecko Based: update) |
Bobbychien (talk | contribs) (→Platform/Browser/Gecko Benchmark: add mozbench) |
||
| (15 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
== Introduction == | == Introduction == | ||
== Benchmarks == | == Benchmarks == | ||
=== Application | |||
=== Methodology === | |||
* mozBench | |||
* [https://developer.mozilla.org/en-US/Firefox_OS/Automated_testing/Raptor Raptor: Performance Tools for Gaia] | |||
=== Reference Devices === | |||
* [https://developer.mozilla.org/en-US/Firefox_OS/Phone_guide/Flame Flame] | |||
* [https://en.wikipedia.org/wiki/Sony_Xperia_Z3_Compact Sony Xperia Z3 Compact (Aries)] | |||
=== Application/Gaia Bechmark=== | |||
{| class="wikitable" | {| class="wikitable" | ||
|- | |- | ||
! Benchmark !! Description !! | ! Benchmark !! Description !! Flame !! Aries | ||
|- | |- | ||
| App Cold Launch | | App Cold Launch | ||
|| | || First launch of each FxOS app | ||
|| | || [http://raptor.mozilla.org/#/dashboard/script/apps.js?device=flame-kk&branch=master&memory=1024&series=coldlaunch.visuallyLoaded Done] | ||
|| [http://raptor.mozilla.org/#/dashboard/script/apps.js?device=aries&branch=master&memory=2048&series=coldlaunch.visuallyLoaded Done] | |||
|- | |- | ||
| App Warm Launch | | App Warm Launch | ||
|| | || | ||
|| Planning | |||
|| | || | ||
|- | |- | ||
| | | [[In-Progress|Service Worker]] | ||
|| | || FxOS Service Worker Benchmark | ||
|| | || In-Progress | ||
|| In-Progress | |||
| | |||
|- | |||
|} | |} | ||
=== Platform/Browser/Gecko | === Platform/Browser/Gecko Benchmark=== | ||
{| class="wikitable" | {| class="wikitable" | ||
|- | |- | ||
! Benchmark !! Description !! | ! Benchmark !! Description !! Flame !! Aries !! Aries (mozBench) | ||
|- | |- | ||
| Octane | | Octane | ||
|| Javascript Benchmark | || Javascript Benchmark | ||
|| [http://arewefastyet.com/#machine=26&view=breakdown&suite=octane Done] | |||
|| [http://arewefastyet.com/#machine=33&view=breakdown&suite=octane Done] | |||
|| [https://raptor.mozilla.org/dashboard/script/benchmarks Done] | |||
|- | |||
| Dromaeo (Mozilla) | |||
|| Javascript Benchmark | |||
|| | |||
|| | |||
|| | || | ||
|- | |- | ||
| | | Kraken | ||
|| Javascript Benchmark | || Javascript Benchmark | ||
|| | || [http://arewefastyet.com/#machine=26&view=breakdown&suite=kraken Done] | ||
|| [http://arewefastyet.com/#machine=33&view=breakdown&suite=kraken Done] | |||
|| [https://raptor.mozilla.org/dashboard/script/benchmarks Done] | |||
|- | |- | ||
| Sunspider | | Sunspider | ||
|| Javascript Benchmark | || Javascript Benchmark | ||
|| [http://arewefastyet.com/#machine=26&view=breakdown&suite=ss Done] | |||
|| [http://arewefastyet.com/#machine=33&view=breakdown&suite=ss Done] | |||
|| | || | ||
|- | |- | ||
| Web API - Storage API | | Web API - Storage API | ||
|| Benchmark of IndexedDB and local storage | || Benchmark of IndexedDB and local storage | ||
|| | |||
|| | |||
|| | || | ||
|- | |- | ||
| Web API - Worker | | Web API - Worker | ||
|| Benchmark for Shared | || Benchmark for Shared worker | ||
|| | |||
|| | |||
|| | || | ||
|- | |- | ||
| Compliance | | Compliance | ||
|| HTML5 and CSS3 | || HTML5 and CSS3 | ||
|| | |||
|| | |||
|| | || | ||
|} | |} | ||
=== Device | === Device Benchmark=== | ||
{| class="wikitable" | {| class="wikitable" | ||
|- | |- | ||
! Benchmark !! Description !! | ! Benchmark !! Description !! Flame !! Aries | ||
|- | |- | ||
| Device Startup | | Device Startup | ||
|| | || | ||
|| | || [http://mzl.la/1ShNWEa Done] | ||
|| [http://mzl.la/1MOgsJq Done] | |||
|- | |- | ||
| [[Firefox OS/Performance/MTBF|MTBF]] | | [[Firefox OS/Performance/MTBF|MTBF]] | ||
|| The Mean Time Between Failures | || The Mean Time Between Failures | ||
|| | || [http://mzl.la/21dxx9p Done] | ||
|| [http://mzl.la/21dxuKY Done] | |||
|- | |- | ||
| [[B2G/Power Consumption|Power Consumption]] | | [[B2G/Power Consumption|Power Consumption]] | ||
|| Power consumption per test scenario | || Power consumption per test scenario | ||
|| | || [http://raptor.mozilla.org/#/dashboard/script/current.js?device=flame-kk&branch=master&memory=1024 Done] | ||
|| In-Progress | |||
|} | |} | ||
Latest revision as of 09:46, 4 January 2016
Introduction
Benchmarks
Methodology
- mozBench
- Raptor: Performance Tools for Gaia
Reference Devices
Application/Gaia Bechmark
| Benchmark | Description | Flame | Aries |
|---|---|---|---|
| App Cold Launch | First launch of each FxOS app | Done | Done |
| App Warm Launch | Planning | ||
| Service Worker | FxOS Service Worker Benchmark | In-Progress | In-Progress |
Platform/Browser/Gecko Benchmark
| Benchmark | Description | Flame | Aries | Aries (mozBench) |
|---|---|---|---|---|
| Octane | Javascript Benchmark | Done | Done | Done |
| Dromaeo (Mozilla) | Javascript Benchmark | |||
| Kraken | Javascript Benchmark | Done | Done | Done |
| Sunspider | Javascript Benchmark | Done | Done | |
| Web API - Storage API | Benchmark of IndexedDB and local storage | |||
| Web API - Worker | Benchmark for Shared worker | |||
| Compliance | HTML5 and CSS3 |
Device Benchmark
| Benchmark | Description | Flame | Aries |
|---|---|---|---|
| Device Startup | Done | Done | |
| MTBF | The Mean Time Between Failures | Done | Done |
| Power Consumption | Power consumption per test scenario | Done | In-Progress |
Working Items
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 406 [1] => Not Acceptable ) ) 1