Firefox OS/Performance/Benchmark: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(→‎Application Based: Update MCTS)
 
(11 intermediate revisions by 2 users not shown)
Line 1: Line 1:
== Introduction ==
== Introduction ==


== Benchmarks ==
== Benchmarks ==
=== Application Based===
 
=== Methodology ===
* mozBench
* [https://developer.mozilla.org/en-US/Firefox_OS/Automated_testing/Raptor Raptor: Performance Tools for Gaia]
 
=== Reference Devices ===
* [https://developer.mozilla.org/en-US/Firefox_OS/Phone_guide/Flame Flame]
* [https://en.wikipedia.org/wiki/Sony_Xperia_Z3_Compact Sony Xperia Z3 Compact (Aries)]
 
=== Application/Gaia Bechmark===


{| class="wikitable"
{| class="wikitable"
|-
|-
! Benchmark !! Description !! MCTS !! Flame !! Aries
! Benchmark !! Description !! Flame !! Aries
|-
|-
| App Cold Launch  
| App Cold Launch  
||  
|| First launch of each FxOS app
||
|| [http://raptor.mozilla.org/#/dashboard/script/apps.js?device=flame-kk&branch=master&memory=1024&series=coldlaunch.visuallyLoaded Done]
|| [http://raptor.mozilla.org/#/dashboard/script/apps.js?device=flame-kk&branch=master&memory=1024&series=coldlaunch.visuallyLoaded Done]
|| [http://raptor.mozilla.org/#/dashboard/script/apps.js?device=aries&branch=master&memory=2048&series=coldlaunch.visuallyLoaded Done]
|| [http://raptor.mozilla.org/#/dashboard/script/apps.js?device=aries&branch=master&memory=2048&series=coldlaunch.visuallyLoaded Done]
Line 19: Line 28:
||  
||  
|-
|-
| Page Load Time (Non-cached)
| [[In-Progress|Service Worker]]
||  
|| FxOS Service Worker Benchmark
||
|| In-Progress
||
|| In-Progress
||
|-
| Page Load Time (Cached)
||
||
||
||
|-
| Per app-based performance data
|| Collect CPU usage, memory usage, FPS during a app test
||
||
||
|}
|}


=== Platform/Browser/Gecko Based===
=== Platform/Browser/Gecko Benchmark===


{| class="wikitable"
{| class="wikitable"
|-
|-
! Benchmark !! Description !! Flame !! Aries
! Benchmark !! Description !! Flame !! Aries !! Aries (mozBench)
|-
|-
| Octane
| Octane
|| Javascript Benchmark
|| Javascript Benchmark
|| [http://arewefastyet.com/#machine=26&view=breakdown&suite=octane Done]
|| [http://arewefastyet.com/#machine=33&view=breakdown&suite=octane Done]
|| [https://raptor.mozilla.org/dashboard/script/benchmarks Done]
|-
| Dromaeo (Mozilla)
|| Javascript Benchmark
||
||
||
||
||
|-
|-
| Dromaeo (Mozilla)
| Kraken
|| Javascript Benchmark
|| Javascript Benchmark
||  
|| [http://arewefastyet.com/#machine=26&view=breakdown&suite=kraken Done]
||
|| [http://arewefastyet.com/#machine=33&view=breakdown&suite=kraken Done]
|| [https://raptor.mozilla.org/dashboard/script/benchmarks Done]
|-
|-
| Sunspider
| Sunspider
|| Javascript Benchmark
|| Javascript Benchmark
||
|| [http://arewefastyet.com/#machine=26&view=breakdown&suite=ss Done]
|| [http://arewefastyet.com/#machine=33&view=breakdown&suite=ss Done]
||
||
|-
|-
| Web API - Storage API  
| Web API - Storage API  
|| Benchmark of IndexedDB and local storage  
|| Benchmark of IndexedDB and local storage  
||
||
||
||
||
|-
|-
| Web API - Worker
| Web API - Worker
|| Benchmark for Shared, Web and Service worker  
|| Benchmark for Shared worker
||
||
||
||
||
Line 71: Line 78:
| Compliance
| Compliance
|| HTML5 and CSS3
|| HTML5 and CSS3
||
||
||
||
||
|}
|}


=== Device Based===
=== Device Benchmark===


{| class="wikitable"
{| class="wikitable"
Line 82: Line 90:
|-
|-
| Device Startup
| Device Startup
||  
||
|| [http://raptor.mozilla.org/#/dashboard/script/core.js?device=flame-kk&branch=master&memory=1024&series=reboot.* Done]
|| [http://mzl.la/1ShNWEa Done]
|| [http://raptor.mozilla.org/#/dashboard/script/core.js?device=aries&branch=master&memory=2048&series=reboot.* Done]
|| [http://mzl.la/1MOgsJq Done]
|-
|-
| [[Firefox OS/Performance/MTBF|MTBF]]
| [[Firefox OS/Performance/MTBF|MTBF]]
|| The Mean Time Between Failures  
|| The Mean Time Between Failures  
|| [http://raptor.mozilla.org/#/dashboard/script/mtbf.js Done]  
|| [http://mzl.la/21dxx9p Done]
||
|| [http://mzl.la/21dxuKY Done]
|-
|-
| [[B2G/Power Consumption|Power Consumption]]
| [[B2G/Power Consumption|Power Consumption]]
|| Power consumption per test scenario
|| Power consumption per test scenario
|| [http://raptor.mozilla.org/#/dashboard/script/current.js?device=flame-kk&branch=master&memory=1024 Done]  
|| [http://raptor.mozilla.org/#/dashboard/script/current.js?device=flame-kk&branch=master&memory=1024 Done]  
||
|| In-Progress
|}
|}


Latest revision as of 09:46, 4 January 2016

Introduction

Benchmarks

Methodology

Reference Devices

Application/Gaia Bechmark

Benchmark Description Flame Aries
App Cold Launch First launch of each FxOS app Done Done
App Warm Launch Planning
Service Worker FxOS Service Worker Benchmark In-Progress In-Progress

Platform/Browser/Gecko Benchmark

Benchmark Description Flame Aries Aries (mozBench)
Octane Javascript Benchmark Done Done Done
Dromaeo (Mozilla) Javascript Benchmark
Kraken Javascript Benchmark Done Done Done
Sunspider Javascript Benchmark Done Done
Web API - Storage API Benchmark of IndexedDB and local storage
Web API - Worker Benchmark for Shared worker
Compliance HTML5 and CSS3

Device Benchmark

Benchmark Description Flame Aries
Device Startup Done Done
MTBF The Mean Time Between Failures Done Done
Power Consumption Power consumption per test scenario Done In-Progress

Working Items

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);


External Links

Retrieved from "https://wiki.mozilla.org/index.php?title=Firefox_OS/Performance/Benchmark&oldid=1111145"