Firefox OS/Performance/Release Acceptance: Difference between revisions
< Firefox OS | Performance
Jump to navigation
Jump to search
Eliperelman (talk | contribs) (→2.0) |
(→2.0) |
||
| Line 30: | Line 30: | ||
|- | |- | ||
| [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame&range=30&test=startup_%3E_moz-app-visually-complete&app_list=email%20FTU&app=email%20FTU&plot=median Email] || 1000 ms | | [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame&range=30&test=startup_%3E_moz-app-visually-complete&app_list=email%20FTU&app=email%20FTU&plot=median Email] || 1000 ms | ||
|- | |- | ||
| [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame&range=30&test=startup_%3E_moz-app-visually-complete&app_list=fm&app=fm&plot=median FM Radio] || 1000 ms | | [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame&range=30&test=startup_%3E_moz-app-visually-complete&app_list=fm&app=fm&plot=median FM Radio] || 1000 ms | ||
|- | |- | ||
| [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame&range=30&test=startup_%3E_moz-app-visually-complete&app_list=gallery&app=gallery&plot=median Gallery] || 1000 ms | | [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame&range=30&test=startup_%3E_moz-app-visually-complete&app_list=gallery&app=gallery&plot=median Gallery] || 1000 ms | ||
| Line 40: | Line 38: | ||
|- | |- | ||
| SMS || 1000 ms | | SMS || 1000 ms | ||
|- | |||
| [https://datazilla.mozilla.org/b2g/?branch=v2.0&device=flame&range=30&test=startup_%3E_moz-app-visually-complete&app_list=video&app=video&plot=median Video] || 1000 ms | |||
|} | |} | ||
Revision as of 21:18, 15 July 2014
Criteria
Definitions
- Cold Launch Time
- Milliseconds elapsed from the user-initiated launch of a not-already-in-memory app to the stable display of that app and its visible content.
- Reference Workload
- A standardized collection of application data preloaded before the test is run.
Note: All measurements are the median results calculated from multiple iterations of relevant tests. For example, Datazilla's App Cold Launch values are calculated from 30 such iterations.
2.0
- Reference Device: Flame
- Reference Workload: Light
| Application | Cold Launch Time |
|---|---|
| Browser | 1000 ms |
| Camera | 1000 ms |
| Contacts | 1000 ms |
| Dialer | 1000 ms |
| 1000 ms | |
| FM Radio | 1000 ms |
| Gallery | 1000 ms |
| Settings | 1000 ms |
| SMS | 1000 ms |
| Video | 1000 ms |
NOTE: These apps have been instrumented to emit events that support timing their launch states.
1.4
- Reference Device: Buri/Hamachi
- Reference Workload: Medium
| Application | Cold Launch Time |
|---|---|
| Browser | No regression since 1.3 |
| Camera | No regression since 1.3 |
| Contacts | No regression since 1.3 |
| Dialer | No regression since 1.3 |
| No regression since 1.3 | |
| Gallery | No regression since 1.3 |
| Marketplace | No regression since 1.3 |
| Settings | No regression since 1.3 |
| SMS | No regression since 1.3 |
1.3T
- Reference Device: Tarako
Acceptance for 1.3T will be determined by reviewing final performance results which will include cold launch time.