canmove, Confirmed users
2,041
edits
B2G/QA/2014-10-02 Performance Acceptance: Difference between revisions
Jump to navigation
Jump to search
B2G/QA/2014-10-02 Performance Acceptance (view source)
Revision as of 22:05, 6 October 2014
, 6 October 2014→Music
(→Music) |
|||
| Line 194: | Line 194: | ||
[[File:20141002 perf music.png|framed|left|FxOS Performance Comparison Results, 2.1 2014-10-02 Music]] | [[File:20141002 perf music.png|framed|left|FxOS Performance Comparison Results, 2.1 2014-10-02 Music]] | ||
<br style="clear:both;" /> | <br style="clear:both;" /> | ||
'''2.1''' | |||
* 480 data points | |||
** Median: 1093 ms | |||
** p95: 1237 ms | |||
'''Comment''': Music is not tested for 2.0. For 2.1, median launch performance is slightly over guidelines as calculated, with p95 experience trailing behind it. | |||
However, the distribution is bimodal, possibly indicating a hidden factor that only sometimes happens and confounds the test results. A guess at the medians of the two modes would be ~900 ms and ~1150 ms, indicating that without the confounding factor this might have come in under guidelines, but this bears more examination by the apps' owners. | |||
==== Settings ==== | ==== Settings ==== | ||