Mobile/Testing/05 08 13: Difference between revisions

Line 43: Line 43:


* Now performing 16 runs per test. Could not use 32 due to the increase in test time per build. Test time per build now over an hour.
* Now performing 16 runs per test. Could not use 32 due to the increase in test time per build. Test time per build now over an hour.
* Measuring uncached values on first load, cached values on second load instead of the old approach of independent measurements with preferences controlling the cache.
* Measuring uncached values on first load, cached values on second load instead of the old approach of independent measurements with preferences controlling the cache.
* Option to show standard error or standard deviation.
* Option to show standard error or standard deviation.
* Now click data point to display tooltip. Need to click graph area to dismiss. {{Bug|868609}}  
* Now click data point to display tooltip. Need to click graph area to dismiss. {{Bug|868609}}  
* New Production data: http://mrcote.info/phonedash Current since April 30, back filling April tinderbox builds. Will back fill Nightly builds as time permits.
* New Production data: http://mrcote.info/phonedash Current since April 30, back filling April tinderbox builds. Will back fill Nightly builds as time permits.
* Comparing to the old Production data: http://mrcote.info/phonedash_bc
* Comparing to the old Production data: http://mrcote.info/phonedash_bc
** Recent variability in remote pages much improved.
** Recent variability in remote pages much improved.
** Cached versus uncached values more reasonable.
** Cached versus uncached values more reasonable.
* Issues
* Issues
** gs3 very flaky with regard to pushing profiles and test pages to device.
** gs3 very flaky with regard to pushing profiles and test pages to device.
** gs2, gs3 have highly variable throbber start, stop for Local Blank page but Throbber total is not.
** gs2, gs3 have highly variable throbber start, stop for Local Blank page but Throbber total is not.


Confirmed users
726

edits