Personal tools

Mobile/Performance/S1S2-Tests

From MozillaWiki

Jump to: navigation, search

Video Results: https://docs.google.com/spreadsheet/ccc?key=0Arku3jleCA0UdFVQS211Z29sV202MFdMdE5ldHA1NkE&hl=en_US#gid=0 Manual Testing: Droid Pro Results: https://docs.google.com/spreadsheet/ccc?key=0Arku3jleCA0UdDdOWWxBdU5hSDNQMkRzbGs5TVA2Q0E&hl=en_US#gid=10 Nexus S Results: https://docs.google.com/spreadsheet/ccc?key=0Arku3jleCA0UdFNQdkpuWVZIbjBPQ1gxa3RldzF2b1E&hl=en_US#gid=0 Galaxy S II Results: https://docs.google.com/spreadsheet/ccc?key=0Arku3jleCA0UdFEyN0F2SFpJMWltUUJJYmNPMkNtWlE&hl=en_US#gid=6 11:02, 18 April 2012 (PDT)11:02, 18 April 2012 (PDT)11:02, 18 April 2012 (PDT)~ Device Setup: Checklist : 1. get build from http://ftp.mozilla.org/pub/mozilla.org/mobile/nightly/latest-mozilla-central-android/ 2. uninstall fennec 3. install new fennec 4. verify on the android settings:

Wireless&network:

   turn wireless off (turn on airplane mode) [for local file testing]
   turn bluetooth off
   set Network Mode to CDMA

Call settings: - (if settings is there):

   turn off proximity sensor
   turn off own video in received calls
   turn off use call fail options

Battery & data manager:

   Data Delivery
   uncheck Background data
   uncheck data enabled
   Social applications
   set Sync over Wi-Fi Only
   sync every 60 minutes

Sound:

   turn on silent mode
   turn off haptic feedback

Display:

   turn off automatic brightness
   turn off auto-rotate screen
   turn off animation
   turn off timeout (never time out)
   set wallpaper to static wallpaper
   turn off roaming banner
   turn off in-pocket detection

Accounts and sync

   turn off Background data
   turn off auto-sync

Motion

   turn off motion activation

Privacy

   turn off backup my data

Location & security:

   turn off Google location services
   turn off Standalone GPS services
   turn off VZW location services
   turn off bluetooth bypass

Accounts:

   go into account : 
   uncheck all sync checkboxes

Accessibility :

   turn off accessibility

Date & time

   turn off automatic

Application settings:

   Running Services :
   turn off all but settings, keyboard

5. Remove all Android widgets from the home page 6. Turn off Send performance data in fennec ; make sure to launch fennec manually and turn off the notification for sending anonymous usage information. Note: *** kill all running services except settings and vkb settings -> application -> running services Certain services still come back : Google Services, Media remove google search from the front page *** also to note : - wait about 15 seconds to relaunch. average of 8 seconds for garbage collection. - throw out any garbage collection that happen during the run. - for services that reappear do not worry about killing those services. Directions: 0) be sure to setup the device accordingly to the device setup check list above. 1) Download  : http://dump.lassey.us/time onto the desktop machine 2) using adb : adb push time /data/local 3) change the permission of the file so you can execute: ie adb shell chmod 777 /data/local/time 4) download http://people.mozilla.com/~nhirata/Perf/startup5.html and http://people.mozilla.com/~nhirata/Perf/favorites2.html onto the desktop machine push the html files to the android device using: adb push <local file> /sdcard/download/ 5) To setup the local file on the network: if you are on a mac, place the html files in the ~/Sites/ folder then in the System Preferences, turn on the Sharing -> Web Sharing the ip address of the website should be listed. 6) reboot the android device 7) adb shell 8) for each of the following commands, run them and record the data at the spreadsheet based on the device, close the window and then force quit the application (note: do not go to the home screen after force quitting the application): Wait 15 seconds before running the command again Note: be sure to throw out the first value of each set of run as it may be skewed due to loading of the cache. Droid Pro: https://docs.google.com/spreadsheet/ccc?key=0Arku3jleCA0UdDdOWWxBdU5hSDNQMkRzbGs5TVA2Q0E&hl=en_US#gid=4 Nexus S : https://docs.google.com/spreadsheet/ccc?key=0Arku3jleCA0UdFNQdkpuWVZIbjBPQ1gxa3RldzF2b1E&hl=en_US#gid=0 Galaxy S II: https://docs.google.com/spreadsheet/ccc?key=0Arku3jleCA0UdFEyN0F2SFpJMWltUUJJYmNPMkNtWlE&hl=en_US#gid=0 Note: Original file for twitter page can be found at : http://people.mozilla.com/~nhirata/Perf/m.twitter.com/twitter.com/toptweets/ Original file for the ts page can be found at : http://people.mozilla.com/~nhirata/Perf/startup.html TS test based on http://blog.vlad1.com/2009/07/28/measuring-startup/ 11:02, 18 April 2012 (PDT)11:02, 18 April 2012 (PDT)11:02, 18 April 2012 (PDT) Nightly + Native UI Nightly can be downloaded : http://ftp.mozilla.org/pub/mozilla.org/mobile/nightly/latest-mozilla-central-android-r7/ NativeUI can be downloaded: http://ftp.mozilla.org/pub/mozilla.org/mobile/nightly/latest-birch-android/ local file onload js

   am start -a android.intent.action.VIEW -n org.mozilla.fennec/.App -d file://mnt/sdcard/download/startup5.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local file twitter + onload js

   am start -a android.intent.action.VIEW -n org.mozilla.fennec/.App -d file://mnt/sdcard/download/favorites2.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network onload js

   am start -a android.intent.action.VIEW -n org.mozilla.fennec/.App -d http://192.168.1.109/~nhirata/startup5.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network twitter+onload js

   am start -a android.intent.action.VIEW -n org.mozilla.fennec/.App -d http://192.168.1.109/~nhirata/favorites2.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

SoftVision network: local file onload js

   am start -a android.intent.action.VIEW -n org.mozilla.fennec/.App -d  file://mnt/sdcard/download/m.twitter.com/twitter.com/toptweets/startup11.html#"`millistring=\`/data/local/time\`;  echo \`date \"+%s\"\`${millistring##*.}`" 

local network onload js

   am start -a android.intent.action.VIEW -n org.mozilla.fennec/.App -d http://192.168.77.59/~vlad.ghetiu/m.twitter.com/twitter.com/toptweets/startup11.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network twitter+onload js

   am start -a android.intent.action.VIEW -n org.mozilla.fennec/.App -d http://192.168.77.59/~vlad.ghetiu/m.twitter.com/twitter.com/toptweets/favorites3.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

11:02, 18 April 2012 (PDT)11:02, 18 April 2012 (PDT)Nhirata Dolphin: local file twitter

   am start -a android.intent.action.VIEW  -n mobi.mgeek.TunnyBrowser/.BrowserActivity -d file://mnt/sdcard/download/startup5.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local file twitter + onload js:

   am start -a android.intent.action.VIEW  -n mobi.mgeek.TunnyBrowser/.BrowserActivity -d file://mnt/sdcard/download/favorites2.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network onload js

   am start -a android.intent.action.VIEW  -n mobi.mgeek.TunnyBrowser/.BrowserActivity -d http://192.168.1.109/~nhirata/m.twitter.com/twitter.com/toptweets/startup11.html#`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network twitter + onload js:

   am start -a android.intent.action.VIEW  -n mobi.mgeek.TunnyBrowser/.BrowserActivity -d http://192.168.1.109/~nhirata/m.twitter.com/twitter.com/toptweets/favorites3.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

SoftVision network: local file onload js

   am start -a android.intent.action.VIEW  -n mobi.mgeek.TunnyBrowser/.BrowserActivity -d file://mnt/sdcard/download/m.twitter.com/twitter.com/toptweets/startup11.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network onload js

   am start -a android.intent.action.VIEW  -n mobi.mgeek.TunnyBrowser/.BrowserActivity -d http://192.168.77.59/~vlad.ghetiu/m.twitter.com/twitter.com/toptweets/startup11.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network twitter + onload js:

   am start -a android.intent.action.VIEW  -n mobi.mgeek.TunnyBrowser/.BrowserActivity -d http://192.168.77.59/~vlad.ghetiu/m.twitter.com/twitter.com/toptweets/favorites3.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

11:02, 18 April 2012 (PDT)11:02, 18 April 2012 (PDT)~~ Opera: local file onload js

   am start  -a android.intent.action.VIEW -n com.opera.browser/com.opera.Opera -d file://mnt/sdcard/download/startup5.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local file twitter + onload js:

   am start  -a android.intent.action.VIEW -n com.opera.browser/com.opera.Opera -d file://mnt/sdcard/download/favorites2.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network onload js

   am start  -a android.intent.action.VIEW -n com.opera.browser/com.opera.Opera -d http://192.168.1.109/~nhirata/startup5.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network twitter + onload js:

   am start  -a android.intent.action.VIEW -n com.opera.browser/com.opera.Opera -d http://10.250.3.181/~nhirata/favorites2.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

SoftVision network: local file onload js

   am start  -a android.intent.action.VIEW -n com.opera.browser/com.opera.Opera -d file://mnt/sdcard/download/m.twitter.com/twitter.com/toptweets/startup11.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network onload js

   am start  -a android.intent.action.VIEW -n com.opera.browser/com.opera.Opera -d http://192.168.77.59/~vlad.ghetiu/m.twitter.com/twitter.com/toptweets/startup11.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network twitter + onload js:

   am start  -a android.intent.action.VIEW -n com.opera.browser/com.opera.Opera -d http://192.168.77.59/~vlad.ghetiu/m.twitter.com/twitter.com/toptweets/favorites3.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

11:02, 18 April 2012 (PDT)11:02, 18 April 2012 (PDT)Nhirata 11:02, 18 April 2012 (PDT) Default Browser: local file twitter:

   am start -a android.intent.action.VIEW  -n com.android.browser/.BrowserActivity -d file://mnt/sdcard/download/startup5.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local file twitter + onload js:

   am start -a android.intent.action.VIEW  -n com.android.browser/.BrowserActivity -d file://mnt/sdcard/download/favorites2.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network onload js

   am start -a android.intent.action.VIEW  -n com.android.browser/.BrowserActivity -d http://192.168.1.109/~nhirata/startup5.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network twitter + onload js:

   am start -a android.intent.action.VIEW  -n com.android.browser/.BrowserActivity -d http://192.168.1.109/~nhirata/favorites2.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

SoftVision network: local file twitter:

   am start -a android.intent.action.VIEW  -n com.android.browser/.BrowserActivity -d file://mnt/sdcard/download/m.twitter.com/twitter.com/toptweets/startup11.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network onload js:

   am start -a android.intent.action.VIEW  -n com.android.browser/.BrowserActivity -d http://192.168.77.59/~vlad.ghetiu/m.twitter.com/twitter.com/toptweets/startup11.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network twitter + onload js:

   am start -a android.intent.action.VIEW  -n com.android.browser/.BrowserActivity -d http://192.168.77.59/~vlad.ghetiu/m.twitter.com/twitter.com/toptweets/favorites3.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

11:02, 18 April 2012 (PDT)11:02, 18 April 2012 (PDT)11:02, 18 April 2012 (PDT) Chrome :

   local file twitter:
   am start -a android.intent.action.VIEW  -n com.android.chrome/.Main -d file://mnt/sdcard/download/startup5.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"
   local file twitter + onload js:
   am start -a android.intent.action.VIEW  -n com.android.chrome/.Main -d file://mnt/sdcard/download/favorites2.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"
   local network onload js
   am start -a android.intent.action.VIEW  -n com.android.chrome/.Main -d http://192.168.1.109/~nhirata/startup5.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"
   local network twitter + onload js:
   am start -a android.intent.action.VIEW  -n com.android.chrome/.Main -d http://192.168.1.109/~nhirata/favorites2.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"