Mobile/Performance/S1S2-Tests

From MozillaWiki
Jump to: navigation, search

Video Results: https://docs.google.com/spreadsheet/ccc?key=0Arku3jleCA0UdFVQS211Z29sV202MFdMdE5ldHA1NkE&hl=en_US#gid=0 Manual Testing: Droid Pro Results: https://docs.google.com/spreadsheet/ccc?key=0Arku3jleCA0UdDdOWWxBdU5hSDNQMkRzbGs5TVA2Q0E&hl=en_US#gid=10 Nexus S Results: https://docs.google.com/spreadsheet/ccc?key=0Arku3jleCA0UdFNQdkpuWVZIbjBPQ1gxa3RldzF2b1E&hl=en_US#gid=0 Galaxy S II Results: https://docs.google.com/spreadsheet/ccc?key=0Arku3jleCA0UdFEyN0F2SFpJMWltUUJJYmNPMkNtWlE&hl=en_US#gid=6 11:02, 18 April 2012 (PDT)11:02, 18 April 2012 (PDT)11:02, 18 April 2012 (PDT)~ Device Setup: Checklist : 1. get build from http://ftp.mozilla.org/pub/mozilla.org/mobile/nightly/latest-mozilla-central-android/ 2. uninstall fennec 3. install new fennec 4. verify on the android settings:

Wireless&network: 

   turn wireless off (turn on airplane mode) [for local file testing]

   turn bluetooth off

   set Network Mode to CDMA

Call settings: - (if settings is there): 

   turn off proximity sensor

   turn off own video in received calls

   turn off use call fail options

Battery & data manager: 

   Data Delivery

   uncheck Background data

   uncheck data enabled

   Social applications

   set Sync over Wi-Fi Only

   sync every 60 minutes

Sound: 

   turn on silent mode

   turn off haptic feedback

Display: 

   turn off automatic brightness

   turn off auto-rotate screen

   turn off animation

   turn off timeout (never time out)

   set wallpaper to static wallpaper

   turn off roaming banner

   turn off in-pocket detection

Accounts and sync 

   turn off Background data

   turn off auto-sync

Motion 

   turn off motion activation

Privacy 

   turn off backup my data

Location & security: 

   turn off Google location services

   turn off Standalone GPS services

   turn off VZW location services

   turn off bluetooth bypass

Accounts: 

   go into account : 

   uncheck all sync checkboxes

Accessibility : 

   turn off accessibility

Date & time 

   turn off automatic

Application settings: 

   Running Services :

   turn off all but settings, keyboard

5. Remove all Android widgets from the home page 6. Turn off Send performance data in fennec ; make sure to launch fennec manually and turn off the notification for sending anonymous usage information. Note: *** kill all running services except settings and vkb settings -> application -> running services Certain services still come back : Google Services, Media remove google search from the front page *** also to note : - wait about 15 seconds to relaunch. average of 8 seconds for garbage collection. - throw out any garbage collection that happen during the run. - for services that reappear do not worry about killing those services. Directions: 0) be sure to setup the device accordingly to the device setup check list above. 1) Download  : http://dump.lassey.us/time onto the desktop machine 2) using adb : adb push time /data/local 3) change the permission of the file so you can execute: ie adb shell chmod 777 /data/local/time 4) download http://people.mozilla.com/~nhirata/Perf/startup5.html and http://people.mozilla.com/~nhirata/Perf/favorites2.html onto the desktop machine push the html files to the android device using: adb push <local file> /sdcard/download/ 5) To setup the local file on the network: if you are on a mac, place the html files in the ~/Sites/ folder then in the System Preferences, turn on the Sharing -> Web Sharing the ip address of the website should be listed. 6) reboot the android device 7) adb shell 8) for each of the following commands, run them and record the data at the spreadsheet based on the device, close the window and then force quit the application (note: do not go to the home screen after force quitting the application): Wait 15 seconds before running the command again Note: be sure to throw out the first value of each set of run as it may be skewed due to loading of the cache. Droid Pro: https://docs.google.com/spreadsheet/ccc?key=0Arku3jleCA0UdDdOWWxBdU5hSDNQMkRzbGs5TVA2Q0E&hl=en_US#gid=4 Nexus S : https://docs.google.com/spreadsheet/ccc?key=0Arku3jleCA0UdFNQdkpuWVZIbjBPQ1gxa3RldzF2b1E&hl=en_US#gid=0 Galaxy S II: https://docs.google.com/spreadsheet/ccc?key=0Arku3jleCA0UdFEyN0F2SFpJMWltUUJJYmNPMkNtWlE&hl=en_US#gid=0 Note: Original file for twitter page can be found at : http://people.mozilla.com/~nhirata/Perf/m.twitter.com/twitter.com/toptweets/ Original file for the ts page can be found at : http://people.mozilla.com/~nhirata/Perf/startup.html TS test based on http://blog.vlad1.com/2009/07/28/measuring-startup/ 11:02, 18 April 2012 (PDT)11:02, 18 April 2012 (PDT)11:02, 18 April 2012 (PDT) Nightly + Native UI Nightly can be downloaded : http://ftp.mozilla.org/pub/mozilla.org/mobile/nightly/latest-mozilla-central-android-r7/ NativeUI can be downloaded: http://ftp.mozilla.org/pub/mozilla.org/mobile/nightly/latest-birch-android/ local file onload js 

   am start -a android.intent.action.VIEW -n org.mozilla.fennec/.App -d file://mnt/sdcard/download/startup5.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local file twitter + onload js 

   am start -a android.intent.action.VIEW -n org.mozilla.fennec/.App -d file://mnt/sdcard/download/favorites2.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network onload js 

   am start -a android.intent.action.VIEW -n org.mozilla.fennec/.App -d http://192.168.1.109/~nhirata/startup5.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network twitter+onload js 

   am start -a android.intent.action.VIEW -n org.mozilla.fennec/.App -d http://192.168.1.109/~nhirata/favorites2.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

SoftVision network: local file onload js 

   am start -a android.intent.action.VIEW -n org.mozilla.fennec/.App -d  file://mnt/sdcard/download/m.twitter.com/twitter.com/toptweets/startup11.html#"`millistring=\`/data/local/time\`;  echo \`date \"+%s\"\`${millistring##*.}`"

local network onload js 

   am start -a android.intent.action.VIEW -n org.mozilla.fennec/.App -d http://192.168.77.59/~vlad.ghetiu/m.twitter.com/twitter.com/toptweets/startup11.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network twitter+onload js 

   am start -a android.intent.action.VIEW -n org.mozilla.fennec/.App -d http://192.168.77.59/~vlad.ghetiu/m.twitter.com/twitter.com/toptweets/favorites3.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

11:02, 18 April 2012 (PDT)11:02, 18 April 2012 (PDT)Nhirata Dolphin: local file twitter 

   am start -a android.intent.action.VIEW  -n mobi.mgeek.TunnyBrowser/.BrowserActivity -d file://mnt/sdcard/download/startup5.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local file twitter + onload js: 

   am start -a android.intent.action.VIEW  -n mobi.mgeek.TunnyBrowser/.BrowserActivity -d file://mnt/sdcard/download/favorites2.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network onload js 

   am start -a android.intent.action.VIEW  -n mobi.mgeek.TunnyBrowser/.BrowserActivity -d http://192.168.1.109/~nhirata/m.twitter.com/twitter.com/toptweets/startup11.html#`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network twitter + onload js: 

   am start -a android.intent.action.VIEW  -n mobi.mgeek.TunnyBrowser/.BrowserActivity -d http://192.168.1.109/~nhirata/m.twitter.com/twitter.com/toptweets/favorites3.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

SoftVision network: local file onload js 

   am start -a android.intent.action.VIEW  -n mobi.mgeek.TunnyBrowser/.BrowserActivity -d file://mnt/sdcard/download/m.twitter.com/twitter.com/toptweets/startup11.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network onload js 

   am start -a android.intent.action.VIEW  -n mobi.mgeek.TunnyBrowser/.BrowserActivity -d http://192.168.77.59/~vlad.ghetiu/m.twitter.com/twitter.com/toptweets/startup11.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network twitter + onload js: 

   am start -a android.intent.action.VIEW  -n mobi.mgeek.TunnyBrowser/.BrowserActivity -d http://192.168.77.59/~vlad.ghetiu/m.twitter.com/twitter.com/toptweets/favorites3.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

11:02, 18 April 2012 (PDT)11:02, 18 April 2012 (PDT)~~ Opera: local file onload js 

   am start  -a android.intent.action.VIEW -n com.opera.browser/com.opera.Opera -d file://mnt/sdcard/download/startup5.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local file twitter + onload js: 

   am start  -a android.intent.action.VIEW -n com.opera.browser/com.opera.Opera -d file://mnt/sdcard/download/favorites2.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network onload js 

   am start  -a android.intent.action.VIEW -n com.opera.browser/com.opera.Opera -d http://192.168.1.109/~nhirata/startup5.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network twitter + onload js: 

   am start  -a android.intent.action.VIEW -n com.opera.browser/com.opera.Opera -d http://10.250.3.181/~nhirata/favorites2.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

SoftVision network: local file onload js 

   am start  -a android.intent.action.VIEW -n com.opera.browser/com.opera.Opera -d file://mnt/sdcard/download/m.twitter.com/twitter.com/toptweets/startup11.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network onload js 

   am start  -a android.intent.action.VIEW -n com.opera.browser/com.opera.Opera -d http://192.168.77.59/~vlad.ghetiu/m.twitter.com/twitter.com/toptweets/startup11.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network twitter + onload js: 

   am start  -a android.intent.action.VIEW -n com.opera.browser/com.opera.Opera -d http://192.168.77.59/~vlad.ghetiu/m.twitter.com/twitter.com/toptweets/favorites3.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

11:02, 18 April 2012 (PDT)11:02, 18 April 2012 (PDT)Nhirata 11:02, 18 April 2012 (PDT) Default Browser: local file twitter: 

   am start -a android.intent.action.VIEW  -n com.android.browser/.BrowserActivity -d file://mnt/sdcard/download/startup5.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local file twitter + onload js: 

   am start -a android.intent.action.VIEW  -n com.android.browser/.BrowserActivity -d file://mnt/sdcard/download/favorites2.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network onload js 

   am start -a android.intent.action.VIEW  -n com.android.browser/.BrowserActivity -d http://192.168.1.109/~nhirata/startup5.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network twitter + onload js: 

   am start -a android.intent.action.VIEW  -n com.android.browser/.BrowserActivity -d http://192.168.1.109/~nhirata/favorites2.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

SoftVision network: local file twitter: 

   am start -a android.intent.action.VIEW  -n com.android.browser/.BrowserActivity -d file://mnt/sdcard/download/m.twitter.com/twitter.com/toptweets/startup11.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network onload js: 

   am start -a android.intent.action.VIEW  -n com.android.browser/.BrowserActivity -d http://192.168.77.59/~vlad.ghetiu/m.twitter.com/twitter.com/toptweets/startup11.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

local network twitter + onload js: 

   am start -a android.intent.action.VIEW  -n com.android.browser/.BrowserActivity -d http://192.168.77.59/~vlad.ghetiu/m.twitter.com/twitter.com/toptweets/favorites3.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

11:02, 18 April 2012 (PDT)11:02, 18 April 2012 (PDT)11:02, 18 April 2012 (PDT) Chrome : 

   local file twitter:

   am start -a android.intent.action.VIEW  -n com.android.chrome/.Main -d file://mnt/sdcard/download/startup5.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

   local file twitter + onload js:

   am start -a android.intent.action.VIEW  -n com.android.chrome/.Main -d file://mnt/sdcard/download/favorites2.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

   local network onload js

   am start -a android.intent.action.VIEW  -n com.android.chrome/.Main -d http://192.168.1.109/~nhirata/startup5.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"

   local network twitter + onload js:

   am start -a android.intent.action.VIEW  -n com.android.chrome/.Main -d http://192.168.1.109/~nhirata/favorites2.html#"`millistring=\`/data/local/time\`; echo \`date \"+%s\"\`${millistring##*.}`"
Retrieved from "https://wiki.mozilla.org/index.php?title=Mobile/Performance/S1S2-Tests&oldid=421540"