QA/Fennec/37/Beta/8/AppThwack Results: Difference between revisions

From MozillaWiki
< QA‎ | Fennec‎ | 37‎ | Beta/8
Jump to navigation Jump to search
(adding testplan)
 
(adding testplan)
 
Line 8: Line 8:
  ! Results
  ! Results
  |-
  |-
  |  
  | Ioana Chiorean
  |
  | API 11
  |  
  | March 25th, 2015
  |  
  | '''Done'''
  |}
  |}
</onlyinclude>
</onlyinclude>
Line 17: Line 17:
== Results ==
== Results ==
* ARMv6 / '''ARMv7'''
* ARMv6 / '''ARMv7'''
** public results:  
** public results: https://appthwack.com/public/61a0bad2cc9aa49c7e34435cb
=== Issues ===
=== Issues ===
* java.lang.ClassNotFoundException: org.mozilla.firefox_beta.App - 10 occurrences
** Kyocera Hydro (4.0.4): Exerciser Monkey
** Kyocera Rise (4.0.4): Exerciser Monkey
** Samsung Nexus S 4G (4.1.2): Exerciser Monkey
** HTC Amaze 4G (4.0.3): Exerciser Monkey
** HTC Desire S (4.0.4): Exerciser Monkey
** HTC One (4.1.2): Exerciser Monkey
** HTC One VX (4.0.4): Exerciser Monkey
** Sony Xperia S (4.1.2): Exerciser Monkey
** Sony Xperia Arc (4.0.4): Exerciser Monkey
** Sony Xperia Active (4.0.4): Exerciser Monkey
* java.lang.ClassNotFoundException: Didn't find class 'org.mozilla.firefox_beta.App' on path: /system/framework/android.test.runner.jar:/data/app/com.appthwack.gltest-1.apk:/data/app/org.mozilla.firefox_beta-1.apk - 2 occurrences
** Asus EeePad TF300T (4.2.1): Exerciser Monkey
** Samsung Galaxy S4 Mini (4.2.2): Exerciser Monkey
* java.lang.SecurityException: attempting to read gservices without permission: Neither user 10001 nor current process has com.google.android.providers.gsf.permission.READ_GSERVICES. - 1 occurrence
** Amazon Kindle Fire HDX 8.9" (4.2.2): Exerciser Monkey
* java.lang.ClassNotFoundException: org.mozilla.firefox_beta.App in loader dalvik.system.PathClassLoader[/system/framework/android.test.runner.jar:/data/app/com.appthwack.gltest-1.apk:/data/app/org.mozilla.firefox_beta-1.apk] - 1 occurrence
** Dell Streak 7 (3.2): Exerciser Monkey
* java.lang.ClassNotFoundException: Didn't find class 'org.mozilla.firefox_beta.App' on path: DexPathList[[zip file '/system/framework/android.test.runner.jar', zip file '/data/app/com.appthwack.gltest-1/base.apk', zip file '/data/app/org.mozilla.firefox_beta-1/base.apk'],nativeLibraryDirectories=[/data/app/org.mozilla.firefox_beta-1/lib/arm, /vendor/lib, /system/lib]] - 2 occurrences
** Asus Nexus 7 2 (4.4.2): Exerciser Monkey
** LG Nexus 5 (4.4.4): Exerciser Monkey
* java.lang.ClassNotFoundException: Didn't find class 'org.mozilla.firefox_beta.App' on path: DexPathList[[zip file '/system/framework/android.test.runner.jar', zip file '/data/app/com.appthwack.gltest-1.apk', zip file '/data/app/org.mozilla.firefox_beta-1.apk'],nativeLibraryDirectories=[/data/app-lib/com.appthwack.gltest-1, /data/app-lib/org.mozilla.firefox_beta-1, /vendor/lib, /system/lib]] - 1 occurrence
** LG Nexus 4 (5.0.1): Exerciser Monkey
===PERFORMANCE===
===PERFORMANCE===
* CPU Avg 17.01%
** Min 3.13% HTC One S (4.0.4)
** Max 37.44% HTC One S (4.0.4)
* Memory Avg 90.33MB
** Min 13.46MB HTC One S (4.0.4)
** Max 174.07MB HTC One S (4.0.4)
* Threads Avg 58.15
** Min 11.94 HTC One S (4.0.4)
** Max 69.0 HTC One S (4.0.4)
* Frame Draw Time Avg 3.95ms
** Min 0.0ms HTC One S (4.0.4)
** Max 88.36ms HTC One S (4.0.4)

Latest revision as of 16:13, 25 March 2015

QA Assignment

Assigned Build Completed Results
Ioana Chiorean API 11 March 25th, 2015 Done


Results

Issues

  • java.lang.ClassNotFoundException: org.mozilla.firefox_beta.App - 10 occurrences
    • Kyocera Hydro (4.0.4): Exerciser Monkey
    • Kyocera Rise (4.0.4): Exerciser Monkey
    • Samsung Nexus S 4G (4.1.2): Exerciser Monkey
    • HTC Amaze 4G (4.0.3): Exerciser Monkey
    • HTC Desire S (4.0.4): Exerciser Monkey
    • HTC One (4.1.2): Exerciser Monkey
    • HTC One VX (4.0.4): Exerciser Monkey
    • Sony Xperia S (4.1.2): Exerciser Monkey
    • Sony Xperia Arc (4.0.4): Exerciser Monkey
    • Sony Xperia Active (4.0.4): Exerciser Monkey
  • java.lang.ClassNotFoundException: Didn't find class 'org.mozilla.firefox_beta.App' on path: /system/framework/android.test.runner.jar:/data/app/com.appthwack.gltest-1.apk:/data/app/org.mozilla.firefox_beta-1.apk - 2 occurrences
    • Asus EeePad TF300T (4.2.1): Exerciser Monkey
    • Samsung Galaxy S4 Mini (4.2.2): Exerciser Monkey
  • java.lang.SecurityException: attempting to read gservices without permission: Neither user 10001 nor current process has com.google.android.providers.gsf.permission.READ_GSERVICES. - 1 occurrence
    • Amazon Kindle Fire HDX 8.9" (4.2.2): Exerciser Monkey
  • java.lang.ClassNotFoundException: org.mozilla.firefox_beta.App in loader dalvik.system.PathClassLoader[/system/framework/android.test.runner.jar:/data/app/com.appthwack.gltest-1.apk:/data/app/org.mozilla.firefox_beta-1.apk] - 1 occurrence
    • Dell Streak 7 (3.2): Exerciser Monkey
  • java.lang.ClassNotFoundException: Didn't find class 'org.mozilla.firefox_beta.App' on path: DexPathList[[zip file '/system/framework/android.test.runner.jar', zip file '/data/app/com.appthwack.gltest-1/base.apk', zip file '/data/app/org.mozilla.firefox_beta-1/base.apk'],nativeLibraryDirectories=[/data/app/org.mozilla.firefox_beta-1/lib/arm, /vendor/lib, /system/lib]] - 2 occurrences
    • Asus Nexus 7 2 (4.4.2): Exerciser Monkey
    • LG Nexus 5 (4.4.4): Exerciser Monkey
  • java.lang.ClassNotFoundException: Didn't find class 'org.mozilla.firefox_beta.App' on path: DexPathList[[zip file '/system/framework/android.test.runner.jar', zip file '/data/app/com.appthwack.gltest-1.apk', zip file '/data/app/org.mozilla.firefox_beta-1.apk'],nativeLibraryDirectories=[/data/app-lib/com.appthwack.gltest-1, /data/app-lib/org.mozilla.firefox_beta-1, /vendor/lib, /system/lib]] - 1 occurrence
    • LG Nexus 4 (5.0.1): Exerciser Monkey

PERFORMANCE

  • CPU Avg 17.01%
    • Min 3.13% HTC One S (4.0.4)
    • Max 37.44% HTC One S (4.0.4)
  • Memory Avg 90.33MB
    • Min 13.46MB HTC One S (4.0.4)
    • Max 174.07MB HTC One S (4.0.4)
  • Threads Avg 58.15
    • Min 11.94 HTC One S (4.0.4)
    • Max 69.0 HTC One S (4.0.4)
  • Frame Draw Time Avg 3.95ms
    • Min 0.0ms HTC One S (4.0.4)
    • Max 88.36ms HTC One S (4.0.4)