Mobile/Testing/02 12 14: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(15 intermediate revisions by 6 users not shown)
Line 7: Line 7:
= Status reports =
= Status reports =
== Dev team ==
== Dev team ==
* {{bug|971810}}, {{bug|971809}}, {{bug|971807}} get eideticker, autophone and areweslimyet to send automated emails about regressions
* can we send email about gradual regressions?
* GeckoViewExample test?
** filed {{bug|971101}} to build and publish it. It fails because we need ant on the builders.
** filed {{bug|971841}} to install ant
== Rel Eng ==
== Rel Eng ==
Thanks to gbrown:
* deployed {{Bug|962743}} - Report complete logcats for Android 4.0 panda jobs
** Android panda jobs will report full logcat to blobber at end of test run!
*** example for an [https://tbpl.mozilla.org/?tree=Mozilla-Inbound&rev=6cd04a76fa13&jobname=panda.*reftest.*6 inbound reftest-6 green job], [http://mozilla-releng-blobs.s3.amazonaws.com/blobs/mozilla-inbound/sha512/63242b16694aa73f8a93037e92474c329400c799cf77f6df6af45d77cbf217debd401e67011b5bbe1ecacf915b3e64c7145d42acb89733581a580f2ce9d1254e logcat] and [https://tbpl.mozilla.org/php/getParsedLog.php?id=34566015&tree=Mozilla-Inbound&full=1 full log]
*** announced at http://gbrownmozilla.wordpress.com/2014/02/12/complete-logcats-for-android-tests/


== IT ==
== IT ==
== A Team ==
== A Team ==
* tegra failure rate: [[http://54.215.155.53/android_failures.html?platform=android2.2 1.5%]]
** last week 6.46
* panda failure rate: [[http://54.215.155.53/android_failures.html?platform=android4.0 14.19%]]
** last week 16.42
** excluding retries 0.75%
== Android 2.3 emulator ==
== Android 2.3 emulator ==
* See "Other Opt" at https://tbpl.mozilla.org/?tree=Ash&jobname=Android.*&rev=7da8241436d0
* [dminor] looking at slow reftests
** plan to profile emulator to see where the time is going - likely software renderer is slow, but maybe something else will show up
** will also look at reftest harness itself to see if anything can be tweaked there
** open to suggestions
== Android x86 emulator ==
== Android x86 emulator ==


== Autophone ==
== Autophone ==
* Turned off ipfw on 2014-02-08. It appears that I had previously configured ipfw incorrectly on 2014-02-05 which had already disabled traffic shaping.
* {{bug|968905}} in review. Will allow partitioning devices across repositories and should help with keeping up with the daily builds.
* Production Autophone down due to an OSX only regression from {{bug|965557}}. Investigating and hope to have back up today.
* Rooted Nexus 5s and installed SUTAgent. Having issues with SUTAgent and Android 4.4.


== Eideticker ==
== Eideticker ==
* Lots of use of the eideticker machines by the Android team to track startup perf regressions
* Various bugs fixed (or about to be fixed) in automation that were causing unreliable results: {{bug|970151}}, {{bug|970110}}
= Round Table =
= Round Table =




= Action Items =
= Action Items =
* Callek to followup on ant install - {{bug|971841}}
* snorp will talk to jmaher about talos improvements to find gradual, long-term regressions
* gbrown will follow-up on startup crashes with :glandium
* gbrown will invite jmaher for next week
* gbrown will find out about GeckoView on Talos

Latest revision as of 19:26, 12 February 2014

Previous Action Items

  • snorp will talk to jmaher about talos improvements to find gradual, long-term regressions
  • gbrown will investigate slow Android 2.3 reftests
  • gbrown will follow-up on startup crashes with :glandium
  • jake will ask around about bug 967452

Status reports

Dev team

  • bug 971810, bug 971809, bug 971807 get eideticker, autophone and areweslimyet to send automated emails about regressions
  • can we send email about gradual regressions?
  • GeckoViewExample test?
    • filed bug 971101 to build and publish it. It fails because we need ant on the builders.
    • filed bug 971841 to install ant

Rel Eng

Thanks to gbrown:

IT

A Team

  • tegra failure rate: [1.5%]
    • last week 6.46
  • panda failure rate: [14.19%]
    • last week 16.42
    • excluding retries 0.75%

Android 2.3 emulator

  • [dminor] looking at slow reftests
    • plan to profile emulator to see where the time is going - likely software renderer is slow, but maybe something else will show up
    • will also look at reftest harness itself to see if anything can be tweaked there
    • open to suggestions

Android x86 emulator

Autophone

  • Turned off ipfw on 2014-02-08. It appears that I had previously configured ipfw incorrectly on 2014-02-05 which had already disabled traffic shaping.
  • bug 968905 in review. Will allow partitioning devices across repositories and should help with keeping up with the daily builds.
  • Production Autophone down due to an OSX only regression from bug 965557. Investigating and hope to have back up today.
  • Rooted Nexus 5s and installed SUTAgent. Having issues with SUTAgent and Android 4.4.

Eideticker

  • Lots of use of the eideticker machines by the Android team to track startup perf regressions
  • Various bugs fixed (or about to be fixed) in automation that were causing unreliable results: bug 970151, bug 970110

Round Table

Action Items

  • Callek to followup on ant install - bug 971841
  • snorp will talk to jmaher about talos improvements to find gradual, long-term regressions
  • gbrown will follow-up on startup crashes with :glandium
  • gbrown will invite jmaher for next week
  • gbrown will find out about GeckoView on Talos
Retrieved from "https://wiki.mozilla.org/index.php?title=Mobile/Testing/02_12_14&oldid=924964"