Mobile/Testing/12 19 12: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(Created page with "= Previous Action Items = = Status reports = == Dev team == == Rel Eng == === Tegra === === Panda === == IT == == A Team == == Autophone == == Eideticker == = Round Table = ...")
 
 
(13 intermediate revisions by 8 users not shown)
Line 3: Line 3:
= Status reports =
= Status reports =
== Dev team ==
== Dev team ==
** C++ unit test support: {{bug|811411}} and related - waiting for reviews
** wiki entry for unit tests: https://wiki.mozilla.org/Mobile/Fennec/Android#cppunittests
** {{bug|810347}} More flexible test root support in sutAgent
** {{bug|817235}} Allow remote xpcshell tests to use /mnt/sdcard/tests as test root
** {{bug|814805}} Android xpcshell tests: chmod permission problems on rooted device
== Rel Eng ==
== Rel Eng ==
* {{bug|820592}} Android x86 builds in production, writing patches and testing for them to run in beta and release
=== Tegra ===
=== Tegra ===
=== Panda ===
=== Panda ===
* {{bug|820824}} 66 new pandas in production running mochitests 4-8 on m-c


== IT ==
== IT ==
* Tracker bug - 800 production ready panda boards {{bug|799922}}
** All chassis are racked, having issues with stability of the Android image when remotely flashed. {{bug|819545}}
** Work around would be to manually image all SD cards, if we cannot resolve the stability issues.
* Working on a higher density chassis {{bug|777393}} - This work has restarted.
== A Team ==
== A Team ==
* [[https://docs.google.com/spreadsheet/ccc?key=0ArS97F99-BEZdE5uWW5ZZjc0aHNyb3A4NDI0NVZVNWc 8.12%]] total failure rate, robocop is the biggest offender, a lot of changes happening here
* [[https://docs.google.com/spreadsheet/ccc?key=0ArS97F99-BEZdFczNWpfY1h1TU9lR1N3VHpkTUc5OWc 41.20%]] total failure rate for panda boards
** this is misleading as there are only 6 data points and many of them are including unhidden test suites now which failed when we turned them on.
* robocop tests:
** panda board fixes
** fixed testBookmarksTab
** reviewing a lot of tests, planning on fixing a few more
** patch to speed up robocop tests by 10 minutes per run on average by not copying a full profile
*** will churn on patch, should be able to shave 15 minutes/run
* panda boards:
** turned on, working towards fixing bugs/tests to get more tests unhidden
** will be working with dividehex to troubleshoot the difference between lifeguard imaging and raw imaging
== Autophone ==
== Autophone ==
* bc is landing his big unit-tests patch. It will require one small autolog change, which should be landing around the same time, and then we'll deploy.
** Start with 2 phones and see what happens. Will be setting it up on home staging server as well.
** Results will be up on the [http://brasstacks.mozilla.com/autolog/?tree=mozilla-central&source=autolog autolog] dashboard.
** Also this will test out a new log parser that bc is working on that should be more reliable. Eventually this will be folded into the main logparser module.


== Eideticker ==
== Eideticker ==
* Dashboard updating was down for a few days for the first time in a while. Unfortunately didn't notice for a bit
** Filed {{bug|823112}} to make sure this doesn't happen in the future
= Round Table =
= Round Table =
 
* debug tests?


= Action Items =
= Action Items =
* gbrown to file bugs to get xpcshell tests running in CI
** will use existing bug 811793 as a meta bug

Latest revision as of 04:14, 20 December 2012

Previous Action Items

Status reports

Dev team

Rel Eng

  • bug 820592 Android x86 builds in production, writing patches and testing for them to run in beta and release

Tegra

Panda

  • bug 820824 66 new pandas in production running mochitests 4-8 on m-c

IT

  • Tracker bug - 800 production ready panda boards bug 799922
    • All chassis are racked, having issues with stability of the Android image when remotely flashed. bug 819545
    • Work around would be to manually image all SD cards, if we cannot resolve the stability issues.
  • Working on a higher density chassis bug 777393 - This work has restarted.

A Team

  • [8.12%] total failure rate, robocop is the biggest offender, a lot of changes happening here
  • [41.20%] total failure rate for panda boards
    • this is misleading as there are only 6 data points and many of them are including unhidden test suites now which failed when we turned them on.
  • robocop tests:
    • panda board fixes
    • fixed testBookmarksTab
    • reviewing a lot of tests, planning on fixing a few more
    • patch to speed up robocop tests by 10 minutes per run on average by not copying a full profile
      • will churn on patch, should be able to shave 15 minutes/run
  • panda boards:
    • turned on, working towards fixing bugs/tests to get more tests unhidden
    • will be working with dividehex to troubleshoot the difference between lifeguard imaging and raw imaging

Autophone

  • bc is landing his big unit-tests patch. It will require one small autolog change, which should be landing around the same time, and then we'll deploy.
    • Start with 2 phones and see what happens. Will be setting it up on home staging server as well.
    • Results will be up on the autolog dashboard.
    • Also this will test out a new log parser that bc is working on that should be more reliable. Eventually this will be folded into the main logparser module.

Eideticker

  • Dashboard updating was down for a few days for the first time in a while. Unfortunately didn't notice for a bit
    • Filed bug 823112 to make sure this doesn't happen in the future

Round Table

  • debug tests?

Action Items

  • gbrown to file bugs to get xpcshell tests running in CI
    • will use existing bug 811793 as a meta bug
Retrieved from "https://wiki.mozilla.org/index.php?title=Mobile/Testing/12_19_12&oldid=495085"