Mobile/Testing/10 05 11: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(Created page with "= Previous Action Items = * Bear to create bugs for error codes from SUT agent * Joel will take a look at the bugs that bear files = Status reports = == Dev team == == Rel Eng ...")
 
 
(14 intermediate revisions by 3 users not shown)
Line 1: Line 1:
= Previous Action Items =
= Previous Action Items =
* Bear to create bugs for error codes from SUT agent
* bear will follow up with Armen to figure out his objection to a an email notification about no talos results {{bug|689625}}
* Joel will take a look at the bugs that bear files
* joduinn to start a discussion of process in {{bug|689625}}
* jmaher, gbrown & blassey to generate a set of minimum requirements for running tests on android


= Status reports =
= Status reports =
Line 9: Line 10:
[http://is.gd/ZEOCi7 android_tier_1]
[http://is.gd/ZEOCi7 android_tier_1]


* (fixed) {{bug|684253}} - 6 new foopies
* {{bug|690311}} - verify connection before launching job
* {{bug|665891}} - add 200 new tegras to pool. On their way; we've already bumped our tegra count to ~120.
* https://wiki.mozilla.org/Mobile/Notes/05-Oct-2011#Release_Engineering
** (fixed) {{bug|689209}} - Frequent Android "Graph server unreachable" with "No machine_name called 'tegra-X' can be found"
* (fixed) {{bug|689350}} - No Android/Tegra Tp4m data since Monday 2011-09-19
 
Mountain View power/network outages this week affected tegra/n900 stability; currently fixed.
 
* (open) {{bug|689728}} - make bm-remote-talos-webhost-* more robust


== A Team ==
== A Team ==
=== production unittests ===
=== production unittests ===
* {{bug|688762}}, {{bug|689519}} - cleaned up return codes
* {{bug|689518}} - fixed pageloader
  * {{bug|686143}} - need to figure out the jsreftests which timeout frequently
  * {{bug|686143}} - need to figure out the jsreftests which timeout frequently
  * would really like releng to pull cleanup and device sanity check out of the official job (less purple/red)
  ** {{bug|691073}} - crash while running jsreftests on my tegra - will work with JS team on this
  * new tests and changes should be on hold until we have <5% failure rate on average
  * new tests and changes should be on hold until we have <5% failure rate on average
  * {{bug|689596}} - fixing missing network proxy in android talos config, should be landing later this week
  * {{bug|689596}} - fixing missing network proxy in android talos config, landing by tomorrow
* {{bug|691425}} - minidump collection and processing in automation to be landed shortly
* should be landing specialpowers patches to unblock a lot of patches and tests this week!
* verify dhcp on releng network?


=== easier for developers to work with tools ===
=== easier for developers to work with tools ===
Line 42: Line 38:
  * add more mochitests
  * add more mochitests
  * figure out more details why we are skipping so many reftests
  * figure out more details why we are skipping so many reftests
* {{bug|691349}} - Reftest OpenGL tests for Android coming online in the near future!


= Round Table =
= Round Table =
* Can more random oranges be made purple?
* Have Linaro build running on pandaboards
** Need to get power supply and serial to USB cords today, ensure we can get preliminary tests running


= Action Items =
= Action Items =
* bear will follow up with Armen to figure out his objection to a an email notification about no talos results {{bug|689625}}
* [carried] bear will follow up with Armen to figure out his objection to a an email notification about no talos results {{bug|689625}}
* joduinn to start a discussion of process in {{bug|689625}}
* [carried] joduinn to start a discussion of process in {{bug|689625}}
* jmaher, gbrown & blassey to generate a set of minimum requirements for running tests on android
* [carried] jmaher, gbrown & blassey to generate a set of minimum requirements for running tests on android

Latest revision as of 18:00, 5 October 2011

Previous Action Items

  • bear will follow up with Armen to figure out his objection to a an email notification about no talos results bug 689625
  • joduinn to start a discussion of process in bug 689625
  • jmaher, gbrown & blassey to generate a set of minimum requirements for running tests on android

Status reports

Dev team

Rel Eng

android_tier_1

A Team

production unittests

* bug 686143 - need to figure out the jsreftests which timeout frequently
** bug 691073 - crash while running jsreftests on my tegra - will work with JS team on this
* new tests and changes should be on hold until we have <5% failure rate on average
* bug 689596 - fixing missing network proxy in android talos config, landing by tomorrow
* bug 691425 - minidump collection and processing in automation to be landed shortly
* should be landing specialpowers patches to unblock a lot of patches and tests this week!
* verify dhcp on releng network?

easier for developers to work with tools

* bug 688604 - make talos-remote - coming soon
* bug 687974 - adb for talos
* bug 688749 - fixed issue with reftest where --ignore-window-size would fail 
* need to consider >1 adb device attached at once.
* need to figure out what we support for devices; rooted? cp? run-as? os? tablets?

future

* bug 686807 - pull minidumps from tegras 
* bug 685632 - tp4m rss collection
* xpcshell for tegra
* webserver for mochitest/reftest so we don't need host utils
* pandaboard work
* add more mochitests
* figure out more details why we are skipping so many reftests
* bug 691349 - Reftest OpenGL tests for Android coming online in the near future!

Round Table

  • Have Linaro build running on pandaboards
    • Need to get power supply and serial to USB cords today, ensure we can get preliminary tests running

Action Items

  • [carried] bear will follow up with Armen to figure out his objection to a an email notification about no talos results bug 689625
  • [carried] joduinn to start a discussion of process in bug 689625
  • [carried] jmaher, gbrown & blassey to generate a set of minimum requirements for running tests on android