B2G/QA/Meetings/Automation/2015-01-22

Overview

This is a weekly meetup to discuss all things regarding B2G automation and Quality. Please use wiki style.

• Meeting Name: QA Automation Roundtable
• Meeting Time: Thursday @ 9:30am - 10am PST
• Vidyo Room: QA Vidyo Room
• Video Link: https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
• Old link is gone, should we use this one?
  • https://v.mozilla.com/flex.html?roomdirect.html&key=0HHQN7SSNIkAxuJq04fq7uZk6J8
• Dial in: 1-800-707-25331
• Meeting Notes: https://wiki.mozilla.org/B2G/QA/Meetings
• Previous Meeting:https://wiki.mozilla.org/B2G/QA/Meetings/Automation/2015-01-08

Q1 2015 Goals

2.2 - (OS QA (in Taiwan)

• • Support the stability of 2.2 branch with focused test runs, qawanted, bug triage, and daily smoke tests (manual and automation)
  • Support new feature testing
  • Manage the release out the door until CC date, and hand off to Devices QA team into Q2.

3.0 - (OS QA (in US/EU)

• • Automation goals:
    • Re-evaluate the smoke tests on v3 that will be needed for automation in javascript
    • Focus on getting existing Gij tests running against the lab of devices
    • Creating a set of best practices on creating JS gaia-UI automation tests
    • Focus on getting smoke tests running against the lab of devices (could be a combination of Gij, python, or JS tests).
  • Support the stability of master with focused test runs, qawanted, bug triage, and daily smoke tests (manual and automation)
  • Support lightweight dogfooding program off of nightly
  • Develop feature testplans when features are concrete

Attendees

Previous Action Items

[Tony] request v18D-1 with adb enabled access from T2M

• • Bebe has tested at desk, looks good, but https://bugzilla.mozilla.org/show_bug.cgi?id=1122119 might be relevant

[Tony] MarionetteJS bugs from James

• • Geo to follow up.

Status Highlights

• [Bebe] Bug 1121374 - Devices crash during test runs and can no longer be found via ADB
  • We are investigating the issue but can't reproduce the bug locally
  • Bug 1122119 - [System] Device randomly white-screens, becomes unresponsive, and spams computer (if connected) with 6 device folders

==

• [Peter] Discuss implementing Developer Status for stability for 3.0 (Master)
• White screen bug
  • Currently unknown cause, many developers contributing to 1122119. Bhavana to follow up with mwu(?)
• [Bebe] When should we update to v18D-1
  • Geo to follow up with releng to know what we're bundling -- are we frankenbuilding?
    • (catlee should know)
  • Are the reports still valid w/ different base build?
  • Naoki: flash 18d+shallow instead of deep?
    • Manual should go to full runs for overlap if this is picked

This Week - Decisions & Action Items

• [jlorenzo] Bug 1122119 - Leave a phone shallow flashed running on the clock the entire night and see if it crashes.
• [Peter] Draft a proposal for Developer Status and present it to QA Owners initially