B2G/QA/Meetings/Automation/2014-09-25

Overview

This is a weekly meetup to discuss all things regarding B2G automation and Quality. Please use wiki style.

• Meeting Name: QA Automation Roundtable
• Meeting Time: Thursday @ 9:30am - 10am PST
• Vidyo Room: QA Vidyo Room
• Video Link: https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
• Dial in: 1-800-707-25331
• Meeting Notes: https://wiki.mozilla.org/B2G/QA/Meetings
• Previous Meeting: https://wiki.mozilla.org/B2G/QA/Meetings/Automation/2014-09-18

Previous Action Items

• [DONE] [Dave, Bebe] try rebasing the 2.0 base image and put 2.1 and 2.2 full flash on it. experiment with 1-2 devices for perf/and smoketest
  • v180 here (aka 2.0 w/ kk): https://drive.google.com/a/mozilla.com/file/d/0B7_yuXt7x6y4N3BHc1RHV0pjbVE/edit?usp=sharing
• [DONE] [Tony] investigate bug 1069187, and why this device is not responding. Resolved, yay!

Agenda

• Are we doing full 2.1 and 2.2 runs now against KK full flash pvtbuilds nightlies now?
  • Viorela's report for 2.1 today doesnt say kk in the subject line, so im unclear if its jb or kk. Okay KK.
• Scope/Definition for FxOS Functional automation effort
  • How to balance new work vs. fixing existing debt?
    • Concentrate on fixing/writing tests.
    • If blocked by harness issues, file bug against fxos-auto first, then take case by case if we're hard-blocked.
    • 2/3 work towards new tests, 1/3 work towards fixing debt/old tests
  • Do we know when to switch over to MarionetteJS instead of Python? MJS Still isnt ready, according to A-team. (ETA late OCT)
    • Make call w/ Zac as to when to pilot
  • Sources of tasks
    • MozTrap suite for Browser/Homescreen/RocketBar: https://moztrap.mozilla.org/runtests/run/5442/env/347/
      • Homescreen is at least somewhat stable, landed in 2.0
      • Vertical Homescreen test migration: https://bugzilla.mozilla.org/show_bug.cgi?id=1019891
      • Still some happy path left to cover
      • Kevin Grandon knows the score on Homescreen in terms of flux
  • Other things that landed in 2.0
    • Ringtones
      • Verify the sound channel?
    • Camera features
    • Accounts
    • Find my Device
    • Various apps got visual refresh
      • Dialer
      • Contacts
      • SMS
    • Unresolved Gaia UI Test Bugs: https://bugzilla.mozilla.org/buglist.cgi?product=Firefox%20OS&component=Gaia%3A%3AUI%20Tests&resolution=---&list_id=11238669
    • Open Gaia UI Test Bugs with no assignee: https://bugzilla.mozilla.org/buglist.cgi?list_id=11238677&emailtype1=substring&query_format=advanced&emailassigned_to1=1&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&email1=nobody&component=Gaia%3A%3AUI%20Tests&product=Firefox%20OS
    • Anything else we should be looking at? How about more smoketests?

This Week - Decisions & Action Items

[Geo] take the template from above and organize a backlog/breakdown sprint with Bebe, Martijn, and Geo