QA/StaffMeetings/QA-Staff-08-08-2012: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(48 intermediate revisions by 17 users not shown)
Line 23: Line 23:
** item
** item
* Upcoming Events/Conferences
* Upcoming Events/Conferences
** item
** Fennec work week next week: aug 13-17 boston.  Tony, Aaron, Kevin
** B2g work week: aug 27-31 sao paulo.  Jhammink


== [https://www.google.com/calendar/embed?src=j41a8ne525ml0heaipg0idb6is@group.calendar.google.com Travel / PTO] ==
== [https://www.google.com/calendar/embed?src=j41a8ne525ml0heaipg0idb6is@group.calendar.google.com Travel / PTO] ==
* item
* Tchung paternity: sept 10th-ish, for 4 weeks.
* juanb: aug 23 - sept 2, vacay.
* nhirata : aug 15 ~ aug 20 vacay.


== QA Team Updates  ==
== QA Team Updates  ==
Line 32: Line 35:
=== Desktop (Juan)  ===
=== Desktop (Juan)  ===
* Firefox
* Firefox
**  
** 15.0 beta 4 going to build today, shipping by Friday
* ESR (ashughes)
* ESR (ashughes)
**
** Current priority is burning down fixed bug verifications, [mailto:ahughes@mozilla.com email] Anthony if you can help
* Stability (marcia)
* Stability (marcia)
** [https://wiki.mozilla.org/Platform/2012-08-07#Desktop Stability Report for this week]
** [https://wiki.mozilla.org/Platform/2012-08-07#Desktop Stability Report for this week]
Line 41: Line 44:


* Automation (ashughes)
* Automation (ashughes)
**
** Current priority is automating Moztrap smoketests, 4 tests in-development
* Sync Client (Tracy)
* Sync Client (Tracy)
**
** Client train ran end of week last week.
** Current issue - Bug 781323 - Log files don't open from about:sync-log
* App WebRT (Jason/Aaron)
* App WebRT (Jason/Aaron)
** What happened this week?
** What happened this week?
***
*** Desktop largely deprioritized
*** Firefox heavy focus now for QA with some focus on Android
*** Began eliciting and understanding requirements for packaged apps
*** Mind dumped a bunch of test cases for Firefox OS apps lifecycle
*** Ramping up on navigator.pay requirements
*** Conducting web compat analysis to find top pain point frameworks
*** Continued QA support for Web Apps on Android
** What's next?
** What's next?
***
*** Continue ramping up on navigator.pay requirements
*** Build packaged apps test plan
*** Support testing of Firefox OS Hosted Web Apps functionality
* Community
* Community
** item
**


=== Mobile (Tony) ===
=== Mobile (Tony) ===
* Issues
* Issues
**
** getting back on track with trains.  fx17
** armv6 undecided, will increase marketshare once landed
** b2g devices have not arrived yet.  exploring other options; discussion on finalizing our pre-production device
*** dogfood program is coming (rel mgmt driving, qa helping)
** b2g feature not complete, still targeting 8/31
** webcompatibilty b2g agent changed, discussion is still ongoing
** thanks to everyone for onboarding to help with b2G!
* Fennec (Kevin/Aaron)
* Fennec (Kevin/Aaron)
**
**
** Stability (nhirata)
** Stability (nhirata)
***
*** see mobile, platform and channel meeting notes.
* B2G (Geo/jhammink)
* B2G (Geo/jhammink)
**
** Met w/ Lucas Adamski re: security/permissions testing.
** Much discussion around calculating coverage/trend metrics on testing (Gecko and Gaia)
** Continued framework fixes/mods for running mochitest on-device (manual kickoff for API verification purposes)
** Exercise created for Alarm API--some early problems seen
** Creating test plan for on-device API verifications
** jsmith joining team for Apps/Marketplace platform
** building new sheet for managing tests, reporting metrics as per TEF's/PMs requests
** we have divergent reporting methods now - setting up meeting to converge on one
***Request sent to MozTrap team for reporting reqs - https://etherpad.mozilla.org/b2g-moztrap-requirements
** onboarding Marcia with a few test areas
** nhirata doing bug maintenance and req review
* Pancake (nhirata)
* Pancake (nhirata)
**
** still haven't released
** 0 time spent on Pancake last week; meetings cancelled last 2 times.
** they are working on Waffles. (v2 UI is actually called French Toast... Waffles is just a joke)
* Community Members Onboarding
* Community Members Onboarding
** item
** item
Line 68: Line 98:
=== Services (jbonacci) ===
=== Services (jbonacci) ===
* Sync Server (jbonacci/jrgm): [https://wiki.mozilla.org/QA/Sync/ Sync Server]
* Sync Server (jbonacci/jrgm): [https://wiki.mozilla.org/QA/Sync/ Sync Server]
**
** TokenServer work continues in Dev and Stage
*** Includes BID and ToS requirements for Production
** AITC work continues in Dev and Stage
** Sync + MetLog work continues in Dev and Stage
*** Testing has just started in Stage
*** Need help from Dev and OPs on loadtest issues which block release to Production.
* BrowserID (jbonacci/jrgm): [https://wiki.mozilla.org/QA/BrowserID BrowserID]
* BrowserID (jbonacci/jrgm): [https://wiki.mozilla.org/QA/BrowserID BrowserID]
**
** Persona Beta release has been moved off of 8/15/2012 date due to resource and scheduling contraints for OPs and QA
*** Tentative release date is now some time between 8/15/2012 and 9/30/2012
*** QA is working with the BID "Stabilization" team to help establish controls for functionality, compatibility, and stability across trains.
*** QA is also sitting in on DevOPs discussions to define better deployment processes and tools
** Train 33: Bug 779264 - browserid: QA and deploy BrowserID train-2012.07.30 to production
*** NOTE: This is off of an AWS/ephemeral deploy. Stage is isolated for the BID "DevOps" team to debug.
* Community Members Onboarding
* Community Members Onboarding
**  
** klrmn has been helping Dev and WebQA with automation tasks for BID
* Hiring and Training
* Hiring and Training
**
** One phone screen candidate over the past two weeks


=== [https://wiki.mozilla.org/QA/Execution/Web_Testing/Meetings/2012 Web (Stephen)]  ===
=== [https://wiki.mozilla.org/QA/Execution/Web_Testing/Meetings/2012 Web (Stephen)]  ===
* Affiliates
* Affiliates
**
** Small l10n pushed -- [https://bugzilla.mozilla.org/show_bug.cgi?id=780622 milestone 2012-08-06]
* AMO
* AMO
**
** [http://cl.ly/3T07243A1z1h 2012-08-09] goes out tomorrow.
* BrowserID
**
* Engagement Projects
**
* Flightdeck
**
* Mozilla.com
* Mozilla.com
** no update
** no update
* Mozillians
* Mozillians
** manual testing of Kuma bugs
** [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED;query_format=advanced;component=Phonebook;product=Community%20Tools;target_milestone=2012-08-08;list_id=3967880 milestone 2012-08-08] push planned for today
* MDN
* MDN
**
** shipped [https://hacks.mozilla.org/2012/08/its-time-mdn-relaunch-on-kuma-wiki-on-august-3/ MDN Kuma] to production
** manually testing bugs
* Socorro
* Socorro
**
** [https://bugzilla.mozilla.org/show_bug.cgi?id=771218 Bug 771218] - Ongoing problems with Socorro staging
* SUMO
* SUMO
** Continuous Deployment; smooth sailing
** Continuous Deployment; smooth sailing
* Community Members Onboarding
* Community Members Onboarding
** item
** Sergey is back :-)
*** https://github.com/stupchiy


=== [https://wiki.mozilla.org/QA/QA_Community Community] (Marcia)  ===
=== [https://wiki.mozilla.org/QA/QA_Community Community] (Marcia)  ===


* Upcoming Events
* Upcoming Events
**
** September 12 CD meetup @ Atlassian in SF: [http://www.meetup.com/Continuous-Delivery-San-Francisco/events/76879172/?a=co1_grp&rv=co1 iOS CD Integration & Tightening the Feedback Loop in your CD System]
* Syracuse University Projects proposal:
** [https://etherpad.mozilla.org/Mozilla-Academic-Coursework Etherpad]


* Testdays (ashughes)
* Testdays (ashughes)
Line 112: Line 150:


* QMO.next (Raymond):
* QMO.next (Raymond):
**fixed search bug
**fixed search [https://bugzilla.mozilla.org/show_bug.cgi?id=781057 bug]


* Community Members Onboarding
* Community Members Onboarding
Line 119: Line 157:
=== [[Auto-tools/Automation_Development/Meetings|Automation Development (Henrik, Dave)]] ===
=== [[Auto-tools/Automation_Development/Meetings|Automation Development (Henrik, Dave)]] ===
==== General ====
==== General ====
* TBD
* OS X 10.8 slave has been enabled for Mozmill CI
 
* New [http://www.hskupin.info/2012/08/07/new-in-qa-testsuite-flag-available-for-mozilla-qa-driven-test-frameworks/ ‘in-qa-testsuite’] flag available for Mozilla QA driven test frameworks
==== Projects ====
* TBD


===== [https://wiki.mozilla.org/QA/TCM MozTrap] (Cameron) =====
===== [https://wiki.mozilla.org/QA/TCM MozTrap] (Cameron) =====
* TBD
* Investigating adding a new report for B2G
* 1.1 has been deployed to production


===== Community Members Onboarding =====
===== Community Members Onboarding =====
Line 131: Line 168:


== Basecamp Roundtable/Discussion Items ==
== Basecamp Roundtable/Discussion Items ==
* <add item>
* [jsmith] Managing Scope for Critical Path vs. Non-Critical Path for Basecamp
* Moztrap support for B2G daily testing (mattb)


== Other Roundtable/Discussion Items  ==
== Other Roundtable/Discussion Items  ==
* item
* Getting B2G phones for QA
* [https://mozillians.org/en-US/satdav satdav] raised: can we record meetings for community members, can meetings be held earlier to better include EU?
* Moztrap -- feature request for B2G reporting needs - https://etherpad.mozilla.org/b2g-moztrap-requirements
* nhirata to give a session based testing w/ gaia presentation tomorrow : PB&J at 1 pm PDT


== Notes, Takeaways and Action Items  ==
== Notes, Takeaways and Action Items  ==

Latest revision as of 22:55, 9 August 2012


« previous week | index | next week »

QA Staff Meeting Notes Aug-08-2012

Meeting Details

 # Every Weds @ 1:30p Pacific Time - Mozilla HQ, Warp Core 
 #
 # Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=UK1zyrd7Vhym
 # Phone:  +1 650 903 0800 or 650-215-1282 x92 Conf# 95312 (US/INTL)
 #         +1 800 707 2533 (pin 369) Conf# 95312 (US Toll Free)
 #         +1 416 848 3114 x92 Conf# 95312 (Canada)
 # IRC:    irc://irc.mozilla.org:6697/#qa

QA Org Items

  • New Hires & Interviews
    • item
    • item
  • Upcoming Events/Conferences
    • Fennec work week next week: aug 13-17 boston. Tony, Aaron, Kevin
    • B2g work week: aug 27-31 sao paulo. Jhammink

Travel / PTO

  • Tchung paternity: sept 10th-ish, for 4 weeks.
  • juanb: aug 23 - sept 2, vacay.
  • nhirata : aug 15 ~ aug 20 vacay.

QA Team Updates

Desktop (Juan)

  • Automation (ashughes)
    • Current priority is automating Moztrap smoketests, 4 tests in-development
  • Sync Client (Tracy)
    • Client train ran end of week last week.
    • Current issue - Bug 781323 - Log files don't open from about:sync-log
  • App WebRT (Jason/Aaron)
    • What happened this week?
      • Desktop largely deprioritized
      • Firefox heavy focus now for QA with some focus on Android
      • Began eliciting and understanding requirements for packaged apps
      • Mind dumped a bunch of test cases for Firefox OS apps lifecycle
      • Ramping up on navigator.pay requirements
      • Conducting web compat analysis to find top pain point frameworks
      • Continued QA support for Web Apps on Android
    • What's next?
      • Continue ramping up on navigator.pay requirements
      • Build packaged apps test plan
      • Support testing of Firefox OS Hosted Web Apps functionality
  • Community

Mobile (Tony)

  • Issues
    • getting back on track with trains. fx17
    • armv6 undecided, will increase marketshare once landed
    • b2g devices have not arrived yet. exploring other options; discussion on finalizing our pre-production device
      • dogfood program is coming (rel mgmt driving, qa helping)
    • b2g feature not complete, still targeting 8/31
    • webcompatibilty b2g agent changed, discussion is still ongoing
    • thanks to everyone for onboarding to help with b2G!
  • Fennec (Kevin/Aaron)
    • Stability (nhirata)
      • see mobile, platform and channel meeting notes.
  • B2G (Geo/jhammink)
    • Met w/ Lucas Adamski re: security/permissions testing.
    • Much discussion around calculating coverage/trend metrics on testing (Gecko and Gaia)
    • Continued framework fixes/mods for running mochitest on-device (manual kickoff for API verification purposes)
    • Exercise created for Alarm API--some early problems seen
    • Creating test plan for on-device API verifications
    • jsmith joining team for Apps/Marketplace platform
    • building new sheet for managing tests, reporting metrics as per TEF's/PMs requests
    • we have divergent reporting methods now - setting up meeting to converge on one
    • onboarding Marcia with a few test areas
    • nhirata doing bug maintenance and req review
  • Pancake (nhirata)
    • still haven't released
    • 0 time spent on Pancake last week; meetings cancelled last 2 times.
    • they are working on Waffles. (v2 UI is actually called French Toast... Waffles is just a joke)
  • Community Members Onboarding
    • item

Services (jbonacci)

  • Sync Server (jbonacci/jrgm): Sync Server
    • TokenServer work continues in Dev and Stage
      • Includes BID and ToS requirements for Production
    • AITC work continues in Dev and Stage
    • Sync + MetLog work continues in Dev and Stage
      • Testing has just started in Stage
      • Need help from Dev and OPs on loadtest issues which block release to Production.
  • BrowserID (jbonacci/jrgm): BrowserID
    • Persona Beta release has been moved off of 8/15/2012 date due to resource and scheduling contraints for OPs and QA
      • Tentative release date is now some time between 8/15/2012 and 9/30/2012
      • QA is working with the BID "Stabilization" team to help establish controls for functionality, compatibility, and stability across trains.
      • QA is also sitting in on DevOPs discussions to define better deployment processes and tools
    • Train 33: Bug 779264 - browserid: QA and deploy BrowserID train-2012.07.30 to production
      • NOTE: This is off of an AWS/ephemeral deploy. Stage is isolated for the BID "DevOps" team to debug.
  • Community Members Onboarding
    • klrmn has been helping Dev and WebQA with automation tasks for BID
  • Hiring and Training
    • One phone screen candidate over the past two weeks

Web (Stephen)

Community (Marcia)

  • Video Work
  • QMO.next (Raymond):
    • fixed search bug
  • Community Members Onboarding
    • item

Automation Development (Henrik, Dave)

General

  • OS X 10.8 slave has been enabled for Mozmill CI
  • New ‘in-qa-testsuite’ flag available for Mozilla QA driven test frameworks
MozTrap (Cameron)
  • Investigating adding a new report for B2G
  • 1.1 has been deployed to production
Community Members Onboarding
  • item

Basecamp Roundtable/Discussion Items

  • [jsmith] Managing Scope for Critical Path vs. Non-Critical Path for Basecamp
  • Moztrap support for B2G daily testing (mattb)

Other Roundtable/Discussion Items

  • Getting B2G phones for QA
  • satdav raised: can we record meetings for community members, can meetings be held earlier to better include EU?
  • Moztrap -- feature request for B2G reporting needs - https://etherpad.mozilla.org/b2g-moztrap-requirements
  • nhirata to give a session based testing w/ gaia presentation tomorrow : PB&J at 1 pm PDT

Notes, Takeaways and Action Items

Today

  • Add notes here

Last Meeting

  • Action Items