QA/StaffMeetings/QA-Staff-09-11-2013

# Every Weds @ 1:30p Pacific Time - Mozilla HQ, Warp Core 
#
# Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
# Phone:  +1 650 903 0800 or 650-215-1282 x92 Conf# 9245 (US/INTL)
#         +1 800 707 2533 (pin 369) Conf# 9245 (US Toll Free)
#         +1 416 848 3114 x92 Conf# 9245 (Canada)
# IRC:    irc://irc.mozilla.org:6697/#qa

QA Org Items

   QA Show and Tell

   This week: Lessons from the Cloud

   https://wiki.mozilla.org/QA/Show-and-Tell#Schedule

   Next week: Tony - B2G

   New Hires & Interviews 

   Upcoming Events/Conferences 

   Firefox for Android Work Week in Toronto (Sept 16-20)

   Notices

Travel/PTO

   [rbillings] PTO Sept 2-13 

   [tony] - in Taiwan, Sept 23-27

   [nhirata, jhammink, jsmith, zac] - Sep 7 to 14 Oslo work week

   [krupa] - working from India Sep 5-17th

   [mwobensmith] PTO 9/19-9/20

   [dclarke] PTO 9/25-10/2

   [kbrosnan] - PDX 9 -13th, Toronto 16 - 20th

   [nhirata] PTO .. Sept 20th?

   [camd] - Paternity leave watch.  She could pop at any minute!  :)

   [kbrosnan] - Toronto 16 - 20

QA Team Updates

Desktop (Juan)

   Firefox 

   24, 25, 26 shipping next week

   Firefox Metro to ship in Aurora 26.

   [marcia] [10.9] This OS is supposed to ship in the "fall" and I am actively running it as my primary OS.

   ESR (mwobensmith) 

   Security bug verification and ship readiness (17.0.9esr and 24.0esr)

   Stability (marcia) 

   https://wiki.mozilla.org/Platform/2013-09-10#Stability_.28kairo.2Fbsmedberg.29 

   Automation (ashughes)

   Security (mwobensmith)

   Community 

Mobile (Tony)

   Firefox for Android (Kevin/Aaron) 

   Firefox 24

   [aaron] Built and signed off on 24.0 beta 10 build-candidate #2 containing a single uplift of an approved low-risk cherry-picked patch in bug 899159 to further address reproducible deadlock situtations in WebRTC (in-combination with the help from bug 904784)

   Stability (kbrosnan) 

   https://wiki.mozilla.org/CrashKill/2013-09-09#Mobile

   B2G (Geo/jhammink) 

   Much of team out in Oslo for B2G workweek

   QA daily update: https://mozqa.etherpad.mozilla.org/oslo-b2g-ww-2013

   Stability (nhirata)

   https://crash-analysis.mozilla.com/rkaiser/2013-09-10/2013-09-10.b2g.topcrashes.weekly.html

   https://wiki.mozilla.org/CrashKill/2013-09-09#B2G

   Graphics  is the main issue speaking with Sotaro, you will notice gralloc locking  and unlocking, which cause a lot of the current performance issues.   Esp. under the conditions of change orientation

   [jsmith] getUserMedia audio support for Firefox OS test plan is finished

   [jsmith] Web Notifications for Firefox OS test plan is finished

   [marcia] Smoketests

   Still being bit by the Graphics crashes on 1.2 on a daily basis.

   [marcia] Full Functional Run on Buri 1.2 has started

   Results so far:

   The Run:http://mzl.la/14IokXm

   The Results:http://mzl.la/1ezIkT1

   The breakdown:http://bit.ly/1dY9qEO

   The Bugs:http://mzl.la/14BPk01 (11)

   Increasing 1.2 acceptance criteria

   Platform

   [dclarke + geo] device storage and alarms API compatibility tests finished/delivered

   [dclarke] mozCamera mochitests landed

   [martijn] Bug 914089 - b2g.json cleanup and reorder, part 3 - WIP patch attached

   [martijn] Bug 913706 -  Fix the tests for B2G mochitest that use nsICookiePermission.setAccess - patch going through tryserver testing/fixes on way to approval

   Community Members Onboarding

Services (Edwin)

   Identity

   Security fixes on next train

   Moz idP - rolled back deploy last week, shooting to re-deploy next week.

   Sync: testing db storage and api

   Sync: testing client side api

   Coming soon: Realms/Single sign on

    New Sync (just like Old Sync, but with less calories)

   Final architecture, focus, product definition, schedule, and sense of purpose is still under discussion ... 

   QA is focused on the 3 services that currently make up the authentication process for Sync: IdP/Auth (picl-idp), FAB (Persona-flavored account bridging), and the Scrypt-Helper (for stretching your mobile passwords).

   Load testing is still under development in the Dev environment

   Monitoring and logging is still under development in the Dev environment

   Next week we might start some real OPs planning for Stage and Prod

   I don't forsee any real QA client/automation work for at least two weeks.

   Services

   Campaign Manager (aka product annoucements for Fennec) testing now

   Push Notifications being load tested

   Tracking Heka for various services-related projects

Web (Stephen)

   B2G/Gaia testing:

   Had a Gaia dev (:jugglinmike) not only run our Gaia UI Tests for his area (clock), but he also fixed our tests to reflect his changes, before he landed!

   https://github.com/mozilla/gaia-ui-tests/pull/1347

   Working with :mwu to hopefully soon get our Hamachi engineering builds for master unblocked:

   https://bugzilla.mozilla.org/show_bug.cgi?id=912617

   Various gfx bugs caught: Bug 914823

   Core JS bug 915233

   IMEI dialer app failure bug 915038

   startup bugs: 914673, 

   Memory issue 915138

   Settings app bug 914091 (thanks contributor Anah for writing the test case for this)

   Bouncer 

   Automation caught a regression on stage for the alias firefox-latest (yay!)

   Engagement Projects 

   New Firefox Flicks release going out over this weekend, announcing the winners

   Firefox Health Report

   No updates

   Firefox Marketplace

   Getting closer to turning on Payments in the US, but have been finding some late-breaking issues

    Automation caught a few bugs this week, including:

   https://bugzilla.mozilla.org/show_bug.cgi?id=914238 - Featured apps section is empty on MP Stage homepage

   Mozilla.com 

   shipped weekly release on Monday

   working on tests for next release

   Mozillians 

    Marching forwards towards the summit and features desired for the event

   MDN 

     working on automated tests for MDN redesign

   Socorro 

    Milestone 59 is slated to ship today although may potentially be held back do to  https://bugzilla.mozilla.org/show_bug.cgi?id=915209#c2 

   https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&target_milestone=59&product=Socorro&list_id=7883380

   SUMO 

    Automated Persona-loging coverage is restored, now that developers have fixed the bug(s)

   Community Members Onboarding

Community (Marcia)

   Projects 

   Open Badge Competition deadline is 9-15

   One clear front runner in the results so far

   All design contributors will be featured in a blog post announcing the results next week

   Upcoming Events 

   Mozilla Summit 2013 - October 4 -6

   Agenda at a Glance: https://wiki.mozilla.org/Summit2013/AgendaAllDays

   Testdays (ashughes)

   September 20:  https://quality.mozilla.org/2013/09/testday-dedicated-to-the-new-multi-page-abouthome-in-firefox-for-android/

   Video Work

   No Update this week

   QMO.next (Raymond)

    no update this week.

   Community Members Onboarding

Automation Development (Henrik, Dave)

   General

   Automation Development report – week 36 2013: http://www.hskupin.info/2013/09/10/automation-development-report-week-36-2013/

   How to Run the Gaia-UI Endurance Tests: https://woodrobert.wordpress.com/2013/09/03/how-to-run-the-gaia-ui-endurance-tests/

   Projects

   Mozmill [henrik]

   Upcoming mozmill 1.5.23 release which fixes a regression introduced in 1.5.22

   Last patches for Mozmill 2.0 are under review (needs intensive testing)

   Mozmill CI [henrik]

   Mozmill l10n tests are running via mozmill-ci now: https://github.com/mozilla/mozmill-ci/issues/237

   Mozmill-CI got new jobs for the 24.0ESR release: https://github.com/mozilla/mozmill-ci/issues/286

   mozmill-env contains mozmill-automation package now for Mozmill 1.5.22 and 2.0rc5:

   https://github.com/whimboo/mozmill-environment/issues/62

   In the next couple of hours we will have setup a mozmill 2.0 ci instance for intensive final testing (bug 911993)

   Gaia [dave]

   gaia-ui-tests is now using mozdownload for b2g desktop testing

   Gaia-UI Endurance tests are now located in the main Mozilla /gaia repository

   Eideticker

   Initial working version of Eideticker CI: https://github.com/davehunt/eideticker-ci

   MozTrap (Cameron)

   New version pushed to production with some performance fixes.

   Bob Silverberg working part time on updating to Django 1.5.2

   Community Members Onboarding 

Roundtable/Discussion Items

   Spoke to desktop and got a update about bugzilla, we can make it for staff and contributors only to see

   we can do it every week as its fine to do you just need to submit a bug for it

   [tony] if you're testing B2G here, please test against 1.2 on your device.   see any of the qa-b2g team for build information.

   [marcia] Update on putting meeting on air mozilla?

Notes, Takeaways and Action Items

   Today 

   Notes

   Revisit doing Air Mozilla at the end of October. Check into Vidyo feasibility [Geo]

   Action Items

   Can we dogfood ZTE Open phones for 1.2 [tchung to follow up]

   Last Meeting 

   Action Items