QA/StaffMeetings/QA-Staff-04-10-2013

From MozillaWiki
Jump to: navigation, search

April 10, 2013

# Every Weds @ 1:30p Pacific Time - Mozilla HQ, Warp Core 
#
# Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
# Phone:  +1 650 903 0800 or 650-215-1282 x92 Conf# 9245 (US/INTL)
#         +1 800 707 2533 (pin 369) Conf# 9245 (US Toll Free)
#         +1 416 848 3114 x92 Conf# 9245 (Canada)
# IRC:    irc://irc.mozilla.org:6697/#qa

QA Org Items


   New Hires & Interviews 
     
   Upcoming Events/Conferences 
   Jammink at SFHTML5 conference, April 25th; also invited to speak at MobileWebDevcon in Boston, July 16th
   B2G Workweek in Madrid (Apr 15-19)
   Notices



Travel / PTO


   [marcia] PTO April 12
   Firefox OS Work Week in Madrid April 15-19 - https://intranet.mozilla.org/FxOS_Madrid [bob, tchung, marcia, jsmith, zac) 
   jammink - april 8-16 in Chile for IOT (Interoperability Testing) 
   [juanb] PTO April 18, 19
   [edwong] possible jury duty April 22+


QA Team Updates

Desktop (Juan)


   Firefox 
   Firefox 21.0b2 released (featuring multiple Social providers and about:healthreport)
   Firefox 20.0.1 to be released tomorrow.
   New Funnelcake builds also in the works for this/next week.


   ESR (mwobensmith) 



   Stability (marcia) 
    https://wiki.mozilla.org/Platform/2013-04-09#Stability


   Automation (ashughes)


   WebRTC (jsmith)
   Notices
   Targeted for Fx22 ship - 7 blockers remaining
   Automation remote story debate - TURN & STUN server integration in mochitests
   Quality concerns - data channel automation needs improvement, audio latency
   Status - This Week
   More WebRTC Exploratory Testing - E2E Dogfooding + DOM API Analysis
   Investigate bug 859395 to diagnose call failure
   Status - Last Week
   Offer media constraint mochitests landed (bug 850275)
   Exploratory testing for Peer Connection & Data Channel DOM APIs
   First stab at checking media flow mochitests (bug 831789)
   Dogfood exploratory sessions with audio/video chat testing
   Misc automation development (bug 855796, bug 850587)
   Security (mwobensmith)
   CSP planning, IDN cleanup, assorted security bugs


   Community 
   [jsmith] Advertised WebRTC dogfooding and testing opportunities on various communication channels - https://quality.mozilla.org/2013/04/webrtc-testing-try-out-conversat-io-with-other-users-and-file-bugs/

Mobile (Tony)


   Issues 
   Fennec:
   Amid a cycle for Firefox for Android 20.0.1 containing promo removal and stability ride-alongs; targeting release tomorrow
   http://bugzil.la/858561 – Move BrowserDB.expireHistory from GeckoApp.onPause to GeckoApplication.onActivityPause
   http://bugzil.la/859425 – Move decoding/storing favicons to background thread
   http://bugzil.la/817775 – Marketplace promo is active on beta on about:home, but it shouldn't be
   B2G:
   Smoketest continue to fail on commercial RIL
   https://bugzilla.mozilla.org/show_bug.cgi?id=857632
   Workweek next week, focus involved v1.0.1 bug stomping
   IOT issues found this week in Chile and Spain for round 1.  See below for details
   Inari and Leo devices are ported with nightly builds.  Buri is next focus, has known driver issues
   Fennec (Kevin/Aaron)
   Working on a h264 device compatibility test plan
    Stability (nhirata) 
    https://wiki.mozilla.org/CrashKill/2013-04-08#Mobile
    bug 752828:
   mfinkle made a change on friday to help, please test around the following bugs 
    https://bugzilla.mozilla.org/show_bug.cgi?id=843005
    https://bugzilla.mozilla.org/show_bug.cgi?id=856739


   B2G (Geo/jhammink) 
   Stability (nhirata)
   https://wiki.mozilla.org/CrashKill/2013-04-08#B2G
   in need of LG device to test around geolocation crash
    bug 859915 - crash in [@ libqc_b2g_ril.so@0x41ba4]
   UX bugs (nhirata):  details:
   https://docs.google.com/spreadsheet/ccc?key=0ArdCjhGHWKX1dHd1U0hmTGl5b2FMTDhkWGNsUjlZUGc#gid=2
   TestRun 1.1a (camd, mbrandt)
   TestRun 1.1a has not been created yet - waiting for go-ahead from jammink
   jammink gives go-ahead; I'll be leaning on Barker to set up the breakdown and help dole out tasks
   camd created a script using Moztrap's API that can create new testruns based off of a list of testcase ids - https://moztrap-connect.readthedocs.org/en/latest/api.html
   IOT Testing
   Tracking bugs from Mozilla:
   https://bugzilla.mozilla.org/show_bug.cgi?id=855378 - Certification Blockers for Latam IOT (incomplete)
   https://bugzilla.mozilla.org/show_bug.cgi?id=855322 - Certification blockers for Spain IOT
   Whiteboards all bugs updated (IOT, <region>, Ikura). Combined Bugzilla Query for ALL IOT whiteboard bugs: http://bit.ly/10MocpA  PLEASE CHECK THIS QUERY!  I am seeing 56 bugs (Spain and Chile combined)
   Top issues (numbers as yet refer to vendor-specific bug tracker, not bugzilla):
   #43554 - Messaging delivery reports are received poorly decoded.
   #43555 - The DuT does not send messages to destinations of 8 digits
   #43257 - [BLOCKER] The links on the web pages do not work
   #NOT ENTERED YET - [BLOCKER] The DUT is unable to import the contacts from the SIM.
   Keypad for entering PUK, PIN and new PIN does not show any keys (not in (no issue in system yet)
   Other issues found in IOT (my rubbish translation, sorry)
   DUT displays options or bookmarks in English (no issue in system yet)
   Media player not paused when a call is recieved #43552
   Audio still present when volume set to 0 #43553
   Facebook does not allow you to upload a photo #43556
   Current IOT risks:
   ZTE and TEF are using their own system to log certification bugs  There seems to be quite a bit of disconnect as to how bugs are getting entered into Bugzilla and or handled on our side, and there is a risk that issues will get dropped
   I'm going to propose that we switch to either their system or ours.
   TEF has expressed some concern that bugs are not being bumped to P1.
   We have a scarcity of IKURA devices to which to repro bugs, collect logcats and screenshots.   I'm working with Gerald to fix this and get us a loaner device for the duration of the time I'm here; in the meantime, we've made a few visits already to certification facility to collect this info; we'll return to AT4 for next round this friday.
   AT4 (the certification facility) is testing on a very old build - which no one between TEF and ZTE can agree which it actually is.  David from TEF says it's 3/21; the phones I checked at AT4 today were on a 3/28 build.
   Other
   I've been asked by ZTE today to possibly stay for - or return immediately for- another week.  Certification testing is only just now getting underway, and there is much to do re: co-ordination
   Continuing to explore compatibility document/test suite for 1.0.1. Have list of documentation targets from engineering, going through estimation/scoping on what we have.
   Smoketest effort continues
   We have been testing with the Mozilla RIL the past few few days due to compatability issues
   Community Members Onboarding



Services (Edwin)


   Identity
   Sign In Beta 2 announcement and social media blitz
   AWS - jrgm - gene continuing buildout, have confirmed initially for keysigner and verifier; need readonly databases to get much further.
   working on fixing up automation - edwong/karl
   PiCL - jbonacci
   Prototypes and demos!
   Integrating SimplePush, MySQL, also
   Focus is on picl-server and marteau this week. Next week will probably shift to desktop and mobile
   Services
   Heka 0.1.2 for Sync is due to go out to Prod today (jbonacci)
   Heka 0.1.4 for Marketplace is due to go out to Prod today (Services QA spectating)
   Heka 0.2 release is getting ready for some QA effort (kthiessen)


Web (Stephen)


   Affiliates 
    No updates


   B2G/Gaia testing: 
   1 v1-train regression caught
   6 new tests added
   Some coverage gained, some lost due to Marionette changes


   Bouncer 
    working through https://bugzilla.mozilla.org/show_bug.cgi?id=860274 - Deploy bouncer redirect in support of 20.0.1 Firefox release
   brandon (dev) added tests for them in https://github.com/mozilla/bouncer-tests/pull/30/files


   Engagement Projects 
    nothing this week
   Firefox Health Report
   v1.0 shipped
   https://blog.mozilla.org/metrics/fhr-faq/
   https://twitter.com/lxt/status/320267073429311489
   Diagnosing STR for https://bugzilla.mozilla.org/show_bug.cgi?id=860477


   Firefox Marketplace 
    Krupa's been in apps/marketplace meetings; will have her update after the meetings


   Mozilla.org 
   mozilla.org test day last Friday April 5th, 2013  https://etherpad.mozilla.org/mozilla-org-testday-april-2013
   shipped https://mozilla.kanbanery.com/projects/33256/board/


   Mozillians 
    Milestone 04-04-2013 released this week
   https://wiki.mozilla.org/Mozillians/Releases/2013-04-04


   MDN 
    https://developer.mozilla.org/en-US/docs/Project:Changelog


   Socorro 
    Releases are blocked until stage is stood back up
   [tracker] Mo' stage, mo' problems: issues with backfilling and crontabber
   https://bugzilla.mozilla.org/show_bug.cgi?id=859931


   Community Members Onboarding



Community (Marcia)


    Grow Mozilla Meetings
   Notes from April 4 meeting - https://wiki.mozilla.org/Grow/Meeting_04_04_13
   Open Badges Presentation - May 2, 2013 at Noon in Ten Forward. Will be streamed on Air Mozilla.
   Please come prepared with questions and review this spreadsheet prior to the presentation:
   https://docs.google.com/spreadsheet/ccc?key=0AsHml-k4XnX7dG1tV0JLTE1yZjJlM2RqaVdfS24zX0E#gid=0
   Projects 
    One and Done
   Some discussion on the community-building mailing list regarding the scope of the project
   Delphine's feedback from her presentation at Mozilla Hispano Work Week (approx. 20 people attended): 
   People felt that this should be a tool oriented to newcomers only -  and not to people that are already Mozilla or Open Source contributors  
   They said that it would probably be difficult for people to judge how  much time a task could take, especially if they are new. This was said  for example when showing the mockup where there is a time line, and that  the contributor has to say where in the task he is 
   Some people present thought that the reward process was not  "rewarding" enough, or not something they would personally find  rewarding. This makes me wonder how successful Open Badges are going to  be in other countries than the US. 
   However I'd like to note that the people who thought that receiving a  badge or swag was not perceived as rewarding are old-time contributors,  who say that they already have too much Mozilla swag and don't care  about Badges. For newcomers though, this might be perceived as rewarding... 
   Some time ago, I remember some community members in Europe for example  saying that they did not feel interested by the badge rewarding system.  This may have changed since then, but maybe it's worth looking into? 
   Otherwise feedback was generally positive. People think this can be a  very useful tool to attract new contributors and are interested in seeing it develop more 
   Linden School
   Had a conference call with Mike Hoye, Liz Henry and Kat from the Linden School in Toronto. They are interested in integrating some Mozilla content into their curriculum for the fall semester and are willing to consider proposals that would be suitable for 15-17 year old young women
   Created https://mozqa.etherpad.mozilla.org/Linden-School-Ideas to track ideas


   Upcoming Events 
    Mozilla Summit - https://wiki.mozilla.org/Summit2013
   October 4th, 5th and 6th
   Awaiting word on how community nominations will be handled after they have registered in Mozillians
     High-Level Timeline as published on wiki:
   April 17th - Final day for volunteers to update their Mozillians.org profiles (add location and join "summit 2013" group). 
   April 30th - Summit invitation list (volunteers only) final. 
   By second week in May - Volunteers who will receive invitations will be contacted via email. 
   First weeks in June - Invitations sent to staff + volunteers. 
   June 14th - 16th - Summit Planning Assembly (Paris, France) 
   Remo - Mozilla Mexico - April 26 - 28
   https://etherpad.mozilla.org/remo-mozcamp-mexico


   Testdays (ashughes)
   Firefox 21 Beta testday this Friday, April 12, 2013:
   https://quality.mozilla.org/2013/04/firefox-21-0-beta-2-testday-march-12th/


   Video Work
    No update this week


   QMO.next (Raymond)
   waiting on  security review of plugin


   Community Members Onboarding



Automation Development (Henrik, Dave)


   General
   Overall A-team goals for Q2 2013: https://wiki.mozilla.org/Auto-tools/Goals/2013Q2
   Still no update yet for the mozqa.com move - not sure when IT will actually handle it (bug 811869) 
   Still a slow process by IT to get ready with our new Mac Minis (bug 853074) 


   Projects
   Mozmill CI [henrik]
   Henrik landed a patch (bug 857956) which drastically improved the robustness of the update tests (lets cross fingers that it will stick)
   Last blocker for pulsebuildmonitor has been fixed and we can most likely push it to production tomorrow
   Testing localized builds for beta and release candidate builds are on the way (bug 857980 for pulsetranslator needs to be fixed first)
   Gaia UI
   Lots of work going into making the Gaia UI tests run reliably on B2G desktop. A lot of fixes already landed for next Marionette release, and hopefully more soon.


   MozTrap (Cameron)
   [camd] - working on a few more small updates
   [camd] - created new suite for b2g of test cases in v1.1.0 that are not in v1.0.1
   https://moztrap.mozilla.org/manage/cases/?filter-suite=273


   Community Members Onboarding 



Roundtable/Discussion Items


   When do you want Q2 goals finalized by? [tony]
   Or generally, can we can update from each team on Q2 Goals?
   Do we have anyone in the pipeline for Director of QA? [mbrandt]
   Criteria for giving equipment to community members [marcia]
   Request for a contributor funneled over from David Boswell


Notes, Takeaways and Action Items


   Today 

   Notes
   Action Items
   Last Meeting 
   Action Items 

Template for this document is here: https://etherpad.mozilla.org/qa-staff-template