QA/StaffMeetings/QA-Staff-12-12-2012

From MozillaWiki
Jump to: navigation, search

December 12, 2012

Every Weds @ 1:30p Pacific Time - Mozilla HQ, Warp Core

# Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
     Phone:  +1 650 903 0800 or 650-215-1282 x92 Conf# 9245 (US/INTL)
#         +1 800 707 2533 (pin 369) Conf# 9245 (US Toll Free)
#         +1 416 848 3114 x92 Conf# 9245 (Canada)
# IRC:    irc://irc.mozilla.org:6697/#qa

QA Org Items

   New Hires & Interviews 
   Several interviews are happening this week for QA services roles
   Talking to HR about improving the "Interview Prep" that occurs before we interview candidates on site
   Liz Henry started this week as Bugmaster! She is based out of SF
   "lizzard," in IRC
   Cornel Ionce, Bogdan Maris and Alexandra Lucinet have joined the Desktop Softvision team
   Andrei has joined Web QA to help backfill Bebe's leadership on helping with B2G automation (Gaia smoketests)
   Upcoming Events/Conferences 
   Notices

Travel / PTO

   Geo on PTO 12/17-1/1, back 1/2.
   kbrosnan EDT 12/18 - 12/31
   bmoss at offsite and back in office on Friday
   tchung in Madrid
   stephend 12/16/ - 12/21
   Please add PTO days to the Gmail calendar

QA Team Updates Desktop (Juan)

   Firefox 
   Per-window Private Browsing is now in Nightly
   Multi-provider Social API support is now in Nightly
   ESR (ashughes) 
   Stability (marcia) 
   https://wiki.mozilla.org/Platform/2012-12-11#Stability_Report_.5BWeekly.5D
   We were missing Flash symbols for 11.6, but we should have them now
   Automation (ashughes)
   Sync Client (Tracy) 
   no client Sync train
   Community 

Mobile (Tony)

   Issues 
   Fennec (Kevin/Aaron) 
    Stability (nhirata) 
   https://wiki.mozilla.org/Platform/2012-12-11#Stability_Report_.5BWeekly.5D
   Announcements (Tracy)
   In testing, but Client Dev and Server Dev are sorting out some implementation issues.  Problems I am currently seeing are time based, which should be fixed on the server.   Client code can't land on 18beta at this time.  We're cutting this too close and server dev has been slow to respond.
   B2G (Geo/jhammink)
   Geo on PTO from 12/17-1/1 (back 1/2)
   PoC for Mochitest Triage is mwargers
   PoC for Mochitest Framework and general automation concerns is dclarke
   PoC for Permissions testing is ptheriault
   Mad props to mwargers re: an extremely successful mochitest triage
   https://bugzilla.mozilla.org/show_bug.cgi?id=815416  successfully passed try-server. Adds 32000 legacy mochitests across 337  files from /layout  to b2g run. Want to run on cedar for a bit, then  move into m-c when demonstrably solid.
   https://bugzilla.mozilla.org/show_bug.cgi?id=817638  adds 55000 mochitests from /content across 590 files, however, didn't  pass try-server. Paring down list to eliminate rest of failures and then  will get moved into cedar, m-c.
   Will be running triage script across /dom over next week or so. Goal is  to get all these in (along with anything found in /dom) by EOY.
   Thanks to dclarke, mochitest auto-permissions are landing: https://bugzilla.mozilla.org/show_bug.cgi?id=814140. This should enable a bunch more tests. Also should fix most of the  work done on API smoketests previously that got derailed by perms  issues.
   Working on getting revised End to End testing
   Working on completion of Gaia UI automated tests on device
   Starting the full first time run on the B2G v1.0 TestRun after revision
   Verify Gaia and B2G fixed bugs
   Continue working with UX team & UXbranch
   Continue working with SUMO & Feedbacks
   App install test plan is defined with many MozTrap test cases defined
   Preloaded apps test definition is getting a bit clearer - met together to talk about it
   Trying to sign off on the identity pref on
   Vetting Moztrap Gaia testcase results from QAnalysts; trying to fix test areas.  Our schedule:
   Friday,  Dec 14th - complete all testcases, fixing/modifying/ importing;  complete 
   Friday, Dec 28th - complete a full first time run on the B2G v1.0 TestRun.  
   Jan 14th - verify Gaia and B2G fixed bugs
   Daily  Smoketest - we are getting TEF and Qanalysts (testing  outsource)  the  possibility to run the daily smoketests (they either  need rights  to the builds, or  manifests). 
   Stability (nhirata)
   https://wiki.mozilla.org/Platform/2012-12-11#Stability_Report_.5BWeekly.5D
   bug 817946 - We seem to corrupt memory somewhere, which leads to pretty useless stacks in crash reports
   Apps (Jason) 
   App install test plan is specified, somewhat in MozTrap -https://etherpad.mozilla.org/app-install-testing
   Identity test plan in progress for b2g on device - https://wiki.mozilla.org/B2G/QA/Identity
   Exploratory testing on app flows on b2g
   Tried to do a signoff to pref on identity - but signoff failed due a release coordination problem
   Community Members Onboarding

Services (jrgm)

   Sync Server (jrgm) - https://wiki.mozilla.org/QA/Sync/
   BrowserID (jrgm) - https://wiki.mozilla.org/QA/BrowserID
   still working on train-2012.11.23
   a release on Monday worked with most other RPs, but not bugzilla (5 logins affected, 4 of them me; we rolled back very quickly). There is a hotfix so we will try again this week.
   bigtent train-2012.12.07 has landed and branched
   working with jsmith w.r.t. b2g
   there is an ops maintenance window today Wednesday at 2pm (and I may step out of this meeting).
   Hiring and Training 
   interview this week, interview this Friday, and another next week

Web (Stephen)

   Affiliates 
   Release planned for next Monday
   https://wiki.mozilla.org/index.php?title=Websites/Affiliates/Release/2012/12
   B2G/Gaia testing: 
   currently working with the a-team to figure out why our run in CI is failing very early
   https://bugzilla.mozilla.org/show_bug.cgi?id=819809 - Marionette not properly starting tests and switching to frame (regression: 12/09) should be fixed now, which was our blocker, before 
   Monday/Tuesday lost due to bad builds
   Some existing tests have been strengthened and made more reliable
   Small amount of new coverage but nothing of High priority unfortunately due to various upstream blockers
   Bouncer 
   no updates
   Engagement Projects 
   Firefox Flicks planning release for Jan
   Firefox Marketplace 
   http://cl.ly/2F0h2V0E2703 going live 12/13
   Mozilla.com 
   working on testing and pushing a replacement Django-fied all.html page
   Mozillians 
   no updates
   MDN 
   pushed a bunch of changes live to production today
   QMO
   just pushed the WordPress 3.5 upgrade to production
   filed a bug to get Google Analytics on QMO
   Socorro 
   Milestone 30 slated to be released: 2012-12-12
   https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced;target_milestone=30;product=Socorro;list_id=5201761
   Community Members Onboarding

Community (Marcia)

   Projects 
   Upcoming Events 
   Grow Mozilla meeting tomorrow: https://wiki.mozilla.org/Grow/Meeting_12_13_12
   https://wiki.mozilla.org/Capture_Mozilla is an new initiative using video
   Testdays (ashughes)
   https://quality.mozilla.org/2012/12/firefox-os-automation-testday/ (davehunt)
   [tentative] Firefox 18 Beta / Per-window Private Browsing next week (juanb)
   Video Work
   No report this week
   QMO.next (Raymond)
   Community Members Onboarding


Automation Development (Henrik, Dave, Rob)


   General
   Welcome Mario from Softvision
   Firefox OS Testday on Friday (as noted above)
   Projects
   Gaia UI (Dave)
    Blocker: bug 819809 - Marionette not properly starting tests and switching to frame (regression: 12/09) 
    Marked tests appropriately when they require a local area  network (rather than wifi specifically) to allow such tests to run on  B2G desktop and panda boards 
    Test stability improvements, with more in progress 
    FM Radio test landed 
   WebAPI (Rob)
    Submitted updated patch for WebProximitySensor tests (bug 811583) 
    Submitted patch for WebMobileConnection.data tests (bug 811580) 
    Dave submitted patch for battery charging status (bug 805452) 
    Test reviews for our tests and reviews of some test changes by development 
    Patch coming today for Screen Orientation API test (bug 813777) 
   WebRTC (Henrik)
    Leaking mochitests have been enabled on the Alder branch 
    Working on the initial basic video peer connection test caused a lot of extra work due to crashes and unexpected behavior. 
    I'm going to simply transform the manual tests from http://mozilla.github.com/webrtc-landing/ as first step (those should be proven to work) 
    We now have https://github.com/whimboo/webrtc-tests where first mochitests will land until they are ready for final review 
   MozTrap (Cameron)
   Version 1.3.1 pushed out yesterday
   Demo of some new features
   Community Members Onboarding 

Basecamp Roundtable/Discussion Items

   Which builds should we be using on our Unagi devices?
   Please see marcia's email to qa-staff
   Please report crashes using these instructions: https://etherpad.mozilla.org/B2G-Crashes
   Releng asked us how long we want to keep the files for and also which files in regards to bug#819543. 
   1) is there any other files we need from that directory? 
   AFAIK: we need the unagi/otoro images.  log files are on buildbot, and  the symbols can be taken from the symbol server.  Does anyone else need  any of the other files? 
   2) How long do we need to keep the files? 
   At least a 6 week window is needed (between the gecko builds). I would  reasonably optimistically hope for 6 months, but prob 3 months is more  realistically reasonable.   Does anyone else have a better idea? 

Other Roundtable/Discussion Items

   [camd] - MozTrap demo:
   I wanted to give a 5-10 minute demo of a couple new MozTrap features
   markdown support in test runs for links, etc.
   shareable links
   PREVIEW: pinned / sticky filters
   UPCOMING: tags with markdown for prerequisites, etc.
   Can I ask we add the bit.ly addon to the site to make the links shortner - it will be for sharing them - satdav
   Can I suggest we add (BrowserID) persona as their is all ready a wordpress plugin
   the site has had a push today - with some accessibility links - they are darker now the orange and the blue links also the top bar has been fixed a bit

Notes, Takeaways and Action Items

   Today 
   Notes
   Can we have a URL shortener for MozTrap?
   Action Items - Add QMO 
   Can I ask we add the bit.ly addon to the site to make the links shortner - it will be for sharing them - satdav
   Can I suggest we add (BrowserID) persona as their is all ready a wordpress plugin
   Last Meeting 
   Action Items 

Template for this document is here: https://etherpad.mozilla.org/qa-staff-template