QA/StaffMeetings/QA-Staff-11-14-2012

From MozillaWiki
Jump to: navigation, search

November 14, 2012

# Every Weds @ 1:30p Pacific Time - Mozilla HQ, Warp Core 
#
# Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
# Phone:  +1 650 903 0800 or 650-215-1282 x92 Conf# 9245 (US/INTL)
#         +1 800 707 2533 (pin 369) Conf# 9245 (US Toll Free)
#         +1 416 848 3114 x92 Conf# 9245 (Canada)
# IRC:    irc://irc.mozilla.org:6697/#qa

QA Org Items

   New Hires & Interviews 
   Upcoming Events/Conferences 
   Selenium Meetup on "The Future of Selenium Testing for Mobile Web and Native Apps" http://www.meetup.com/seleniumsanfrancisco/events/88722022/
   mozcampasia - anyone going?
   John Hammink on some panel at this conference  - http://mobilewebdevconference.com/san-francisco-2013/agenda.html (Thursday, January 31, '13)
   Notices

Travel / PTO

   19 (Kevin, PTO)
   16-26 (John away, PTO)
   22-27 (juanb in TX)
   Nov 30, Dec 25-26 and Jan 1,2 - All of Softvision

QA Team Updates Desktop (Juan)

   Firefox 
   Firefox 17.0 go-to-build later today, release on Tuesday
   Call-to-action: 
   If you can help with Firefox 17 security fix verification please contact ashughes immediately
   If you notice a hang with Social API turned on please contact ashughes immediately
   ESR (ashughes) 
   Firefox 10.0.11esr go-to-build on Friday, release on Tuesday
   Firefox 17.0esr go-to-build on Friday, release on Tuesday
   Stability (marcia) 
   Desktop Stability Report: https://wiki.mozilla.org/Platform/2012-11-13#Desktop
   Some Socorro issues late last week:
   Bugs related to this: 
   Original bug: https://bugzilla.mozilla.org/show_bug.cgi?id=810241
   Rollback: https://bugzilla.mozilla.org/show_bug.cgi?id=810298
   Root cause regression: https://bugzilla.mozilla.org/show_bug.cgi?id=792118
   Backfill: https://bugzilla.mozilla.org/show_bug.cgi?id=810313
   Automation (ashughes)
   Sync Client (Tracy) 
   2.0 into Fx20 nightlies by end of quarter
   Community Members Onboarding
   ashughes
    Jennifer Cappella (incoming bug triage -- via QA Contribute) 
    Kamil Jozwiak (security testing -- via Brian Bondy) 
    David Fern (incoming bug triage -- via QA Contribute) 

Mobile (Tony)

   Issues 
   Fennec: Respinning Firefox 17 b6, due to bug http://bugzil.la/802510 and working on bug http://bugzil.la/811763
   Likely mobile only beta 7 due to http://bugzil.la/811763
   B2G: ramping up on more outsourcing help with device testing
   Mozilla TPE and TEF are working directly with Moz US testing schedule
   stability and regressions still high
   see last week's summary below
   Fennec (Kevin/Aaron) 
    Stability (nhirata) 
   4.2 crasher as above ( bug 802510 )
   crash reporter not reporting as above ( bug 811763 )
   not much to talk about currently otherwise , see platform stability notes.
   Product marketing announcements to ride with Fx18 betas for release in January
   B2G (geo/tchung) 
   Last week's summary: https://intranet.mozilla.org/Program_Management/Firefox_OS/WeeklyStatus/20121109#Quality
   Current state of testcases in moztrap/testcase mapping:  http://bit.ly/U4qoCh  SV doing a great job!
   Already running suites for individual areas - vetting testcases
   We're starting a new process/triage with Gordon about handling UX, Polish, Performance issues
   TEF starting to use moztrap - export of testcases from Massimo arrived today.
   email/browser needs feedback from PM about use case questions
   email needs more test cases to cover coe path difference of imap/activesync
   Met w/ A-Team+Fabrice during workweek, came up with plan for mochitest framework to optionally run tests at a high privilege level to ease permissions concerns for functionality tests and centralize code for much easier maintenance.
   Refactored permissions testing approach into three separate suites to reduce dependencies on unstable system parts: https://wiki.mozilla.org/B2G/QA/API_Permissions_Test_Plan -- suite 1 and 3 tracked at https://bugzilla.mozilla.org/show_bug.cgi?id=811141, tracking bug + patch for suite 2 coming soon.
   Starting triage on existing mochitests to expand suite running on TBPL.
   Stability (nhirata)
   still need ADUs, still need symbols associated.  Reports should show correctly, but only some of them have.
   https://crash-analysis.mozilla.com/rkaiser/2012-11-13/2012-11-13.b2g.crashes.html
   Apps (Jason) 
   Pay & ID test plan being defined here - https://wiki.mozilla.org/Apps/ID_and_Payments/Test_Plan
   Preloaded apps planning discussion coming soon
   Planning on updating apps test plan on API updates
   Partial testing on-device of trusted UI and mozPay flows
   Looking into test definition updates for identity and apps
   Looking into more exploratory testing around new app changes on device
   Community Members Onboarding

Services (jrgm)

   Sync Server (jrgm) - https://wiki.mozilla.org/QA/Sync/
   BrowserID (jrgm) - https://wiki.mozilla.org/QA/BrowserID
   Working on train-2012.11.09 for production next week.
   Testing is somewhat blocked by an issue in stage env that is being worked on now
   Major load test run to analyze scaling issues (dialed up in stage to breaking point).
   stabilizing automation tests
   Hiring and Training 
   Phone screen with candidate last week

Web (Stephen)

   AMO
   Firefox 17 compatibility changes are landing this week.
   Firefox Health Report (FHR) - https://blog.mozilla.org/metrics/fhr-faq/
   the work and timeline is currently being scoped
   https://intranet.mozilla.org/Program_Management/FirefoxHealthReport
   Affiliates 
   no updates
   B2G/Gaia testing:
   we'll be able to check out the touch-event support in Marionette, tomorrow:
   https://bugzilla.mozilla.org/show_bug.cgi?id=809245
   this unblocks us from finishing Marketplace + almost all of the smoketests (sans ~2)
   A-team is busy working through our list of outright blockers or testability bugs:
   https://bugzilla.mozilla.org/show_bug.cgi?id=811053
   https://bugzilla.mozilla.org/show_bug.cgi?id=810376 (landed)
   https://bugzilla.mozilla.org/show_bug.cgi?id=811351 (landed, needs to land in aurora)
   they're cutting us a special build for today, so we can use the two "landed" bugs, above
   Bouncer 
   Sentry improvements verified and in the pipeline for the next release - https://bugzilla.mozilla.org/show_bug.cgi?id=804347#c13
   Engagement Projects 
   Firefox Flicks is in early project-kickoff state
   Firefox Marketplace 
   App signing is being set up. See https://bugzilla.mozilla.org/show_bug.cgi?id=797902 for more details
   We push as always on Thursdays. This week's changes are available at http://cl.ly/3K29001a3E2X
   Mozilla.com 
   http://scrumbu.gs/p/mozilla_org/
   Mozillians 
   Funkload performance benchmarking complete -https://bugzilla.mozilla.org/show_bug.cgi?id=795388#c7
   API release scheduled for next Monday
   MDN 
   http://scrumbu.gs/t/mdn/2012-11-20/
   PFS
   just got asked to help move PFS off of AMO:
   https://bugzilla.mozilla.org/show_bug.cgi?id=811841
   Socorro 
   Milestone 26 slated for release tomorrow
   https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced;target_milestone=26;product=Socorro;list_id=4964812
   team completed a postmortem for last week's release which needed to be rolled back due to https://bugzilla.mozilla.org/show_bug.cgi?id=792118 causing a regression
   Community Members Onboarding
   Firechemist/Jonah Ho has done some great MozTrap testing
   chrisculver701 joined IRC today and has looked at a few Marketplace tests

Community (Marcia)

   Projects 
   Upcoming Events 
   MozCamp Asia - Schedule is here: https://wiki.mozilla.org/MozCampAsia2012/Schedule
   Testdays (ashughes)
   Automation Testday: https://quality.mozilla.org/2012/11/automation-testday-get-ready-for-automated-webapi-and-webrtc-testing/
   Facebook Messenger for Firefox: https://quality.mozilla.org/2012/11/facebook-messenger-for-firefox-testday/
   Video Work
   QMO.next (Raymond)
   Community Members Onboarding


Automation Development (Henrik, Dave)


   General
   The WebRTC team wanted to have Henrik back to create automated tests
   Rob and Dave are working hard to get more WebAPI and Gaia tests written
   New ESX cluster in PHX will be available soon (network flow has already been setup)
   MozTrap (Cameron)
   Rebecca has been testing features.  Thanks Rbillings!
   MozTrap 1.2 going to staging tomorrow:
   Run Series
   Split-the-work while running tests
   Upgrade to Django 1.4.2 complete
   some int'l fixes
   MozTrap 1.2.5 in progress
   perf fixes for activating huge test runs
   links to lists with filters
   other small fixes
   Community Members Onboarding 

Basecamp Roundtable/Discussion Items

   [jsmith] External Reporting, Metrics, Validity, and Reliability
   (tony) pre-packaged 3rd party app testing strategy

Other Roundtable/Discussion Items

   Gmail PTO calendar up to date for the upcoming holidays?
   Even if your plans aren't solidified please add tentative dates to the calendar
   Coverage during the holidays for Firefox Desktop/Mobile/Firefox OS. Rel Management has a tracking sheet as to who is on point for coverage (https://docs.google.com/spreadsheet/ccc?key=0Ait_RA8Il0WWdFhxT2NBQXRBdm5NaWJOWFllOE5uS0E&pli=1#gid=0)
   Report from the Mozilla Festival
   One and Done Session led by Zac Campbell
   Poor turnout for variety of reasons but Reps/moderators did us proud and we went through the session structure anyway
   We spent 2hrs(!) discussing the personality of a contributor, their needs, drive, rewards and trying to understand how we can better deal with them
   A bit more time looking through Parul's wireframes
   Scans of the morning's work
   https://www.dropbox.com/sh/5xz4ze1s1kezgco/SN8X_kJ1qf
   http://careers.mozilla.org/en-US/position/oByUWfwJ
   Community Manager, Firefox Engineering
   We should begin a dialog about having a similar role for QA
   [mwobensmith] General question about how we intend to deal with B2G test media that is security-sensitive, as it is often host-dependent

Notes, Takeaways and Action Items

   Today 
   Notes
   Action Items
   Last Meeting 
   Action Items 

Template for this document is here: https://etherpad.mozilla.org/qa-staff-template