QA/StaffMeetings/QA-Staff-03-12-2014

From MozillaWiki
Jump to: navigation, search

Mozilla QA Meeting March 12, 2014 (Video Replay)

# Every Weds @ 1:30p Pacific Time - Mozilla HQ, Warp Core 
#
# Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
# Phone:  +1 650 903 0800 or 650-215-1282 x92 Conf# 9245 (US/INTL)
#         +1 800 707 2533 (pin 369) Conf# 9245 (US Toll Free)
#         +1 416 848 3114 x92 Conf# 9245 (Canada)
# IRC:    irc://irc.mozilla.org:6697/#qa

Actions From Last Week

  • [ctalbert] Continue to pursue solutions about QA+/QA- and other triage flags for querying only: to Email or Not to Email (bug 978850)
    • Check bug for details re: resolution
  • [ctalbert] Final update to QA meeting template
    • Done

Discussion Zone

  • [jsmith] The no show and tell problem
    • [edwong] show and tell ideas: bugzilla tips-n-tricks, a*team high level view of projects
  • [jsmith] MozTrap Needs
  • [jsmith] Rethinking the meeting time
  • [marcia] Community Test Days - Can we set a goal of having teams host test days in their area once a month?
  • [kthiessen] Cross-pollination of testday publicity/outreach techniques, etc -- attendance at the Sync testday was a bit disappointing, and I'd like to know how other groups get more attendance.

QA Show and Tell

https://wiki.mozilla.org/QA/Show-and-Tell#Schedule What would people like to see: brainstorm here!

  • bugzilla tips, treeherder, desktop fx automation strategy (tbpl, mozmill, mochitest), finding a B2G regression range, testing sync
  • This week:
  • Next week:

Milestones and Calls for Action

Achievements

  • [FxOS QA] Completed our first 1.4 test pass
  • [FxOS QA] Had a very successful 1.4 bug bash (40+ attendees! 85 bugs! 2 blocker bugs!)

Upcoming

  • [FxOS QA] Working on setting up a signoff test pass to release Flame device to dogfooding community
  • [FxOS QA] Working on planning a first test pass with the tarako device

Internal Goals

Community Updates

Contributor Honor Roll

For those that went above and beyond this week, we salute you here.

How To Find Us

Upcoming Events/Conferences

Travel / PTO

  • Anthony Hughes will be at GDC all next week (March 17-21)
  • [dclarke] PTO 04/1 - 04/12
  • [tony] PTO 3/5-3/20
  • [kthiessen] In Portland for Mozilla Reps meetup -- Apr 5-6 (might take a day on either side of the weekend)
  • [lizzard] Mar 24-27 Web Eng workweek in MV.
  • [geo] FxOS perf workweek Mar 31 - Apr 4

Detailed Updates

Below follows detailed updates on what each team is working on and toward. The leads highlighted in each section are the people you want to find if you're interested in helping out.

Desktop (Juanb)

  • Firefox
    • Firefox for Windows 8 Touch Mode will not ship in Firefox 28 -- more details to come from Johnathan Nightingale later this week
    • Firefox 28.0rc will require a respin due to an issue related to updates from Windows 8 Touch mode supported Betas
    • keeping an eye on Pwn2Own in case a respin is required before Tuesday's release
  • ESR (mwobensmith)
    • Preparing for 24.4
  • Stability (KaiRo)
  • Automation (ashughes)
  • Security (mwobensmith)
    • We are waiting to see what security bugs they will find on Firefox today and tomorrow. All hands on board for rapid turnaround of bug verification and build certification.

Mobile (Tchung)

  • Firefox for Android (Kbrosnan/AaronMT)
  • B2G (Geo/jhammink)
    • just finished QAnalyst's portion of burirun 1.4-1:
    • [jammink] focusing on Tarako; just set up base imaging station in MV
      • also, 1.3t triage, for which I must duck out early today
    • [jammink] SIM Customization testing this week for 1.4; seeing different results than TEF. Investigating.
    • [jammink] following verifyme bugs for 1.3
    • [jsmith] FxOS 1.4 Bug Bash last week
    • [dclarke] mochitest on device / fixes for profile / wifi connectivity issues
    https://bugzilla.mozilla.org/show_bug.cgi?id=981190
    https://bugzilla.mozilla.org/show_bug.cgi?id=981217
    • [geo] Met with relman and reviewed release dashboard against metrics needs. Checking it out to see if staging a QA instance w/ quality-based queries (jsmith has several already established) would make sense re: tracking metrics and baselining: https://github.com/williecheong/release_dash
    • [geo] Working on improving Eideticker FPS measurement, starting with having a stable reference target to measure against. Building frame-timing analyzer to show frame anomalies so they can be matched to Eideticker results: https://github.com/geoelectric/moz-frame-analyzer *** will be hookable into existing requestAnimationFrame-based animation demos to dump timings.

Services (Edwong)

  • FxA
    • Beta Test Pass
    • getting delete acct landed asap
  • Sync
    • Beta Test Pass
  • WMF/FMD
    • peter landed some linting on server

Web (Stephend)

  • Affiliates
    • Waiting for first iteration of site redesign to land on dev for manula testing + rejiggering of automation to match new workflows
  • B2G/Gaia testing:
    • Tarako device up and running Performance tests in MV office.
    • Functional tests caught 2 tiling bugs 982128 and 982113
  • Bouncer
    • No updates
  • Engagement Projects
  • Firefox Health Report
  • Firefox Marketplace
    • Apps day in session.
    • Marketplace weekly release was shipped on 03/11
  • Mozilla.com
    • shipped weekly release. testing Bedrock's update to the latest playdoh-lib.
  • Mozillians
    • No updates
  • MDN
  • Socorro
    • No updates - continous delivery
  • SUMO

Firefox Automation (Whimboo)

  • General
  • Projects
    • Mozmill
      • Mozmill 2.0.6 has been released with preliminary crash handling support - we already found a couple of crashes
      • We will keep in releasing 2.0.7 with set as default browser for metro, which will happen soon
    • Mozmill Tests
      • Cosmin is working on software update tests to allow Beta -> RC -> Beta updates
    • TPS
      • Made TPS working for Firefox Account authentication by last Friday - still have to finish it up so we are backward compatible with the old sync auth
      • Tests are running: http://brasstacks.mozilla.com/autolog/?tree=mozilla-inbound&source=autolog
      • Failures have to be investigated - there might be some core issues actually (Andreea and Andrei will help here)
      • On fixing base code for Firefox Account, which is necessary for TPS
      • Work on Coversheet (TPS CI) has been started
  • MozTrap (Camd)

Action Items

  • ctalbert taking over the meeting invite and will book a new conference in the new office
  • figure out how to get us back on Air Mozilla as a stream [owner needed]
  • [karl] Straw poll/Doodle - Does the current meeting time work for you
  • [geo] Interactive MozTrap task session - usability study please put on calendar
    • Identify top N flows
    • Walk through as a group
    • Expose/articulate individual issues
  • [entire team] Each team a plan test day for the next month
    • If you need help/advice please contact ashughes
  • [team] review all draft One and Done tests and get them into prod

Template available at: https://etherpad.mozilla.org/qa-mtg-template