From MozillaWiki
Jump to: navigation, search

Mozilla QA Meeting June 25, 2014 (Video Replay)

# Every Weds @ 1:30p Pacific Time - Mozilla HQ, Room: QA
# Vidyo:
# Phone:  +1 650 903 0800 or 650-215-1282 x92 Conf# 9245 (US/INTL)
#         +1 800 707 2533 (pin 369) Conf# 9245 (US Toll Free)
#         +1 416 848 3114 x92 Conf# 9245 (Canada)
# IRC:    irc://

Actions From Last Week

  • marcia to proceed with QA Fair idea, getting list of stations and leads - Done
  • kthiessen to send out swag/tag discussion to dev.quality - Done
  • whimboo to summarize rules for verification re: in-testsuite to dev.quality (not done yet - if time permits i will do it this week. Otherwise early next week)
  • pragmatic to summarize atrain's commentary on QMO to dev.quality, continue that discussion - Done
  • rbillings to send out reminder to review One and Done contact info - Done

Discussion Zone

QA Show and Tell

  • This week:
    • B2G Smoketests Dashboard - jlorenzo
      • POC, not 100% accurate data for now.
      • Use Moztrap and Bugzilla data, stored in ElasticSearch backend (already used for )
      • Use Highstocks (from ) to render charts.
      • Open questions before going to production:
        • Are we okay to replicate Moztrap data into ES? If so, is a refresh rate of 30 minutes acceptable (equals to the one used for ) ? . If not, we need to add more data in Moztrap REST API and performance may be an issue. => Need to discuss about it offline.
        • Clicking on a bar of a chart to get the corresponding test cases/bugs is harder to implement than having a chart and a table inventorying them. The table would be refreshed each time the chart is (un)zoomed. Is it okay as a first running version? => Okay for the table in the first release
        • Is the licensing of Highstocks in line with Mozilla? (Creative Commons 3.0 BY-NC, free for non commercial use, ) => Need to talk to wlach. Flot may be another solution.
        • What is "Smoketests Age?" - bug-open age? (length of time each smoketest blocker is open, or?)
        • What about filtering by release? => Doable by tracking blocking-b2g flag. This data may not be always accurate.
  • Next week:

Milestones and Calls for Action


Upcoming Events/Conferences

  • QA Work Week Mon July 28 - Thu July 31 | Mountain View, CA


  • One and Done
    • We just discussed Q3 requirements and had a lot of great feedback

    • To file feature requests or bugs, see:

still waiting on tableau reports.

Contributor Welcome

These are new contributors, if you see them around, say hello

Contributor Honor Roll

For those that went above and beyond this week, we salute you here.


How To Find Us

Internal Goals

Detailed Updates

Below follows detailed updates on what each team is working on and toward. The leads highlighted in each section are the people you want to find if you're interested in helping out.

Desktop (Juanb)

  • Firefox
  • ESR (mwobensmith)
    • Two ESR channels now - 24 and 31.
  • Stability (KaiRo)
    • Crash rates look bad across the board, we are tracking the bugs and poking devs.
      • The largest 31 Beta issue seems to be an issue with old graphics drivers.
  • Automation (ashughes)
  • Security (mwobensmith)
    • Shumway security testing

Mobile (Tchung)

Platform (sydpolk)

Services (Edwong)

  • Identity/Persona
  • FxA
  • Sync
  • SimplePush
  • Heka
  • Loads
  • CampaignManager
  • AddOns Registration

Web (Stephend)

  • Affiliates
  • B2G/Gaia testing:
    • switched the Wi-Fi nodes in the QA lab to use "ateam" - seems to be going well
    • very close to proving the multi-adb-per-node - probably can enable it on the new, dedicated B2G Jenkins on Monday (tentatively)
      • with the exceptions of a few T-Mobile SIMs, the phones, Mac Minis, and temp. racks/shelving are all ready to go
  • Bouncer
    • No updates
  • Engagement Projects
    • no updates
  • Firefox Health Report
    • OH, "next quarter there will be a bunch of new work on FHR"
    • If this is the case we'll ramp up/remove the automation blocker for testing about: prefixes
  • Firefox Marketplace
    • Weekly release went live 06/24
    • weekly release scheduled for Thursday
  • Mozillians
    • Awaiting ops, new mapbox features slated to release any-time-now
    • Spring cleaning - dusting & mopping - continues on our test automation codebase. Be on the lookout for git issues
  • PluginCheck
    • Successful meeting with espressive + tomcat + whimboo this week outlining next steps
      • group is doing some exploration into spinning up vms with pre-configured envs to install plugins
  • Socorro
    • yesterday's outage to the webapp - didn't effect collectors or processors - was due to a missing WSGI file
    • Spring cleaning - dusting & mopping - continues on our test automation codebase. Be on the lookout for git issues
  • Webmaker
    • Added a new Jenkins job for stage
      • webmaker.stage.saucelabs
    • xfails added for page titles, stage and prod jobs are green now

Firefox Automation (Whimboo)

  • General
  • Projects
    • Puppet
      • We can now successfully puppetize Ubuntu and OS X boxes
      • Remaining work: screensize, proxies (gui), java and tools installation
    • TPS
    • Mozmill
      • Patch for using wptserve is nearly final, waiting for dependencies (manifest-parser)
    • Tests
    • The first basic geolocation test might land today. Others will follow soon.

Travel / PTO

  • [marcia] 6/25 and working remotely/some PTO until 7/9 (in EST)
  • [henrik] Maybe PTO June 30th - July 4th
  • [ashughes] PTO June 25 - July 2nd
  • [Tchung][Jsmith] traveling June 26-27 (seattle)
  • [Tchung] productivity ww week of july 18th (SF)
  • [mbrandt] PTO 6/27 - 6/30
  • [aaronmt] PTO 6/30
  • [rbillings] PTO 7/3-7/7

Action Items

  • [geo] Send out email re: getting topics for demo stations at QA meetup/fair

Template available at: