QA/StaffMeetings/QA-Staff-06-25-2014
From MozillaWiki
< QA | StaffMeetings
Contents
Mozilla QA Meeting June 25, 2014 (Video Replay)
# Every Weds @ 1:30p Pacific Time - Mozilla HQ, Room: QA # # Vidyo: https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh # Phone: +1 650 903 0800 or 650-215-1282 x92 Conf# 9245 (US/INTL) # +1 800 707 2533 (pin 369) Conf# 9245 (US Toll Free) # +1 416 848 3114 x92 Conf# 9245 (Canada) # IRC: irc://irc.mozilla.org:6697/#qa
Actions From Last Week
- marcia to proceed with QA Fair idea, getting list of stations and leads - Done
- kthiessen to send out swag/tag discussion to dev.quality - Done
- whimboo to summarize rules for verification re: in-testsuite to dev.quality (not done yet - if time permits i will do it this week. Otherwise early next week)
- pragmatic to summarize atrain's commentary on QMO to dev.quality, continue that discussion - Done
- rbillings to send out reminder to review One and Done contact info - Done
Discussion Zone
- Q2 Goals: https://wiki.mozilla.org/QA/Goals/2014q2
- Q3 Goals: https://wiki.mozilla.org/QA/Goals/2014q3
- Work Week information - a reminder concerning the QA fair - https://etherpad.mozilla.org/QA-Fair
- [marcia] agenda for QA work week https://wiki.mozilla.org/QA/Work_Week_July_2014
- [kthiessen] Any more discussion around swag-tags? If not, I'll close out the thread on dev-quality and send mail/open bugs to folks for next steps.
- [jsmith] More of a FYI - Appcache being killed off in the platform, need to know the impact on products we support
- BD probably needs to be contacted
- Be sure to get involved in the QMO discussion on dev-quality if you have an opinion.
- Update your areas with what is happening down below - it's important so that people not at the meeting can keep up with what is going on.
QA Show and Tell
https://wiki.mozilla.org/QA/Show-and-Tell#Schedule
- This week:
- B2G Smoketests Dashboard - jlorenzo
- POC, not 100% accurate data for now.
- Use Moztrap and Bugzilla data, stored in ElasticSearch backend (already used for http://charts.mozilla.org/ )
- Use Highstocks (from http://www.highcharts.com/ ) to render charts.
- Open questions before going to production:
- Are we okay to replicate Moztrap data into ES? If so, is a refresh rate of 30 minutes acceptable (equals to the one used for http://charts.mozilla.org/ ) ? . If not, we need to add more data in Moztrap REST API and performance may be an issue. => Need to discuss about it offline.
- Clicking on a bar of a chart to get the corresponding test cases/bugs is harder to implement than having a chart and a table inventorying them. The table would be refreshed each time the chart is (un)zoomed. Is it okay as a first running version? => Okay for the table in the first release
- Is the licensing of Highstocks in line with Mozilla? (Creative Commons 3.0 BY-NC, free for non commercial use, http://shop.highsoft.com/highstock.html ) => Need to talk to wlach. Flot may be another solution.
- What is "Smoketests Age?" - bug-open age? (length of time each smoketest blocker is open, or?)
- What about filtering by release? => Doable by tracking blocking-b2g flag. This data may not be always accurate.
- B2G Smoketests Dashboard - jlorenzo
- Next week:
Milestones and Calls for Action
Achievements
Upcoming Events/Conferences
- QA Work Week Mon July 28 - Thu July 31 | Mountain View, CA
Community
- One and Done
- We just discussed Q3 requirements and had a lot of great feedback
https://etherpad.mozilla.org/oneanddone-2014q3
- To file feature requests or bugs, see:
https://wiki.mozilla.org/QA/OneandDone
- os bridge/AdaCamp activity (readonly)
- liz's talk on Mozilla bug reporting, triage, QA, and release process at AdaCamp was well attended! (blog post to come)
- liz's talk with Sumana Harihareswara on the GNOME-OPW mentoring project
- Maja is running a hacker lounge event for One and Done: http://www.majazf.ca/blog/one-and-done-osbrige.html
- QA/bug triagers got a nice thank-you from a speaker at Open Source Bridge for helping to get a 12 year old bug fixed! (bug 157846)
- lots of people tried out firefoxOS phones last night :)
- QMO Redesign
- Lively discussion on dev-quality mailing list https://groups.google.com/forum/?_escaped_fragment_=topic/mozilla.dev.quality/9AmeBMJNu8g#!topic/mozilla.dev.quality/9AmeBMJNu8g
- Please chime in if you haven't got your opinion in yet.
- Baloo (lizzard) (read-only)
still waiting on tableau reports.
- progress tracked in https://bugzilla.mozilla.org/show_bug.cgi?id=1017201 and https://bugzilla.mozilla.org/show_bug.cgi?id=990667
- Events
- Intro to Web Testing event, 24 June 2014 from 6-8 pm PDT at the Mozilla San Francisco office (2 Harrison Street) http://www.meetup.com/The-Mountain-View-Mozilla-Meetup-Group/events/188949632/ https://etherpad.mozilla.org/WebQA-Intro
- QA Champions
Contributor Welcome
These are new contributors, if you see them around, say hello
Contributor Honor Roll
For those that went above and beyond this week, we salute you here.
Updates
How To Find Us
Internal Goals
- Monthly Review: https://wiki.mozilla.org/QA/Goals/2014q2
- In-meeting review first meeting of every month
Detailed Updates
Below follows detailed updates on what each team is working on and toward. The leads highlighted in each section are the people you want to find if you're interested in helping out.
Desktop (Juanb)
- Firefox
- ESR (mwobensmith)
- Two ESR channels now - 24 and 31.
- Stability (KaiRo)
- Crash rates look bad across the board, we are tracking the bugs and poking devs.
- The largest 31 Beta issue seems to be an issue with old graphics drivers.
- Crash rates look bad across the board, we are tracking the bugs and poking devs.
- Automation (ashughes)
- Security (mwobensmith)
- Shumway security testing
Mobile (Tchung)
- Firefox for Android (Kbrosnan/AaronMT)
- Stability (kbrosnan)
- Firefox OS (jsmith/nhirata)
- 2.0
- Dolphin remains the only 1.4 device.
- Stability (nhirata)
- https://wiki.mozilla.org/CrashKill/2014-06-23
- If you have ideas to improve the report : https://etherpad.mozilla.org/crash-reporting-for-B2G
- https://wiki.mozilla.org/CrashKill/2014-06-23
Platform (sydpolk)
Services (Edwong)
- Identity/Persona
- FxA
- Sync
- SimplePush
- Heka
- Loads
- CampaignManager
- AddOns Registration
Web (Stephend)
- Affiliates
- Waiting on finalized priority list - draft list --> https://docs.google.com/document/d/1aMqFZNMJDdhLp1cYp7mJtvMbSmzVUMq_B2CDIjQ17cc/edit
- Again, a big thank you to the community for helping working automation tasks
- B2G/Gaia testing:
- switched the Wi-Fi nodes in the QA lab to use "ateam" - seems to be going well
- very close to proving the multi-adb-per-node - probably can enable it on the new, dedicated B2G Jenkins on Monday (tentatively)
- with the exceptions of a few T-Mobile SIMs, the phones, Mac Minis, and temp. racks/shelving are all ready to go
- Bouncer
- No updates
- Engagement Projects
- no updates
- Firefox Health Report
- OH, "next quarter there will be a bunch of new work on FHR"
- If this is the case we'll ramp up/remove the automation blocker for testing about: prefixes
- Firefox Marketplace
- Weekly release went live 06/24
- Mozilla.com
- weekly release scheduled for Thursday
- Mozillians
- Awaiting ops, new mapbox features slated to release any-time-now
- Spring cleaning - dusting & mopping - continues on our test automation codebase. Be on the lookout for git issues
- PluginCheck
- Successful meeting with espressive + tomcat + whimboo this week outlining next steps
- group is doing some exploration into spinning up vms with pre-configured envs to install plugins
- Successful meeting with espressive + tomcat + whimboo this week outlining next steps
- Socorro
- yesterday's outage to the webapp - didn't effect collectors or processors - was due to a missing WSGI file
- Spring cleaning - dusting & mopping - continues on our test automation codebase. Be on the lookout for git issues
- Webmaker
- Added a new Jenkins job for stage
- webmaker.stage.saucelabs
- xfails added for page titles, stage and prod jobs are green now
- Added a new Jenkins job for stage
Firefox Automation (Whimboo)
- General
- Projects
- Puppet
- We can now successfully puppetize Ubuntu and OS X boxes
- Remaining work: screensize, proxies (gui), java and tools installation
- TPS
- The new bare-bone Jenkins master is running at http://tps-ci-production.qa.scl3.mozilla.com:8080/
- Remaining work: implement execution script for TPS, and pulse listener
- Mozmill
- Patch for using wptserve is nearly final, waiting for dependencies (manifest-parser)
- Tests
- The first basic geolocation test might land today. Others will follow soon.
- Puppet
Travel / PTO
- [marcia] 6/25 and working remotely/some PTO until 7/9 (in EST)
- [henrik] Maybe PTO June 30th - July 4th
- [ashughes] PTO June 25 - July 2nd
- [Tchung][Jsmith] traveling June 26-27 (seattle)
- [Tchung] productivity ww week of july 18th (SF)
- [mbrandt] PTO 6/27 - 6/30
- [aaronmt] PTO 6/30
- [rbillings] PTO 7/3-7/7
Action Items
- [geo] Send out email re: getting topics for demo stations at QA meetup/fair
Template available at: https://etherpad.mozilla.org/qa-mtg-template