QA/Firefox/TeamMeetings/Firefox-QA-Staff-01-21-2015

Firefox QA Standup - January 21st, 2015

Dial-in Information

• Wednesdays, 8:30am Pacific Time
• Telephone:
• 650-903-0800 or 650-215-1282 x92 Conf# 99779 (US/INTL)
• 1-800-707-2533 (pin 369) Conf# 99779 (US)
• Vidyo Room: QA-Desktop
• Vidyo Guest URL
• Agenda and notes: etherpad
• Archives: wiki.mozilla.org
• Previous Meeting: https://wiki.mozilla.org/QA/Firefox/TeamMeetings/Firefox-QA-Staff-01-14-2015

Attendees: Florin, Henrik, Andreea, KaiRo, Andrei, Otilia,Teodora, Petruta

Project Updates

• Loop (-)
  • [Florin] Will there still be someone monitoring this? Should we remove it from the meeting? No one is owning this so it should be removed (ashughes)

• E10S (Juan/Liz)
  • Draft e10s test plan at https://wiki.mozilla.org/QA/Electrolysis
  • Remaining on nightly until probably 39/40 (we are pushing to 40)
  • more e10s tests will be enabled soon on mozilla-central (moved from holly)

• Metrics / Dashboards (KaiRo)
  • Ongoing discussions on release-drivers about the loss of ADI on Aurora/DevEdition and Nightly channels, how that affects quality and what their quality has to be so people can run them.

Support is working on some metrics for trending issues and will share their data with us once it s ready (late Q1)

• • They are working on an alert system that will give them notice of trending issues and that is their Q1 project. We discussed ways to bring that into the QA risk analysis as one part of it.
  • They have interesting data sets that can provide feedback from the "out in the wild" crowd which would be very useful (and something we've never had before).
  • Metrics and code complexity update - (ctalbert)
    • anthony interested

• Stability (KaiRo)
  • Still no Android 37.0a2 and 38.0a1 data on Socorro due to bug 1122145.
  • Crash rates are bad on all channels except desktop release.
  • Will have a meeting with the team on the future of custom reports (currently scheduled for Monday)

• Shumway (mwobensmith)
  • Focusing on the JW Player - an open-source Flash video player

• You Tube Testing Status Update [marcia]
  • [Florin] Firefox 36 Beta 3 testday is scheduled for Friday January 23rd. If we are to include Youtube testing we need testing details to add to the testday etherpad: https://etherpad.mozilla.org/testday-20150123.
    • Added to the etherpad.
• Current status is on Line 81 of https://etherpad.mozilla.org/QA-YouTube-Status
• Need to spot check MSE feature in Beta 2

Notes and Actions

• [Ctalbert] Fix template to remove Loop - maybe someone else would liek to own?
• [ctalbert] send ashughes the metrics update stuff (and marc)

Heads-Up

• Upcoming PTOs:
  • Vasilica Mihasca (Ica) - Sick Leave - Jan 19th - 23rd
  • Liz- out Friday afternoon and Monday

• Events
  • [Florin] Firefox 36 Beta 3 testday scheduled for Friday January 23rd.

Q4 Goals

https://wiki.mozilla.org/QA/Goals/2014q4

Q1 Goals

https://wiki.mozilla.org/QA/Goals/2015q1

Community

[Ioana] Next Community Call: https://etherpad.mozilla.org/Quality-Automation-Call-2015-01-27 Last: https://etherpad.mozilla.org/Quality-Automation-Call-2015-01-13 [Ioana] Qa Buddy Up Pilot launched: https://wiki.mozilla.org/QA/Buddy_Up_Pilot Let our contributors know about the program

Channel Status

Release (Fx 35)(Desktop - KaiRo Mobile - Kevin)

Mobile: https://wiki.mozilla.org/QA/Fennec/35

Beta (Fx36) (Desktop - KaiRo Mobile - Aaron)

Mobile: https://wiki.mozilla.org/QA/Fennec/36 Beta 2 is delayed due to US holiday this Monday

Aurora (Fx 37) (Desktop - KaiRo Mobile - Aaron/Kevin)

Mobile: https://wiki.mozilla.org/QA/Firefox#Release_Owners General Testplan: https://wiki.mozilla.org/Releases/Firefox_37/Test_Plan

Nightly (Fx 38) (Desktop - KaiRo Mobile - Aaron/Kevin)

This is an ESR release Spring awesomeness?

Security

• Various SSL things
  • 1024 bit root cert changes slated for Fx36 \o/
  • Secure TLS fallback slipped to Fx37 (bug 1084025)

Automation (whimboo)

• General
  • Working on monitoring more closely the infrastructure issues we've been having for a while now, triaging the bugs for duplicates and leaving just one for each
  • Duty will maintain a statistics document to see how often an issue reproduces on each machine
  • mozmill-crowd 0.3 has been released: https://addons.mozilla.org/en-US/firefox/addon/mozmill-crowd/

• Testdaybot Status
  • Ready for prime-time. We can get it running for this weeks Test Day. Details see: https://github.com/mozilla/testdaybot/issues/52

Thanks Barb!!! \o/

• Marionette / Mozmill
  • The upcoming Firefox UI tests with Marionette are now located at: https://github.com/mozilla/firefox-ui-tests and are included in bugsahoy via the new Bugzilla component "Mozilla QA / Firefox UI Tests"

• Tests
  • Functional testrun takes fewer time now thanks to a fix from Teodor on the awesome bar tests, we used to wait 4s to populate history, now we use an observer - bug 1113158
  • Have 5 new tests in progress, 2 need a library for about:newtab, 2 are for openH264 plugin and one for all the tools in developer tools
  • New tests last sprint:
    • Bug 1098351 - Add new automated test for "Override mixed script content blocking" - https://moztrap.mozilla.org/manage/case/8881/
    • Bug 1110677 - Add automated test for "Change newtab page appearance" - https://moztrap.mozilla.org/manage/case/14576/
  • Closed 16 bugs last sprint
  • We see a lot this crash these days, with our testruns, trying to provide a full-heap dmp file to help debugging:
    • Bug 1120331 - crash in mozilla::ipc::MessageChannel::Send(IPC::Message*)

Kittens

A cat pursuing its Q1 goals: