Firefox QA Standup - February 11th, 2015

Dial-in Information

• Wednesdays, 8:30am Pacific Time
• Telephone:
• 650-903-0800 or 650-215-1282 x92 Conf# 99779 (US/INTL)
• 1-800-707-2533 (pin 369) Conf# 99779 (US)
• Vidyo Room: QA-Desktop
• Vidyo Guest URL
• Agenda and notes: etherpad
• Archives: wiki.mozilla.org
• Previous Meeting: https://wiki.mozilla.org/QA/Firefox/TeamMeetings/Firefox-QA-Staff-02-04-2015

Attendees: Tracy, ctalbert, mwobensmith, Andrei,Otilia, Teodora, kbrosnan,maja_zf, Florin, Bogdan, Flaviu, Ioana, KaiRo

Discussion Items

• TODO: Add tracking bugs to the "hot list" table (anyone)
  • [Florin] Tracking bugs for:
    • Privacy pane revamp - no tracking bugs found related to this (TODO: clint to ask about this)
    • Screensharing - found: https://bugzilla.mozilla.org/buglist.cgi?quicksearch=1126289%2C1040061%2C923225&list_id=11997842 - I believe these are ok
• Tracking bug for 38 release: https://bugzilla.mozilla.org/showdependencytree.cgi?id=1132074&hide_resolved=1
• [Florin] Additional exploratory testing started on 36 Beta for Youtube with Flash now served by default on Windows - final results to be sent out tomorrow as a few issues were encountered
• [Florin] Regression testing started for Search with 36 Beta as we've had a series of fixes going in this cycle
• [Otilia] On automation we would like to remove files and cronjob from mozqa.com for mciconf project. Does anyone still use this tool for updates testing?
• [kevin] Mobile
  • doing a beta 9
  • hello on Android

Project Updates

• E10S (Juan/Liz)
  • Draft e10s test plan at https://wiki.mozilla.org/QA/Electrolysis

• Metrics / Dashboards (KaiRo)
  • Delivered some data on crashes per component to Marc and Clint via email.

• Stability (KaiRo)
  • Still fighting issues on all pre-release channels, hoping beta will clear up
  • Updated https://wiki.mozilla.org/User:KaiRo/Filing_Crash_Bugs - will move this to QA area on MDN as time allows

• Shumway (mwobensmith)
  • Support for Amazon site product video player should be in Nightly and enabled
  • Next targets are currently IMDB and PBS

• You Tube Testing Status Update [marcia]
  • Possibility that we may ship Mac as well as Windows
  • Testing focus is currently on Aurora
  • Most recent manual update on Line 38: https://etherpad.mozilla.org/QA-YouTube-Status
  • MSE was removed in Beta 7, and you should now see flash as the default on 36 on all platforms
  • Serve MSE video to Firefox 37+ users on Windows Vista+ and OS X.
  • Serve Flash video to Firefox 37+ users on Windows XP and Linux.

• YouTube MSE automation [sydpolk]
  • mediasource web-platform tests in Jenkins now running on Windows.
  • Infrastructure for Mac web-platform tests waiting for infrastructure work (static IP addresses)
  • maja_zf/sydpolk investigating writing long-playing youtube tests for OOM conditions.

Notes and Actions

Heads-Up

• Upcoming PTOs:
  • Andrei - February 16th
  • Camelia - February 16th & 20th
  • KaiRo off Feb 16th, observing US holiday
  • Aaron/Kamil - Feb 16th (Family Day in Ontario)
  • Syd - Feb 13th (birthday holiday); Feb 16th US Holiday
  • US out of office Feb 16

• Events
  • [Florin] Firefox 36 Beta 7 testday last Friday February 6th - https://etherpad.mozilla.org/testday-20150206
    • [Andrei] Several participants and one new bug filed for YouTube. Part of the results are still being investigated.
  • [Florin] Firefox 37 Aurora testday next Friday February 13th - https://etherpad.mozilla.org/testday-20150213

Q1 Goals

https://wiki.mozilla.org/QA/Goals/2015q1

Community

[Ioana] Next Community Call: no vocal updates Last: https://etherpad.mozilla.org/Quality-Automation-Call-2015-02-10 - suspended due to conference system problems. Will announce the next one soon

Channel Status

Release (Fx 35)(Desktop - KaiRo Mobile - Kevin)

Mobile: https://wiki.mozilla.org/QA/Fennec/35

• Android 35.0.1 looks successful.

Beta (Fx36) (Desktop - KaiRo Mobile - Aaron)

Mobile: https://wiki.mozilla.org/QA/Fennec/36

• MSE backed out of b7, only shipped with b8 yesterday due to required YouTube changes
• D2D 1.1 backed out for b9
• Flash sandbox reverted to Protected Mode in b9.

Aurora (Fx 37) (Desktop - KaiRo Mobile - Aaron/Kevin)

Mobile: https://wiki.mozilla.org/QA/Firefox#Release_Owners General Testplan: https://wiki.mozilla.org/Releases/Firefox_37/Test_Plan

Nightly (Fx 38) (Desktop - KaiRo Mobile - Aaron/Kevin)

• This is an ESR release
• Spring awesomeness

ESR (Fx 31.5.0)

Security

Automation (whimboo)

• General
  • Got also a couple of new community members who are interested to help - mostly on the firefox-ui-tests now

• Testdaybot Status
  • DONE! Only need feedback from Florin how it worked the last testdays

• Mozmill
  • We supported win64 Firefox builds but we had to stop due to naming changes on the FTP server - we need the next version of mozdownload which we want to release at latest tomorrow.
  • Functional testruns which usually take 6-8 minutes are ~30-40 seconds faster now! (see bug 1113158)
  • Lots of fixes went in lately. So for latest beta we had only 9 failures for all builds across platforms, locales, and testruns which should be around 2000 in total

• Marionette
  • The first tests have been converted to Marionette. Barbara will mostly continue on the remaining ones. If QA people still have a bit of time we would appreciate their help

• Tests

Kittens