QA/Firefox/TeamMeetings/Firefox-QA-Staff-03-04-2015

`= Firefox QA Standup - March 4th, 2015 =

Dial-in Information

• Wednesdays, 8:30am Pacific Time
• Telephone:
• 650-903-0800 or 650-215-1282 x92 Conf# 99779 (US/INTL)
• 1-800-707-2533 (pin 369) Conf# 99779 (US)
• Vidyo Room: QA-Desktop
• Vidyo Guest URL
• Agenda and notes: etherpad
• Archives: wiki.mozilla.org
• Previous Meeting: https://wiki.mozilla.org/QA/Firefox/TeamMeetings/Firefox-QA-Staff-02-25-2015

Attendees: Ioana, MihaiP, teoVermesan, CSuciu, Flaviu, Andrei, Tracy, Florin, Catalin Varga, Petruta, Camelia, Otilia, Mihaela

Discussion Items

• [Florin] Any news on the visit to Romania (March 16-20)? Will Doug/Lawrence join?
  • Reply - Kairo - need to ping Doug to see Lawrence's status - he is considering it but we must keep in mind he is traveling long way form Canada
  • Doug confirmed as not coming this Q1
• [Florin] General status:
  • e10s Regression testing - Plugins
  • likely to get 36.0.1
• Mobile - Ioana
  • still not sure if we will have a 36.0.1 - see Sylvester's mail
  • 37 Beta 2 - Signed Off and available on Google Play now

Project Updates

• E10S (Juan/Tracy)
  • Draft e10s test plan at https://wiki.mozilla.org/QA/Electrolysis

• Metrics / Dashboards (KaiRo)
  • Did a bit more thinking about crash score, but not much time between releases and urgent requests in the stability area (around top crashes and also MSE)

• Stability (KaiRo)
  • Crash Signatures are now linked from their field in Bugzilla!
  • See per-channel notes in channel status.

• Shumway (mwobensmith)

• You Tube Testing Status Update [marcia]

• YouTube MSE automation [sydpolk]
• initial set of marionette python tests for youtube is ready: https://github.com/mjzffr/firefox-media-tests
• maja_zf has started work on tool to populate the marionette tests with youtube urls that recently appear in crash-stats
• MSE webplatform tests are now running for all Mac platforms, and Windows 7 and 8.1 32 and 64 bit.

Notes and Actions

Heads-Up

• Upcoming PTOs:
  • marcia - PTO 3/2 - 3/6
  • Otilia - PTO March 6th, 20th
  • maja_zf - birthday PTO March 6th

• Events
  • KaiRo will visit Softvision in the week of March 16
  • [Florin] Firefox 37 Beta 3 testday next Friday March 6th - https://etherpad.mozilla.org/testday-20150306

Q1 Goals

https://wiki.mozilla.org/QA/Goals/2015q1

• • Clint will follow up with individual goal owners so that we can do this in a more streamlined fashion, especially since so much has recently changed.

Community

• any other input fro the Community call?
• we will restart the Mobile testdays - oriented more on education/mentoring

Channel Status

Release (Fx 36)(Desktop - KaiRo Mobile - Kevin)

Mobile: https://wiki.mozilla.org/QA/Fennec/36

• A 36.0.1 will be done with a significant list of fixes, see https://wiki.mozilla.org/Firefox/Channels/Meetings/2015-03-03#Schedule_Update
• We especially caused a number of issues with some variants of WinXP in 36.

Beta (Fx37) (Desktop - KaiRo Mobile - Aaron/Ioana)

Mobile: https://wiki.mozilla.org/QA/Fennec/37

• 37.0b1 was crashing a lot with an issue well-known through the DevEdition cycle (bug 1120331), finally fixed in b2
• Flash Protected Mode is disabled in 37 Beta atm, will be enabled again.

[Kairo] will ping bsmedberg to find out when it will be re-enabled since we aren't shipping with flash protected mode disabled

• Protected mode will be enabled on next beta we ship.

Aurora (Fx 38) (Desktop - KaiRo Mobile - Aaron/Kevin)

Mobile: https://wiki.mozilla.org/QA/Firefox#Release_Owners General Testplan: https://wiki.mozilla.org/Releases/Firefox_37/Test_Plan

• Crash rates right now are not good, but better than during the whole 37 Dev Edition cycle.

Nightly (Fx 39) (Desktop - KaiRo Mobile - Aaron/Kevin)

• Crash rates right now are not good, but better than during the whole 38 Nightly cycle.

ESR (Fx 31.5.0)

Security

Automation (whimboo)

• General
  • Firefox Automation report – week 51/52 2014: http://www.hskupin.info/2015/03/02/firefox-automation-report-week-51-52-2014/ (bit old but I will keep up soon)

• Mozmill
  • We may only release another version of Mozmill if really necessary due to breakage
  • The topcrash on our Windows 7 machine has been fixed for beta, so all platforms are active again for testing
  • We stopped running l10n tests in CI production due to no-one is maintaining them or checking results

• Marionette
  • Current status of test conversion for Q1: http://mzl.la/18k3dCz
  • All blockers for security tests have been fixed - Barbara and a couple of contributors working on the conversion
  • Nearly all blockers for update tests are fixed - Bob is working on test libraries and Henrik on harness + the actual tests
  • Working with RelEng to get update tests for beta and releases to be run on buildbot / taskcluster once Marionette update tests are stable enough

• Tests

Kittens

• https://gfycat.com/TornWindingKudu