QA/Firefox/TeamMeetings/Firefox-QA-Staff-09-17-2014

From MozillaWiki
< QA‎ | Firefox‎ | TeamMeetings
Jump to navigation Jump to search

Firefox QA Standup - September 17th, 2014

Dial-in Information

  • Wednesdays, 8:30am Pacific Time
  • Telephone:
  • 650-903-0800 or 650-215-1282 x92 Conf# 99779 (US/INTL)
  • 1-800-707-2533 (pin 369) Conf# 99779 (US)
  • Vidyo Room: QA-Desktop
  • Vidyo Guest URL
  • Agenda and notes: etherpad

https://etherpad.mozilla.org/firefox-qa-standup-2014-q3

Attendees: Kamil, Florin, Bogdan, Cornel, tracy, Otilia, juanb, KaiRo,mschifer, Cristina, Flaviu, Anthony Hughes, Aaron, mwobensmith, Alexandra, KBrosnan, Catalin Suciu

Discussion Items

  • [ctalbert] "Providing Stepping Stones" with new contributors
  • [ctalbert] Wanted: Churn metrics collaborator
    • That's a nice pathway. Can you define it and add it to the active community page below.
  • It would be good if we could find someone who can reproduce bug 933733 (no rendering without mouse movement) so we can see if this is now actually fixed on Nightly.

Project Updates

  • Loop (Anthony)
    • Beta: will be pref'd off next week likely
    • Aurora: final uplifts planned for Oct 2nd, mostly FxA related changes, ~2 weeks in Aurora feature complete
    • Nightly: UX work for "rooms" mode will be complete this week


https://wiki.mozilla.org/QA/Firefox#Community_members

  • E10S (Juan)

Crashes!

  • Metrics / Dashboard (KaiRo)
    • Note that "iteration work needed" in the graph did go down partly because for the first time, an iteration (34.3) fell off the charts without all verifications done (13 at last check).

Notes and Actions

  • Document on-boarding process for contributors on the QA Wiki
  • Define a Metrics Pathway
  • file bug for one & done to add standard footers (by team?)

Heads-Up

  • Upcoming PTOs:
    • Ioana - Sept 12-15 RemoCamp, 16-19 PTO
    • Bogdan Maris - PTO September 22nd - 26th
    • Anthony Hughes - working from SF Sept 22-26 for Tribe
  • Thurs. Sept. 18 - Liz at Ally skills training session in MV
    • PTO Sept 19th Friday and 23rd Tuesday
    • KaiRo probably taking off Friday 19th as compensation for birthday last Saturday
    • mwobensmith PTO September 25/26
    • kjowiak - PTO September 19th, 2014


Q3 Goals

https://wiki.mozilla.org/QA/Goals/2014q3

Community

  • I am going to start replying to the serious inquiries from get involved emails. I've got a 6 week back log to sift through.

one & done: 3517 users. 1999 task attempts/1379 finished.

Channel Status

Release (Fx 32) (Desktop - Juan/Kamil Mobile - Aaron/Kevin )

  • likely to be 32.0.2, 32.0.1 updates have been turned off to find fix for startup crasher (bug 1063052, also see stability section)

Beta (Fx 33) (Desktop - Tracy/Kevin Mobile - Aaron/Kevin)

  • beta4 went out yesterday
  • If OMTC crashes aren't seriously cleared out by this Friday, devs will disable it prior to beta6
    • Stability-wise, it looks like we might be good when bug 1015683 (needing attention) and bug 1043426 (needing uplift of bug 1044129) both can be fixed.

Aurora (Fx 34)(Desktop - Liz Mobile - Aaron/Kevin)

  • Stability ok, translation and loop still filing new bugs

Nightly (Fx35) (Desktop - Robert Mobile - Anthony)

  • Lots of new crashes due to the prompt to enable e10s

ESR (Fx 31.2)

Security

  • [Kamil] Bug # 945192 - DLL Hijacking
    • was backed out from m-c because of two reasons
      • #1 - intermittent test failures on all the branches which ended up being unrelated
      • #2 - telemetry indicates 2% of users are hitting the security code that was added
        • this could be anything, possible theories so far are FAT32, Network Drives
    • being added back into oak until we can find the reason behind the 2% error code spike
  • [mwobensmith] Projects underway
    • Tracking protection - compatibility on top 100 sites
    • Bug triage on old sec-low, sec-moderate bugs
    • Shumway security testing ongoing

Automation (whimboo)

  • Releases
    • Mozmill 2.0.7 and mozmill-automation 2.0.7 released to support new OS X signed builds, and get e10s disabled for now on Nightly builds
    • Mozmill 2.0.8 and mozmill-automation 2.0.8 released as bustage release due to regressions of the 'let' changes on bug 1001090 (~5h turnaround)
    • Memchaser 0.6 released to make it working again with Nightly and Aurora:
  • Mozmill
    • CI system got updates to 2.0.7 and 2.0.8, which both are live on production meanwhile
    • One of the regressions we found with Mozmill testing (bug 1046645) is part of the latest security release 32.0.1
    • By accident we got an EV cert for mozqa.com - we will use https://ssl-ev.mozqa.com for EV related tests (stops dependencies on AMO)
    • Work continues this week on Mozmill update tests so that we fully support the new OS X signed builds
    • Quick calculation of the failure rate for functional beta revealed 0.027% across all the tested locales, which is lower than the 5% target for this quarter
    • Mozmill doesn't support e10s at all. That means a lot of work the upcoming weeks. See bug 695026 for an overview
  • TPS
    • We still have issues running tests in our new CI when using a dynamically created account - weren't able to investigate bug 1043994 yet

Stability

  • While the gfx blocklist fixes in 32.0.1 worked, we found out that bug 1063052 makes Firefox unusable for a 5-digit number of users and will roll a 32.0.2 for that.
    • Probably will advocate to take bug 1046382 as a ride-along to fix even more crashes.
  • Beta rate still ~40% higher than previously due to OMTC/D3D11, bug 1015683 is the largest remaining offender in 33.0b4 that doesn't have a fix to uplift yet, needs continuous poking to get activity.
  • Bug 1064107 is still an issue on 34 and 35, needs a lot of poking for progress
  • As mentioned above, Nightly is dominated by e10s issues.
  • looking at startup crashers that block updates, compare how the data looks early in the release cycle
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Firefox/TeamMeetings/Firefox-QA-Staff-09-17-2014&oldid=1017840"