Firefox/Channels/Meetings/2019-04-09

Channel Meeting Details

• Tuesdays 10am and Thursdays at 8am Pacific Time
• irc.mozilla.org #planning for backchannel

Video/Teleconference Details - NEW

• 650-903-0800 or 650-215-1282 x92 Conf# 99951 (US/INTL)
• 1-800-707-2533 (pin 369) Conf# 99951 (US)
• Vidyo Room: Release Coordination
• Vidyo Guest URL

Attendees

RyanVM, marcia, Pascal, Aryx, philipp, tania, Tom

Schedule Update

Current releases dashboard: https://mozilla.github.io/delivery-dashboard

• 67 beta 9 shipped, early beta flag unset
• 66.0.3 will gtb later today (https://docs.google.com/spreadsheets/d/15AcB8ipP-GhpwSzsWO4L8fBokYZXf_2CDyg1daRnzgk/edit#gid=1009056035 for list of bugs) aim to release Wednesday

Off-train releases

Current Shield studies: https://strategy-and-insights.mozilla.com/shield-studies/index.html

Stability

• https://bugzilla.mozilla.org/show_bug.cgi?id=1542820 was filed for the Mission Control Server Issues

Nightly

firefox nightly summary score: 6.86 , Thursday 7.55

• Core | DOM crash https://bugzilla.mozilla.org/show_bug.cgi?id=1543015 spiked in the 4-8 nightly
• Core | DOM Web storage crash https://bugzilla.mozilla.org/show_bug.cgi?id=1542706 is #3 overall, investigation continuing
• content Shut down crashes appear to have been reduced. See https://bugzilla.mozilla.org/show_bug.cgi?id=1538274 for details
• Filed https://bugzilla.mozilla.org/show_bug.cgi?id=1543110 to account for the Flash crashes in the top 15 crashes on nightly
• Current Nightly crash triage - https://wiki.mozilla.org/NightlyCrashTriage/2019Q2

Beta

firefox beta summary score: 3.66, Thursday 4.08

• Quickheal crashes still hanging around at #6 overall, https://bugzilla.mozilla.org/show_bug.cgi?id=1489041
• shutdownhang in mozilla::dom::quota::QuotaManager::Observer::Observe: https://bugzilla.mozilla.org/show_bug.cgi?id=1542485 - 8.7% of browser crashes
  • volume decreased in the past days on nightly
• IndexedDB crash: https://bugzilla.mozilla.org/show_bug.cgi?id=1528690 - 3.5% of browser crashes
• https://bugzilla.mozilla.org/show_bug.cgi?id=1535301 - 1.6% of browser crashes
  • might need a diagnostic patch for 1-2 beta cycles
• content crash in mozilla::dom::ClientSource::SetController: https://bugzilla.mozilla.org/show_bug.cgi?id=1535699 - 4% of content crashes
• https://bugzilla.mozilla.org/show_bug.cgi?id=1529556 in beta 10, should mitigate some oom|small crashes

Release

firefox release summary score: 2.03, Thursday 2.18

• Release looks good overall, no new issues in the Top 20 crashes
• #18 Top Core Graphics crash https://bugzilla.mozilla.org/show_bug.cgi?id=1535866 has a ni. Affects 67 as well
• Third Party crash https://bugzilla.mozilla.org/show_bug.cgi?id=1318858 seems to be rising a bit on release

Mobile

• Crash rate is calculated based on usage hours (the time Firefox is actively used).
• Usage hours will be significantly lower on Fennec than on desktop Firefox, so we can't compare mobile rates to desktop rates.

• Release

fennec release summary score: 17.12, Thursday 17.20

• • One new bug in the top 20, https://bugzilla.mozilla.org/show_bug.cgi?id=1542320. Correlated to Adreno 540
  • #5 top crash https://bugzilla.mozilla.org/show_bug.cgi?id=1526396 is awaiting a skip list add

• Beta

fennec beta summary score: 91.22, Thursday 122.02

• • https://bugzilla.mozilla.org/show_bug.cgi?id=1543076 could be a new bug, a signature change or an existing bug

• Nightly

fennec nightly summary score: 67.46, Thursday 70.12

• • Massive crash spike on Fennec, see https://crash-spikes.herokuapp.com/?date=2019-04-08&channel=nightly&product=FennecAndroid
  • Fixed by patch in https://bugzilla.mozilla.org/show_bug.cgi?id=1542440
  • Tests caught this, but didn't catch the magnitude of how many crashes were generated

QA

Nightly

Aurora / Dev Edition

Beta

Action items

Mobile Stability

SUMO Report / User Advocacy

Roundtable

Special Topics

• 66.0.2 post-mortem (Pascal, Liz)
  • Drivers were the keyboard events/Office 365 bug, an Audio/Video crash, and the OpenH264 issue for Fennec.
  • Bugs uplifted for 66.0.2: https://mzl.la/2uKVFGP
  • Release notes: https://www.mozilla.org/en-US/firefox/66.0.2/releasenotes/, https://www.mozilla.org/en-US/firefox/android/66.0.2/releasenotes/
  • QA's analysis of dot releases: https://docs.google.com/spreadsheets/d/1vaDGBxt0d4jOyg8ZE3k_JwwBtjOR-blIWaQJ9DmJZiA/edit#gid=2037116061

What went well:

• Successful release!
• went to 100% update rate

Challenges:

• Rushing this dot release because of office365 (didn't feel we could rely on the hotfix)
• Missed a typo in office 365 domains (will be fixed in 66.0.3, bug 1539618)
• Two blocking issues didn't land in time (now drivers for 66.0.3) 1498973 and 1537609

Aurora/Beta Feature Review

Post-Mortem (Tues 2wks from GA Release)

9:15am Pacific Time Thurs April 4 (today) https://public.etherpad-mozilla.org/p/66-0-Post-Mortem