Firefox/Channels/Meetings/2018-11-06

Channel Meeting Details

• Tuesdays 10am and Thursdays at 8am Pacific Time
• irc.mozilla.org #planning for backchannel

Video/Teleconference Details - NEW

• 650-903-0800 or 650-215-1282 x92 Conf# 99951 (US/INTL)
• 1-800-707-2533 (pin 369) Conf# 99951 (US)
• Vidyo Room: Release Coordination
• Vidyo Guest URL

Attendees

marcia, Sebastian, pascal, philipp, RyanVM, jcristau, tania, Ritu,thomas, Tom, dveditz, lizzard

Schedule Update

Current releases dashboard: https://mozilla.github.io/delivery-dashboard

• 63.0.2 GTB today, fennec only. Ship Tomorrow morning PST
  • 25% on day1, 100% rollout a day later

• 64.0b7 shipped today (desktop+deved+fennec)
  • 64.0rc less than 4 weeks away; will turn off the early beta flag later this week (maybe after b8?)

Off-train releases

Current Shield studies: https://strategy-and-insights.mozilla.com/shield-studies/index.html

Stability

• Filed https://bugzilla.mozilla.org/show_bug.cgi?id=1505080 to investigate why 64.0 is showing in Fennec when it is really a beta

Nightly

firefox nightly summary score: 9.09, Thursday 10.19

• Rate has come down since Thursday. Linux, Mac and Windows all show an increase in content shutdown crashes
  • https://missioncontrol.telemetry.mozilla.org/#/?channel=nightly
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1503201 was a pretty high volume regression, affected Win, Mac and Linux
• https://bugzilla.mozilla.org/show_bug.cgi?id=1503787 is still happening on nightly, averaging 25-30 crashes per build
• #5 top crash https://bugzilla.mozilla.org/show_bug.cgi?id=1502717 is blocked by another bug, https://bugzilla.mozilla.org/show_bug.cgi?id=1486218
• #12 top crash https://bugzilla.mozilla.org/show_bug.cgi?id=1503582 is awaiting review
• Latest Nightly crash triage: https://wiki.mozilla.org/NightlyCrashTriage/2018Q4

Beta

firefox beta summary score: 2.55, Thursday 2.82

[philipp] 64.0b6

• shutdown hangs: https://bugzilla.mozilla.org/show_bug.cgi?id=1498942 - ~12% of browser crashes
  • has a patch; should probably be uplifted to assess the impact (perhaps a candidate for another dot-release)
• https://bugzilla.mozilla.org/show_bug.cgi?id=1503725 - 0.8% of browser crashes
  • patch in b7
• WR tab crash in mozilla::layers::ScrollMetadata::ScrollMetadata: https://bugzilla.mozilla.org/show_bug.cgi?id=1405814 - 0.8% of content crashes
  • patch in b7

Release

firefox release summary score: 2.75, Thursday 3.13

• Shutdown hangs dominate the top 15 crashes - regression in 63: https://bugzilla.mozilla.org/show_bug.cgi?id=1498942
• Overall 63.0.1 looks good in terms of rate.
• Norton extensions seem to be a frequent cause for OOM crashes: https://bugzilla.mozilla.org/show_bug.cgi?id=1505094 - ~3% of content crashes

Mobile

• Crash rate is calculated based on usage hours (the time Firefox is actively used).
• Usage hours will be significantly lower on Fennec than on desktop Firefox, so we can't compare mobile rates to desktop rates.

• Release

fennec release summary score: 30.74, Thursday 32.45

• • Mission Control is showing an increase in main crashes
    • This is likely due to https://bugzilla.mozilla.org/show_bug.cgi?id=1503255
    • Did we somehow make things worse between 62 and 63?

• Beta

fennec beta summary score: 31.85, Thursday 34.44

• • Like release, https://bugzilla.mozilla.org/show_bug.cgi?id=1503255 is the top crash. Nothing else stands out in the latest data

• Nightly

fennec nightly summary score: 38.71, Thursday 44.96

• • Filed new regression https://bugzilla.mozilla.org/show_bug.cgi?id=1505061. Hard to tell what might have regressed it

QA

Nightly

Aurora / Dev Edition

Beta

Action items

Mobile Stability

SUMO Report / User Advocacy

Roundtable

• [wlach] PSA: Recommend using https://missioncontrol.telemetry.mozilla.org not https://data-missioncontrol.dev.mozaws.net/#/
• [wlach] Missioncontrol feedback
  • triaging https://github.com/mozilla/missioncontrol/milestone/3
  • better view of nightly seems like the most frequent request/problem i've been seeing recently... anything else?
  • [marcia] alerting?
    • [wlach] probably better done on top of something more fine grained like imported crash data as time series, in 2019

Special Topics

Aurora/Beta Feature Review

Post-Mortem (Tues 2wks from GA Release)

https://public.etherpad-mozilla.org/p/63-0-Post-Mortem