Socorro:Rapid Betas:Requirements

General changes

Topcrashers

Required reports are as follows, for a given product X:

• Channel topcrashers: All crashes for channel Y over time period N (N=as it is for topcrashers now).
• Build topcrashers: All crashes for channel Y, buildid Z over time period N (N=1 day or 7 days)

The Channel topcrashers report is equivalent what we currently have for releases, aurora, and nightly. The Build topcrashers is equivalent to what we currently have for beta but with different nomenclature.

Daily crashes

Required reports are as follows, for a given product X:

• Channel daily report: All crashes for channel Y over time period N (N=as it is for daily crashes now), all ADUs ditto
• Build daily report: All crashes for channel Y, buildid Z over time period N (N=1 day or 7 days), all ADUs for the given build

The Channel daily report is equivalent what we currently have for releases, aurora, and nightly. The Build daily report is equivalent to what we currently have for betas, but with different nomenclature.

Specific changes needed - User perspective

Navigation

• How should the navigation work?

Home page

• What should be shown on the home page?

Josh: It would make sense to offer a graph by Build Date per Daily Graph below. Except that crashes by build date don't make much sense for a release or ESR version.

Topcrashers report

• The default view should be the Channel Topcrashers. This will show all crashes aggregated for the selected release channel for the last N days.
• There should be navigation that allows selection of a particular buildid from the currently selected channel. This will take you to the Build topcrashers, for the default time period (7 days).
• The Build topcrashers should show the aggregation of crashes for a particular buildid. This will be identified as Product X, Channel Y, Buildid Z

Daily Graphs report

• The default view should be the Channel aggregation. This will show the aggregation of all crashes in that channel, with aggregate ADUs for all builds in that channel, for the last N days.
• There should be navigation that allows selection of a particular buildid from the currently selected channel. This will take you to the Build Daily report, for the default period of time (7 days).

Questions

• Is the version number still relevant? Where should this be displayed?

Josh's Understanding

What follows is my understanding of the new interface based on conversations with Kairo and knowledge of the data.

Betas

How we track beta releases will change substantially in Socorro, as follows:

• Betas will be released several times a week, in some cases daily.
• Each beta will have its own beta number in FTP and product_version_builds.
• Beta numbers will no longer be displayed as part of the version
  • instead, all betas will be in the form "18.0b1"
  • this is the same as nightly/aurora, which are always "a1" and "a2".
• Thus all betas for a specific release will be treated as the same "version".

Topcrashers

Topcrashers will switch between two different views, by crash date and by build date.

Topcrashers By Crash Date

This is our existing view of TopCrashers, which will be unchanged except for aggregating all Betas.

• User selects:
  • Product P
  • Version V (see Betas, above)
  • Time Window W, expressed as weeks back in time from now, defaulting to 1 week
• Report displays:
  • aggregated crash counts for P.V,
  • for crashes received during window W.

Topcrashers by Build Date

This will be a new "view" of the Topcrashers page. It will be largely useless for release versions, so we may not want to offer it for those. Its layout and functionality will be almost identical to the other Topcrashers view, but its data source will be a different matview.

• User selects:
  • Product P
  • Version V (see Betas, above)
  • Time Window W, expressed as weeks back in time from now, defaulting to 1 week
• Report displays:
  • aggregated crash counts for P.V,
  • for builds with build dates during W
  • for crashes received within 7 days of the Build Date

Daily Graph

Like TCBS, the daily graph would have a switch which allows it to switch between two views, by crash date and by build date. The UI would be the same but the data source would be different.

Daily Graph by Crash Date

This is the existing home page graph, which displays:

• User selects:
  • Product P
  • Version V (see Betas, above)
  • Time Window W, expressed as weeks back in time from now, defaulting to 1 week
  • Other criteria ZZ, which are not important for these changes
• X-axis: date crash received
• Y-axis: crashes * 100 / ADU

Home Page Graph by Build Date

• User selects:
  • Product P
  • Version V (see Betas, above)
  • Time Window W, expressed as weeks back in time from now, defaulting to 1 week
  • Other criteria ZZ, which are not important for these changes
• X-axis: date of build
• Y-axis: crashes * 100 / ADU
  • for crashes within 7 days of build date