• QRC = Quantum Release Criteria
• QF = Quantum Flow

Bug Workflow

A QRC bug is a bug that indicates Firefox is below some performance target on a QRC benchmark or metric.

QRC bug states:

1. "[QRC][QRC_NeedAnalysis]" and unassigned (ready for profile analysis)
2. "[QRC][QRC_NeedAnalysis]" and assigned to an engineer analyzing the profile
3. "[QRC][QRC_Analyzed][qf:p1]" and unassigned (ready to be fixed by a QF engineer)
4. "[QRC][QRC_Analyzed][qf:p1]" and assigned to a QF engineer fixing the bug

1. Testers will:
   1. File a new bug for any QRC test failures that don't already have a bug.
   2. Make the new bug block one of the QRC meta bugs.
   3. Attach a link to a Gecko Profiler profile.
   4. Add the whiteboard tag "[QRC][QRC_NeedAnalysis]".
2. Profile analysis engineers on the "Profiler Overflow" list:
   1. Select a bug from the "Bugs Ready To Be Analyzed" list below.
   2. Assign the bug to yourself while you are analyzing it.
   3. If the bug is invalid or not actionable, then needinfo the reporter or close the bug.
      • There might not be obvious, visible problems. The profile analysis does not necessarily require the profile analysis engineer to reproduce the test case, just identify if there are obvious hot spots in the profile.
   4. If you can't identify the root cause, then unassign yourself. Another profile analysis engineer will pick it from the QRC_NeedAnalysis list, so leave any notes you have or needinfo someone who may have domain knowledge relevant to the profile.
   5. If you have identified the root cause, then:
      1. Change the whiteboard tag from "[QRC_NeedAnalysis]" to "[QRC_Analyzed][qf:p1]" (so the bug will be seen by QF engineers).
      2. Move the bug to an appropriate Bugzilla component.
      3. Unassign yourself.

Resources on "How to do Gecko Profiling"

If you have questions about using the Gecko Profiler, operators are ready standing by to help in the #flow IRC channel. :)

Ehsan's videos on how to analyze Gecko profiles

• Introduction to Gecko profiler
• Introduction to Gecko and Native profiler

Mike's deep dive videos analyzing profiles on real bugs

• Search for "Joy of Profiling" on Air Mozilla. Effective Dec 4, 2017 - 15 episodes
• The Joy of Profiling - Pilot
• The Joy of Profiling - Pilot 2

• The Joy of Profiling - Episode 1 Posted on May 19/2017

• The Joy of Profiling - Episode 2 Posted on June 10/2017
• The Joy of Profiling - Episode 3 Posted on June 17/2017
• The Joy of Profiling - Episode 4 Posted on June 24/2017
• The Joy of Profiling - Episode 5 Posted on July 8/2017
• The Joy of Profiling - Episode 6 Posted on July 15/2017

Bugs Ready To Be Analyzed

QRC_NeedAnalysis bugs:

2 Total; 2 Open (100%); 0 Resolved (0%); 0 Verified (0%);

Bugs Now Being Analyzed

QRC_NeedAnalysis bugs:

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);

Bugs Ready To Be Fixed

QRC_Analyzed bugs that are ready to be fixed by a QF engineer:

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);

Links

Responsibilities of the Quantum Profiling Pool

QRC queries:

• All QRC_NeedAnalysis bugs
• All QRC_Analyzed bugs
• All QRC bugs
• QRC meta bugs
• QF bugs that have profiles but are unassigned