Auto-tools/Projects/Stockwell/Robot: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 7: Line 7:
== Comments ==
== Comments ==
=== Weekly ===
=== Weekly ===
A comment is posted to every bug with 1 or more failures in the last week.
* A comment is posted to every bug with 1 or more failures in the last week.


If there were 200 failures in the last 30 days, and the whiteboard does not contain [stockwell disabled], [stockwell disable-recommended], [stockwell fixed], or [stockwell infra] an extra comment is added:
* If there were 200 failures in the last 30 days, and the whiteboard does not contain [stockwell disabled], [stockwell disable-recommended], [stockwell fixed], or [stockwell infra] an extra comment is added:


   ** This test has failed more than 200 times in the last 30 days. It should be disabled until it can be fixed. **
   ** This test has failed more than 200 times in the last 30 days. It should be disabled until it can be fixed. **


Otherwise, if there were 75 or more failures in the last week, an extra comment is added:
* Otherwise, if there were 75 or more failures in the last week, an extra comment is added:


   ** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **
   ** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **
   ** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **
   ** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **


Otherwise, if there were 30 or more failures in the last week, an extra comment is added:
* Otherwise, if there were 30 or more failures in the last week, an extra comment is added:


   ** This failure happened more than 30 times this week! Resolving this bug is a high priority. **
   ** This failure happened more than 30 times this week! Resolving this bug is a high priority. **
Line 24: Line 24:


=== Daily ===
=== Daily ===
A comment is posted to every bug with 15 or more failures in the last day.
* A comment is posted to every bug with 15 or more failures in the last day.
 
== Whiteboard ==
== Whiteboard ==
* If the "200 failures in the last 30 days" comment was made, the whiteboard is updated to [stockwell disable-recommended].
* If the "200 failures in the last 30 days" comment was made, the whiteboard is updated to [stockwell disable-recommended].

Revision as of 16:32, 19 October 2017

Comments and other changes to intermittent-failure bugs by the "OrangeFactor Robot" are made by the code at

https://hg.mozilla.org/automation/orangefactor/file/tip/woo_commenter.py

The woo_commenter runs in two modes, "daily" and "weekly". A cron job runs the woo_commenter in weekly mode on Sunday and in daily mode every other day of the week. The woo_commenter may add a comment to a bug and/or update its whiteboard and/or priority.

Comments

Weekly

  • A comment is posted to every bug with 1 or more failures in the last week.
  • If there were 200 failures in the last 30 days, and the whiteboard does not contain [stockwell disabled], [stockwell disable-recommended], [stockwell fixed], or [stockwell infra] an extra comment is added:
 ** This test has failed more than 200 times in the last 30 days. It should be disabled until it can be fixed. **
  • Otherwise, if there were 75 or more failures in the last week, an extra comment is added:
 ** This failure happened more than 75 times this week! Resolving this bug is a very high priority. **
 ** Try to resolve this bug as soon as possible. If unresolved for 1 week, the affected test(s) may be disabled. **
  • Otherwise, if there were 30 or more failures in the last week, an extra comment is added:
 ** This failure happened more than 30 times this week! Resolving this bug is a high priority. **
 ** Try to resolve this bug as soon as possible. If unresolved for 2 weeks, the affected test(s) may be disabled. **

Daily

  • A comment is posted to every bug with 15 or more failures in the last day.

Whiteboard

  • If the "200 failures in the last 30 days" comment was made, the whiteboard is updated to [stockwell disable-recommended].
  • If the bug is in a bugzilla component that is participating in the stockwell owner-triage trial, and the whiteboard does not contain [stockwell disabled], [stockwell disable-recommended], [stockwell fixed], or [stockwell infra], the whiteboard is updated to [stockwell needswork:owner].

Weekly

  • If less than 15 failures were seen in the last week, and the whiteboard contains [stockwell needswork], the whiteboard is updated to [stockwell unknown].

Priority

  • If the whiteboard was updated to [stockwell needswork:owner] and the priority is not one of ("--", "P1", "P2", "P3"), the priority is set to "--" to indicate this bug needs triage.