75
edits
New test environments: Difference between revisions
Jump to navigation
Jump to search
→Green up tests: wip to expand greening up section
(Added greening section) |
(→Green up tests: wip to expand greening up section) |
||
| Line 255: | Line 255: | ||
** xpcshell | ** xpcshell | ||
** mochitest | ** mochitest | ||
** compiled | ** compiled tests | ||
** reftest/crashtest | ** reftest/crashtest | ||
** | ** web-platform-tests | ||
and so on. | and so on. | ||
A useful reference is the [https://bugzilla.mozilla.org/showdependencytree.cgi?id=1572242&hide_resolved=1 Debian 10 meta] bug. | |||
== Reporting failures == | |||
Use Treeherder where possible when logging failures - this allows all sorts of backend connections to be made, and also nicely includes the debug logs and such if available. | |||
There are some nuances to consider when logging failures; notably, <b>''has this bug been reported before?''</b> This is critical as everyone should strive to reduce the number of duplicate bugs in the system as much as possible. | |||
Example workflows in different situations will be given below. | |||
=== Example (with previously logged bug that match the description) === | |||
* click on the chunk with failures, and wait for Failure Summary pane to open | |||
* open an instance of the run logs in a new tab/window | |||
* in the nested list below the failure will be a list of bugs that Treeherder thinks match the error description, based on the bug title. | |||
* find the bug that best matches the error description from the current run. Quickly check the logs in both the current run and the bug to ensure it describes the same issue. | |||
* if satisfied, click on the pushpin icon. | |||
* in the new pane that pops above the Failure Summary, click on Save. | |||
=== Example (with previously logged bug that does not match description) === | |||
* follow the same steps as above, until the second to last step. | |||
* since none of the bugs suit the description, click on the bug icon beside the error description. | |||
* a new overlay will show titled Intermittent Bug Filer. | |||
* | |||
== Checklist == | == Checklist == | ||
* meta bugs created in Bugzilla? | * meta bugs created in Bugzilla? | ||
* | |||