General View

The test-run for our general Firefox tests covers the non-restart and restart tests. A set of different views are necessary to allow Mozilla QA to easier analyze the results.

Top Failures

The view for top failures in the general test-run should allow features like:

• Shows the top failures from the last couple of days (all tests / tests failed)
• The top failures page will list the failures of all platforms in separate rows. Filters can be used to hide unwanted platforms.
• The time frame will be dynamically adjustable
• Clicking a failed test will show the failure page (see 2nd mockup below)

Screenshot top failures: TBD

• Shows details from available test results with the same failure
• The complete failure message (exception) will not be shown here. It's part of the report itself

Screenshot failure: TBD

New Failures

The view for new failures in the general test-run should allow features like:

• Shows the recently started failures sorted descending by date
• The new failures page will list the new failures of all platforms in separate rows. Filters can be used to hide unwanted platforms.
• Clicking an entry will show the same failure page as for the top failures view

Screenshot new failures: TBD

Report List

The view for uploaded reports of the general test-run should allow features like:

• List of all reports initially sorted descending by date
• Table columns will be sortable
• The different results will be listed in separate columns (pass, fail, skip)
• Clicking the date will open the details view of the report

Screenshot report list: TBD

• Overview and details for a testrun
• User can filter the results for all, passed, failed, and skipped tests (default: all)
• Columns of the results table are sortable (asc and desc)
• Create links to the source file (if possible to the line of the failure)

Screenshot report details: TBD