QA/Automation/Projects/Mozmill Dashboard

< QA‎ | Automation‎ | Projects
Revision as of 15:18, 1 December 2010 by Whimboo (talk | contribs)

Overview

Leads: Henrik Skupin, Anthony Hughes
Co-workers: n/a
Spec: Google Docs
Repository: http://github.com/whimboo/mozmill-dashboard
Bugs: All Open Bugs

Excerpt

The dashboard for Mozmill test-runs is used to display test results for each available test-run, which can currently be executed by our automation or by the upcoming Mozmill Crowd extension. Different views will make it easier to spot new regressions, check the trend of existing failures, or to reference test results of our release testing work.

Project Details

Data Source

The data used for queries and visualizations is provided by the the Results Data project. Depending on the test-run different information will be send. The spreadsheet lists the current list of values for each test-run.

The following test-runs are supported:

  • General (including non-restart and restart tests of the automated BFT tests)
  • Software Update (tests for the application update client)
  • Add-ons (tests provided by add-on authors)
  • L10n (tests for localizers, i.e. cut-off elements)
  • Accessibility tests (tests for accessibility)

To correctly identify the results of different test-runs in the database, the [[QA/Mozmill_Test_Automation/Automated_Testruns|automation scripts] have to be used. We do not support test results sent by Mozmill itself.

Mockups

The following image shows a design mockup in an early state. There will be a discussion for requirements in the Q3/10 and we also plan to have version 0.1 ready by September.