QA/Automation/Projects/Mozmill Dashboard: Difference between revisions

From MozillaWiki
< QA‎ | Automation‎ | Projects
Jump to navigation Jump to search
No edit summary
 
(22 intermediate revisions by the same user not shown)
Line 1: Line 1:
=Overview=
__NOTOC__
{|
==Overview==
| style="width: 33%" |
| style="width: 66%" |
|- valign="top"
| '''Leads:'''
| [mailto:hskupin@mozilla.com Henrik Skupin], [mailto:ahughes@mozilla.com Anthony Hughes]
|- valign="top"
| '''Co-workers:'''
| n/a
|- valign="top"
| '''Spec:'''
| [https://docs.google.com/document/edit?id=1YIxRwkqa62moVfrAcE3O9QDbU9W6eaow8T7kJOEWyw4# Google Docs]
|- valign="top"
| '''Repository:'''
| [http://github.com/whimboo/mozmill-dashboard http://github.com/whimboo/mozmill-dashboard]
|- valign="top"
| '''Bugs:'''
| [https://bugzilla.mozilla.org/buglist.cgi?quicksearch=component%3A%22Mozmill+Result+Dashboard%22 All Open Bugs]
|}
 
=Excerpt=
The dashboard for Mozmill test-runs is used to display test results for each available test-run, which can currently be executed by our automation or by the upcoming Mozmill Crowd extension. Different views will make it easier to spot new regressions, check the trend of existing failures, or to reference test results of our release testing work.
The dashboard for Mozmill test-runs is used to display test results for each available test-run, which can currently be executed by our automation or by the upcoming Mozmill Crowd extension. Different views will make it easier to spot new regressions, check the trend of existing failures, or to reference test results of our release testing work.


=Project Details=
{| style="width: 100%; margin-bottom: 2em"
==Data Source==
|-
The data used for queries and visualizations is provided by the the [[QA/Mozmill_Test_Automation/Results_Data|Results Data]] project. Depending on the test-run different information will be send. The [https://spreadsheets.google.com/ccc?key=trPutwwkRQzWCrBtKMxNpUg&hl=en#gid=0 spreadsheet] lists the current list of values for each test-run.
| style="width: 25%" |
 
| style="width: 75%" |
The following test-runs are supported:
|- valign="top"
* General (including non-restart and restart tests of the automated BFT tests)
| '''Name:'''
* Software Update (tests for the application update client)
| Mozmill Test Results Dashboard
* Add-ons (tests provided by add-on authors)
|- valign="top"
* L10n (tests for localizers, i.e. cut-off elements)
| '''Leads:'''
* Accessibility tests (tests for accessibility)
| [mailto:hskupin@mozilla.com Henrik Skupin], [mailto:dhunt@mozilla.com Dave Hunt]
|- valign="top"
| '''Team Assistance:'''
| n/a
|- valign="top"
| '''Repository:'''
| https://github.com/mozilla/mozmill-dashboard
|}


To correctly identify the results of different test-runs in the database, the [[QA/Mozmill_Test_Automation/Automated_Testruns|automation scripts] have to be used. We do not support test results sent by Mozmill itself.
==Dashboard Platform==
* [[QA/Mozmill_Test_Automation/Dashboard/Documentation|Documentation]]
* [http://etherpad.mozilla.com:9000/qa-auto-mozmill-dashboard Etherpad] for brainstorming and discussions
* [[QA/Mozmill_Test_Automation/Dashboard/FAQ|FAQ]]
* [[QA/Mozmill_Test_Automation/Dashboard/Presentations|Presentations]]


==Mockups==
==Dashboard Production==
The following image shows a design mockup in an early state. There will be a discussion for requirements in the Q3/10 and we also plan to have version 0.1 ready by September.
* [[QA/Mozmill_Test_Automation/Dashboard/Roadmap|Product Roadmap]]
* [[QA/Mozmill_Test_Automation/Dashboard/Release|Release Process]]
* [[QA/Mozmill_Test_Automation/Dashboard/Contribution|How to Contribute]]


[[File:QA_Automation_Dashboard.png|650px|left|Design Mockup for Web Dashboard]]
==Resources==
* [http://couchdb.apache.org/ CouchDB]
* [http://guide.couchdb.org/ CouchDB the definitive guide]
* [http://code.quirkey.com/sammy/index.html Sammy JS framework]

Latest revision as of 10:40, 13 January 2014

Overview

The dashboard for Mozmill test-runs is used to display test results for each available test-run, which can currently be executed by our automation or by the upcoming Mozmill Crowd extension. Different views will make it easier to spot new regressions, check the trend of existing failures, or to reference test results of our release testing work.

Name: Mozmill Test Results Dashboard
Leads: Henrik Skupin, Dave Hunt
Team Assistance: n/a
Repository: https://github.com/mozilla/mozmill-dashboard

Dashboard Platform

Dashboard Production

Resources

Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Automation/Projects/Mozmill_Dashboard&oldid=887765"