Test Matrix

Project Description

Fix the Marionette related problems preventing tests from being run on devices at the Bitbar device farm with results returned to Treeherder.

Requirements:

• Removal of all of python from the Marionette harness - Q4
• Integration of Marionette test suite with Raptor - Q4
• Gaia integration with latest version of node - Q4
• Fix for Crash detected, but error writing stackwalk - Q4
• Update to Mocha 2 - Q4
• Fixing of Tests - Q4
  • Fix or removal of tests that have been turned off
  • Fixing tests that fail on device
• Dashboard of Disabled Tests and Enabled Tests with Inconsistent Results - Q4
• Code coverage tool - Q4
• Documentation - Q4
• Device testing on TaskCluster / Treeherder with Bitbar - Q1
• MJS to work with Taipei device farm
• Sockittome fix - Q1
• MJS stability - Q1
• Sandbox environment stability - Q1

User Stories and Acceptance Criteria

Title	BUG ID	User story	Acceptance Criteria
Removal of python from the Marionette harness	Bug ID	User Story 1 TBD	Acceptance Criteria 1 TBD
	Bug ID	User Story 2 TBD	Acceptance Criteria 2 TBD
Integration of Marionette test suite with Raptor	Bug ID	Real Bug # and User Story pending sync up with Eli	Acceptance Criteria pending
Device testing on TaskCluster / Treeherder with Bitbar	Bug ID	User Story 1 TBD	Acceptance Criteria 1 TBD
	Bug ID	User Story 2 TBD	Acceptance Criteria 2 TBD

Program Status

Milestone	Date	Status
Milestone 1		ON TARGET
Milestone 2		CHALLENGED
Milestone 3		AT RISK

Status Key

Color	Status	Key
	On Target	The project or deliverable is expected to meet its due date.
	Challenged	The project or deliverable is facing an issue that might cause it to miss its due date, but a “get well” plan has been developed to get it back on track.
	At Risk or Late	The project or deliverable is blocked or facing an issue that might cause it to miss its due date, and there’s no “get well” plan to get it back on track, or it is already late.
	Done	The project or deliverable has been completed.
	On Hold	The project or deliverable has been placed on hold.

---

Program Timeline

---

MVP Scope

Querying by 2.6+ features

(please add correct bug tracking number)

No results.

0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);

---

Dependency Tracking

---

Detailed Program Plan

Action Item	Engineering Owner	QA Owner	UX Owner	Bugzilla ID	Planned Done	Actual Done

---

Program Stakeholders

Role	Name	IRC
EPM
EM
PM
TL
UX
QA

• EPM = Engineering Program Manager
• EM = Engineering Manager
• PM = Product Manager
• TL = Tech Lead
• UX = User Experience
• QA = Quality Assurance

---

---