QA/Firefox: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
Line 85: Line 85:
  |Senior Manager for Firefox QA
  |Senior Manager for Firefox QA
  |}
  |}
=Release test plans=
<onlyinclude>
{| class="fullwidth-table"
| style="background:#EFEFEF; width:25%" | '''Project Test Plan'''
| style="background:#EFEFEF; width:25%" | '''Description'''
| style="background:#EFEFEF; width:25%" | '''Scope'''
| style="background:#EFEFEF; width:25%" | '''Timeframe'''
|- valign="top"
|[https://wiki.mozilla.org/Releases/Firefox_33/Test_Plan Firefox 33]<br/>[https://wiki.mozilla.org/QA/Fennec/33 Firefox for Android 33]
|QA activities for Firefox 33.
| [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_33:_Desktop Features in Fx33]<br/> Features in Firefox for Android 33
| [https://wiki.mozilla.org/Releases/#Firefox_33 Firefox 33]
|- valign="top"
|[https://wiki.mozilla.org/Releases/Firefox_32/Test_Plan Firefox 32]<br/>[https://wiki.mozilla.org/QA/Fennec/32 Firefox for Android 32]
|QA activities for Firefox 32.
| [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_32:_Desktop Features in Fx32]<br/>[https://wiki.mozilla.org/Mobile/Roadmap#Firefox_32_.28Nightly.29 Features in Firefox for Android 32]
| [https://wiki.mozilla.org/Releases/#Firefox_32 Firefox 32]
|- valign="top"
|[https://wiki.mozilla.org/Releases/Firefox_31/Test_Plan Firefox 31]<br/>[https://wiki.mozilla.org/QA/Fennec/31 Firefox for Android 31]
|QA activities for Firefox 31.
| [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_31:_Desktop Features in Fx31]<br/>[https://wiki.mozilla.org/Mobile/Roadmap#Firefox_31_.28Aurora.29 Features in Firefox for Android 31]
| [https://wiki.mozilla.org/Releases/#Firefox_31 Firefox 31]
|- valign="top"
|[https://wiki.mozilla.org/Releases/Firefox_30/Test_Plan Firefox 30]<br/>[https://wiki.mozilla.org/QA/Fennec/30 Firefox for Android 30]
|QA activities for Firefox 30.
| [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_30:_Desktop Features in Fx30]<br/>[https://wiki.mozilla.org/Mobile/Roadmap#Firefox_30_.28Beta.29 Features in Firefox for Android 30]
| [https://wiki.mozilla.org/Releases/#Firefox_30 Firefox 30]
|- valign="top"
|[https://wiki.mozilla.org/Releases/Firefox_29/Test_Plan Firefox 29]
|QA activities for Firefox 29.
| [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_29:_Desktop Features in Fx29]
| [https://wiki.mozilla.org/Releases/#Firefox_29 Firefox 29]
|- valign="top"
|[https://wiki.mozilla.org/Releases/Firefox_28/Test_Plan Firefox 28]
|QA activities revolving around mozilla-central in the time frame for Firefox 28 merge.
| [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_28:_Desktop Features in Fx28]
| [https://wiki.mozilla.org/Releases/#Firefox_28 Firefox 28]
|- valign="top"
|[https://wiki.mozilla.org/Releases/Firefox_27/Test_Plan Firefox 27]
|QA activities in the time frame for Firefox 27 merge.
| [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_27:_Desktop Features in Fx27]
| [https://wiki.mozilla.org/Releases/#Firefox_27 Firefox 27]
|- valign="top"
|[https://wiki.mozilla.org/Releases/Firefox_26/Test_Plan Firefox 26]
|QA activities in the time frame for Firefox 26 merge.
| [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_26:_Desktop Features in Fx26]
| [https://wiki.mozilla.org/Releases/#Firefox_26 Firefox 26]
|- valign="top"
|[https://wiki.mozilla.org/Releases/Firefox_25/Test_Plan Firefox 25]
|QA activities in the time frame for Firefox 25 merge.
| [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_24:_Desktop Features in Fx25]
| [https://wiki.mozilla.org/Releases/#Firefox_25 Firefox 25]
|- valign="top"
| [[QA/Desktop_Firefox/Automation|Automation]]
| colspan="3" | Development of automated tests for Desktop Firefox features using Mozmill
|-
| [[QA/Ownership|Feature Ownership]]
| colspan="3" | Testing, Planning, and Bug Triage of new and stable Firefox features
|}
</onlyinclude>

Revision as of 05:49, 11 June 2014

Overview

The Firefox QA team is responsible for the Firefox browser both Desktop, (Windows, Linux, Mac) and Mobile (Android). Some of our responsibilities include qualifying builds prior to a maintenance or milestone release. Some of the responsibilities include, but are not limited to:

  • Verifying bugs using a triage strategy
  • Running basic functional tests and smoke tests - automated and manual
  • Running our automated test suites on localized builds
  • Running automated update tests across platforms, through all update paths, across localized builds
  • Making sure web content is ready for consumption

In addition to qualifying builds prior to a release, we perform ongoing tasks on the development branches to ensure no major problems get uplifted as we merge changes to the next branch. For example, on a daily basis we:

  • Confirm new unconfirmed bugs
  • Verify bugs on development branches like Aurora and Beta
  • Engage community and new volunteers in helping improve Firefox through test day events
  • Interact with developers to help them test the features they implement
  • Perform exploratory testing on new features while on the Aurora branch
  • Write test cases in Litmus for new features and user-facing features
  • Monitor crash-stats to assess stability
  • File and track new crasher bugs as they appear in crash-stats
  • Manage web compatibility testing through community involvement or crowdsourcing companies that help in testing hardware configurations and top-site testing

All of which help assess the quality of individual new features as well as the Firefox version as a whole.

Team Members and Assignments

Name Contact Availability Project Assignments
Juan Becerra jbecerra@mozilla.com 650-903-0800 x262 MoCo Employee (full time) Lead - New features testing coordination.
Anthony Hughes ahughes@mozilla.com MoCo Employee (full time) Lead - Maintenance and security releases.
Aaron Train atrain@mozilla.com MoCo Employee (full time) Lead - New features testing coordination.
Kevin Brosnan kbrosnan@mozilla.com MoCo Employee (full time) Lead - New features testing coordination.
Tracy Walker twalker@mozilla.com Moco Employee (full time) Firefox Sync QA Lead
Matt Wobensmith mwobensmith@mozilla.com Moco Employee (full time) Senior QA for Firefox, security and privacy
Liz Henry lhenry@mozilla.com Moco Employee (full time) Bug Master and crash analysis. Working on Firefox 31 test plan with Anthony.
Nils Ohlmeier nohlmeier@mozilla.com Moco Employee (full time) Platform QA, WebRTC
Henrik Skupin hskupin@mozilla.com Moco Employee (full time) Lead - Firefox Automation.
Robert Kaiser rkaiser@mozilla.com Contractor Stability.
Marc Schifer mschifer@mozilla.com Moco Employee (full time) Senior Manager for Firefox QA

Release test plans

Project Test Plan Description Scope Timeframe
Firefox 33
Firefox for Android 33
QA activities for Firefox 33. Features in Fx33
Features in Firefox for Android 33
Firefox 33
Firefox 32
Firefox for Android 32
QA activities for Firefox 32. Features in Fx32
Features in Firefox for Android 32
Firefox 32
Firefox 31
Firefox for Android 31
QA activities for Firefox 31. Features in Fx31
Features in Firefox for Android 31
Firefox 31
Firefox 30
Firefox for Android 30
QA activities for Firefox 30. Features in Fx30
Features in Firefox for Android 30
Firefox 30
Firefox 29 QA activities for Firefox 29. Features in Fx29 Firefox 29
Firefox 28 QA activities revolving around mozilla-central in the time frame for Firefox 28 merge. Features in Fx28 Firefox 28
Firefox 27 QA activities in the time frame for Firefox 27 merge. Features in Fx27 Firefox 27
Firefox 26 QA activities in the time frame for Firefox 26 merge. Features in Fx26 Firefox 26
Firefox 25 QA activities in the time frame for Firefox 25 merge. Features in Fx25 Firefox 25
Automation Development of automated tests for Desktop Firefox features using Mozmill
Feature Ownership Testing, Planning, and Bug Triage of new and stable Firefox features