QA/Firefox: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
 
(35 intermediate revisions by 7 users not shown)
Line 1: Line 1:
{{TOC right}}
= Overview =
= Overview =
The Firefox QA team is responsible for the Firefox browser both Desktop, (Windows, Linux, Mac) and Mobile (Android). Some of our responsibilities include qualifying builds prior to a maintenance or milestone release. Some of the responsibilities include, but are not limited to:
'''This material is largely out of date'''
 
The Firefox QA team is responsible for the Firefox browser -- both Desktop, (Windows, Linux, Mac) and Mobile (Android). Our responsibilities include qualifying builds prior to a maintenance or milestone release. Other responsibilities include, but are not limited to:


* Verifying bugs using a [[QA/Desktop_Firefox/Triaged_Bug_List|triage strategy]]
* Verifying bugs using a [[QA/Desktop_Firefox/Triaged_Bug_List|triage strategy]]
Line 21: Line 24:


All of which help assess the quality of individual new features as well as the Firefox version as a whole.
All of which help assess the quality of individual new features as well as the Firefox version as a whole.
== Community ==
Everyone is welcome to join us in testing and in our weekly meetings.
If you would like to help out, pick a task from One and Done, which has a list of ways to start testing. All the tasks are up-to-date and they have clear, step by step instructions!
* [https://oneanddone.mozilla.org/en-US/?search=&team=2 One and Done tasks] for Desktop Firefox.
* [https://oneanddone.mozilla.org/en-US/?search=&team=3 One and Done tasks] for Firefox for Android
* [https://wiki.mozilla.org/QA/Firefox/Community Community roles]. This explains how to become an active or core contributor in QA.
== Team Meetings ==
== Team Meetings ==
# 650-903-0800 or 650-215-1282 x92 Conf# 99779 (US/INTL)
This team has been broken up and is embedded with the development teams. [[Firefox/Channels/Meetings|Channel Meetings]] is the best place to get an overview of what individuals are working on.  
# 1-800-707-2533 (pin 369) Conf# 99779 (US)
# Vidyo Room: QA-Desktop
# Vidyo: https://v.mozilla.com/flex.html?roomdirect.html&key=RU7dVysDFakY
# IRC:    irc://irc.mozilla.org:6697/#qa


=== Meeting Notes ===
=== Meeting Notes ===
* [https://etherpad.mozilla.org/firefox-qa-standup-2014-q3 Firefox QA Weekly Agenda]
* Archived meeting notes [[QA/Firefox/TeamMeetings|QA/Firefox/TeamMeetings]]
* [[QA/Firefox/TeamMeetings|QA/Firefox/TeamMeetings]]


== Team Members and Assignments ==
== Team Members and Assignments ==


[[File:FirefoxQA_Team_20140730.JPG|600px|thumb|left|Firefox QA Team - July 2014 Work Week<br/>Front:Matt,Juan,Gabby,Liz<br/>Back:Nils,Kamil,KaiRo,Anthony,Tracy,Kevin,Marc,Aaron<br/>Not Pictured: Henrik]]
[[File:FirefoxQA_Team_20140730.JPG|600px|thumb|left|Firefox QA Team - July 2014 Work Week<br/>Front:Matt,Juan,Gaby,Liz<br/>Back:Nils,Kamil,KaiRo,Anthony,Tracy,Kevin,Marc,Aaron<br/>Not Pictured: Henrik]]


== SoftVision QA Team ==
[[QA_SoftVision_Team|SoftVision QA Team]]


{| class="fullwidth-table"
== Community members ==
  | style="background:#EFEFEF; width:30%" | '''Name'''
Here are a few of our active community members!
  | style="background:#EFEFEF; width:30%" | '''Contact'''
{|class="wikitable fullwidth-table"
  | style="background:#EFEFEF; width:10%" | '''Availability'''
  | style="background:#EFEFEF; width:20%" | '''Name'''
| style="background:#EFEFEF; width:30%" | '''Project Assignments'''
  | style="background:#EFEFEF; width:10%" | '''Contact'''
  | style="background:#EFEFEF; width:60%" | '''Roles'''
  |-
  |-
  |Juan Becerra
  |Gabriela Montagu
  |[mailto:jbecerra@mozilla.com jbecerra@mozilla.com] 650-903-0800 x262
  |[https://mozillians.org/en-US/u/gaby2300/ gaby2300]
  |MoCo Employee (full time)
  |Contributor in QA and Mozilla Hispano; testdays
|Lead - New features testing coordination.
  |-
  |-
  |Anthony Hughes
  |Francesca Ciceri
  |[mailto:ahughes@mozilla.com ahughes@mozilla.com]
  |[https://mozillians.org/en-US/u/madamezou/ madamezou]
  |MoCo Employee (full time)
  |Firefox QE contributor, 2014 [[OPW]] intern
|Lead - Desktop releases testing <br> Lead - Loop testing <br> Lead - Games initiative testing <br> Lead - Testdays community program
|-
|Aaron Train
|[mailto:atrain@mozilla.com atrain@mozilla.com]
|MoCo Employee (full time)
|Lead - New features testing coordination.
  |-
  |-
  |Kevin Brosnan
  |Tiziana Sellitto
  |[mailto:kbrosnan@mozilla.com kbrosnan@mozilla.com]
  |[https://mozillians.org/en-US/u/tiziana/ tiziana]
  |MoCo Employee (full time)
  |Firefox QE contributor, 2013 [[OPW]] intern, triage workshops, addon developer
|Lead - New features testing coordination.
  |-
  |-
  |Tracy Walker
  |Andre Klapper
  |[mailto:twalker@mozilla.com twalker@mozilla.com]
  |[https://mozillians.org/en-US/u/andre/ andre]
  |Moco Employee (full time)
  |Bug triage, [http://wikimediafoundation.org/wiki/User:AKlapper Wikimedia bug wrangler], [http://www.bugzilla.org/ Bugzilla project]
|Firefox Sync QA Lead
  |-
  |-
  |Matt Wobensmith
  |Aleksej
  |[mailto:mwobensmith@mozilla.com mwobensmith@mozilla.com]
  |[https://mozillians.org/en-US/u/Aleksej/ Aleksej]
  |Moco Employee (full time)
  |Bug triage, verification, Bugday moderator, channel op for #bugday
|Senior QA for Firefox, security and privacy
  |-
  |-
  |Liz Henry
  |Jayakumar Sadhasivam
  |[mailto:lhenry@mozilla.com lhenry@mozilla.com]
  |[https://mozillians.org/en-US/u/iamjayakumars/ iamjayakumars]
|Moco Employee (full time)
|Bug triage, Nightly tester, Firefox OS tester, SUMO
|Bug Master and crash analysis. Lead for [https://wiki.mozilla.org/Releases/Firefox_34/Test_Plan Firefox 34 test plan].
  |-
  |-
|Nils Ohlmeier
|}
|[mailto:nohlmeier@mozilla.com nohlmeier@mozilla.com]
 
|Moco Employee (full time)
== [[QA/Firefox/Feature_Owners|Feature Owners]] ==
|Platform QA, WebRTC
Major features in Firefox are owned by a primary QA contact who is responsible for ensuring the proper testing of those features.
|-
|Henrik  Skupin
|[mailto:hskupin@mozilla.com hskupin@mozilla.com]
|Moco Employee (full time)
|Lead - [[QA/Automation|Firefox Automation]].
|-
|-
|Robert Kaiser
|[mailto:kairo@mozilla.com kairo@mozilla.com]  
|Contractor
|Stability.
|-
|Marc Schifer
|[mailto:mschifer@mozilla.com mschifer@mozilla.com]
|Moco Employee (full time)
|Senior Manager for Firefox QA
|}


== SoftVision QA Team ==
We encourage community members to try specializing in a particular Firefox feature so they gain knowledge in depth! Contact the feature owner if you would like to be a tester on their team. <br/>
[[QA_SoftVision_Team|SoftVision QA Team]]


== Feature Owners ==
Here's our current list of [[QA/Firefox/Feature_Owners|Feature Owners]].
Major features in Firefox are owned by a primary QA contact who is responsible for ensuring the proper testing of those features.<br/>
[[QA/Firefox/Feature_Owners|Features Owners]]


=Release Owners=
=Release Owners=
Line 136: Line 116:
=Release test plans=
=Release test plans=
<onlyinclude>
<onlyinclude>
{| class="fullwidth-table"
{| class="wikitable fullwidth-table"
  | style="background:#EFEFEF; width:25%" | '''Project Test Plan'''
  | style="background:#EFEFEF; width:25%" | '''Project Test Plan'''
  | style="background:#EFEFEF; width:25%" | '''Description'''
  | style="background:#EFEFEF; width:25%" | '''Description'''
  | style="background:#EFEFEF; width:25%" | '''Scope'''
  | style="background:#EFEFEF; width:25%" | '''Scope'''
  | style="background:#EFEFEF; width:25%" | '''Timeframe'''
  | style="background:#EFEFEF; width:25%" | '''Timeframe'''
|- valign="top"
|[https://wiki.mozilla.org/Releases/Firefox_37/Test_Plan Firefox 37]<br/>[https://wiki.mozilla.org/QA/Fennec/37 Firefox for Android 37]
|QA activities for Firefox 37.
| [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_37:_Desktop Features in Fx37]<br/> [https://wiki.mozilla.org/QA/Fennec/37 Features in Firefox for Android 37]
| [https://wiki.mozilla.org/Releases/#Firefox_37 Firefox 37]
|-
|[https://wiki.mozilla.org/Releases/Firefox_36/Test_Plan Firefox 36]<br/>[https://wiki.mozilla.org/QA/Fennec/36 Firefox for Android 36]
|QA activities for Firefox 36.
| [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_36:_Desktop Features in Fx36]<br/> [https://wiki.mozilla.org/QA/Fennec/36 Features in Firefox for Android 36]
| [https://wiki.mozilla.org/Releases/#Firefox_36 Firefox 36]
|-
|[https://wiki.mozilla.org/Releases/Firefox_35/Test_Plan Firefox 35]<br/>[https://wiki.mozilla.org/QA/Fennec/35 Firefox for Android 35]
|QA activities for Firefox 35.
| [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_35:_Desktop Features in Fx35]<br/> [https://wiki.mozilla.org/QA/Fennec/35 Features in Firefox for Android 35]
| [https://wiki.mozilla.org/Releases/#Firefox_35 Firefox 35]
  |- valign="top"
  |- valign="top"
  |[https://wiki.mozilla.org/Releases/Firefox_34/Test_Plan Firefox 34]<br/>[https://wiki.mozilla.org/QA/Fennec/34 Firefox for Android 34]
  |[https://wiki.mozilla.org/Releases/Firefox_34/Test_Plan Firefox 34]<br/>[https://wiki.mozilla.org/QA/Fennec/34 Firefox for Android 34]
  |QA activities for Firefox 34.
  |QA activities for Firefox 34.
  | [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_34:_Desktop Features in Fx34]<br/> [https://wiki.mozilla.org/QA/Fennec/34 Features in Firefox for Android 34]
  | [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_34:_Desktop Features in Fx34]<br/>[https://wiki.mozilla.org/Mobile/Roadmap#Firefox_34 Features in Firefox for Android 34]
  | [https://wiki.mozilla.org/Releases/#Firefox_34 Firefox 34]
  | [https://wiki.mozilla.org/Releases/#Firefox_34 Firefox 34]
|-
|[https://wiki.mozilla.org/Releases/Firefox_33/Test_Plan Firefox 33]<br/>[https://wiki.mozilla.org/QA/Fennec/33 Firefox for Android 33]
|QA activities for Firefox 33.
| [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_33:_Desktop Features in Fx33]<br/> [https://wiki.mozilla.org/QA/Fennec/33 Features in Firefox for Android 33]
| [https://wiki.mozilla.org/Releases/#Firefox_33 Firefox 33]
|- valign="top"
|[https://wiki.mozilla.org/Releases/Firefox_32/Test_Plan Firefox 32]<br/>[https://wiki.mozilla.org/QA/Fennec/32 Firefox for Android 32]
|QA activities for Firefox 32.
| [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_32:_Desktop Features in Fx32]<br/>[https://wiki.mozilla.org/Mobile/Roadmap#Firefox_32_.28Nightly.29 Features in Firefox for Android 32]
| [https://wiki.mozilla.org/Releases/#Firefox_32 Firefox 32]
|- valign="top"
|[https://wiki.mozilla.org/Releases/Firefox_31/Test_Plan Firefox 31]<br/>[https://wiki.mozilla.org/QA/Fennec/31 Firefox for Android 31]
|QA activities for Firefox 31.
| [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_31:_Desktop Features in Fx31]<br/>[https://wiki.mozilla.org/Mobile/Roadmap#Firefox_31_.28Aurora.29 Features in Firefox for Android 31]
| [https://wiki.mozilla.org/Releases/#Firefox_31 Firefox 31]
|- valign="top"
|[https://wiki.mozilla.org/Releases/Firefox_30/Test_Plan Firefox 30]<br/>[https://wiki.mozilla.org/QA/Fennec/30 Firefox for Android 30]
|QA activities for Firefox 30.
| [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_30:_Desktop Features in Fx30]<br/>[https://wiki.mozilla.org/Mobile/Roadmap#Firefox_30_.28Beta.29 Features in Firefox for Android 30]
| [https://wiki.mozilla.org/Releases/#Firefox_30 Firefox 30]
|- valign="top"
|[https://wiki.mozilla.org/Releases/Firefox_29/Test_Plan Firefox 29]
|QA activities for Firefox 29.
| [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_29:_Desktop Features in Fx29]
| [https://wiki.mozilla.org/Releases/#Firefox_29 Firefox 29]
|- valign="top"
|[https://wiki.mozilla.org/Releases/Firefox_28/Test_Plan Firefox 28]
|QA activities revolving around mozilla-central in the time frame for Firefox 28 merge.
| [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_28:_Desktop Features in Fx28]
| [https://wiki.mozilla.org/Releases/#Firefox_28 Firefox 28]
|- valign="top"
|[https://wiki.mozilla.org/Releases/Firefox_27/Test_Plan Firefox 27]
|QA activities in the time frame for Firefox 27 merge.
| [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_27:_Desktop Features in Fx27]
| [https://wiki.mozilla.org/Releases/#Firefox_27 Firefox 27]
|- valign="top"
|[https://wiki.mozilla.org/Releases/Firefox_26/Test_Plan Firefox 26]
|QA activities in the time frame for Firefox 26 merge.
| [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_26:_Desktop Features in Fx26]
| [https://wiki.mozilla.org/Releases/#Firefox_26 Firefox 26]
|- valign="top"
|[https://wiki.mozilla.org/Releases/Firefox_25/Test_Plan Firefox 25]
|QA activities in the time frame for Firefox 25 merge.
| [https://wiki.mozilla.org/Firefox/Flight_Tracking#Firefox_24:_Desktop Features in Fx25]
| [https://wiki.mozilla.org/Releases/#Firefox_25 Firefox 25]
  |- valign="top"
  |- valign="top"
  | [[QA/Desktop_Firefox/Automation|Automation]]
  | [[QA/Desktop_Firefox/Automation|Automation]]
Line 197: Line 147:
  | [[QA/Ownership|Feature Ownership]]
  | [[QA/Ownership|Feature Ownership]]
  | colspan="3" | Testing, Planning, and Bug Triage of new and stable Firefox features
  | colspan="3" | Testing, Planning, and Bug Triage of new and stable Firefox features
|
  |}
  |}
</onlyinclude>
</onlyinclude>
Older test plans are archived here: [[QA/Past Test Plans]]


== Security Triage Team ==
== Security Triage Team ==
Line 206: Line 159:
* [mailto:mwobensmith@mozilla.com Matt Wobensmith] (irc: mwobensmith)
* [mailto:mwobensmith@mozilla.com Matt Wobensmith] (irc: mwobensmith)
* [mailto:ahughes@mozilla.com Anthony Hughes] (irc: ashughes) [Lead]
* [mailto:ahughes@mozilla.com Anthony Hughes] (irc: ashughes) [Lead]
* [mailto:gmealer@mozilla.com Geo Mealer] (irc: geo)
* [mailto:jsmith@mozilla.com Jason Smith] (irc: jsmith)
* [mailto:lhenry@mozilla.com Liz Henry] (irc: lizzard)
* [mailto:lhenry@mozilla.com Liz Henry] (irc: lizzard)
==Automation==
Test automation!
The Firefox Automation team is a group of passionate and open minded people working on automation for Firefox. We are spread around the world, but we have one collective goal to empower automation even more in the Mozilla project. If you want to get in contact with one of us please check the table below for more information.
https://wiki.mozilla.org/QA/Automation
==Stability==
The Crashkill or Stability team!
https://wiki.mozilla.org/CrashKill

Latest revision as of 00:33, 18 February 2016

Overview

This material is largely out of date

The Firefox QA team is responsible for the Firefox browser -- both Desktop, (Windows, Linux, Mac) and Mobile (Android). Our responsibilities include qualifying builds prior to a maintenance or milestone release. Other responsibilities include, but are not limited to:

  • Verifying bugs using a triage strategy
  • Running basic functional tests and smoke tests - automated and manual
  • Running our automated test suites on localized builds
  • Running automated update tests across platforms, through all update paths, across localized builds
  • Making sure web content is ready for consumption

In addition to qualifying builds prior to a release, we perform ongoing tasks on the development branches to ensure no major problems get uplifted as we merge changes to the next branch. For example, on a daily basis we:

  • Confirm new unconfirmed bugs
  • Verify bugs on development branches like Aurora and Beta
  • Engage community and new volunteers in helping improve Firefox through test day events
  • Interact with developers to help them test the features they implement
  • Perform exploratory testing on new features while on the Aurora branch
  • Write test cases in Litmus for new features and user-facing features
  • Monitor crash-stats to assess stability
  • File and track new crasher bugs as they appear in crash-stats
  • Manage web compatibility testing through community involvement or crowdsourcing companies that help in testing hardware configurations and top-site testing

All of which help assess the quality of individual new features as well as the Firefox version as a whole.

Community

Everyone is welcome to join us in testing and in our weekly meetings.

If you would like to help out, pick a task from One and Done, which has a list of ways to start testing. All the tasks are up-to-date and they have clear, step by step instructions!

Team Meetings

This team has been broken up and is embedded with the development teams. Channel Meetings is the best place to get an overview of what individuals are working on.

Meeting Notes

Team Members and Assignments

Firefox QA Team - July 2014 Work Week
Front:Matt,Juan,Gaby,Liz
Back:Nils,Kamil,KaiRo,Anthony,Tracy,Kevin,Marc,Aaron
Not Pictured: Henrik

SoftVision QA Team

SoftVision QA Team

Community members

Here are a few of our active community members!

Name Contact Roles
Gabriela Montagu gaby2300 Contributor in QA and Mozilla Hispano; testdays
Francesca Ciceri madamezou Firefox QE contributor, 2014 OPW intern
Tiziana Sellitto tiziana Firefox QE contributor, 2013 OPW intern, triage workshops, addon developer
Andre Klapper andre Bug triage, Wikimedia bug wrangler, Bugzilla project
Aleksej Aleksej Bug triage, verification, Bugday moderator, channel op for #bugday
Jayakumar Sadhasivam iamjayakumars Bug triage, Nightly tester, Firefox OS tester, SUMO

Feature Owners

Major features in Firefox are owned by a primary QA contact who is responsible for ensuring the proper testing of those features.

We encourage community members to try specializing in a particular Firefox feature so they gain knowledge in depth! Contact the feature owner if you would like to be a tester on their team.

Here's our current list of Feature Owners.

Release Owners

(M) = Mobile, (D) = Desktop

Nightly (N) Fx34 Fx 35 Fx 36 Fx 37 Fx 38 Fx 39 Fx 40
Aurora (A) Fx33 Fx 34 Fx 35 Fx 36 Fx 37 Fx 38 Fx 39
Beta (B) Fx32 Fx 33 Fx 34 Fx 35 Fx 36 Fx 37 Fx 38
Owner July 22-Sept1 Sept 2-Oct 13 Oct 14-Nov 24 Nov 25 -Jan 5 Jan 6th – Feb 16 Feb 17- Mar 30 Mar 31 – May 11
Anthony Fx34(D) N Fx35(M) N Fx35(M) A Fx35(M) B Off Fx39(D) N Fx39(D) N Fx39(D) N
Aaron Fx32(M)/Fx34(M) Fx34(M) A Fx34(M) B Off Fx38(M) N Fx38(M) N Fx38(M) N
Kevin Fx33(M) A Fx33(M) B Off Fx37(M) N Fx37(M) A Fx37(M) B Fx 40(D) N Fx 40(D) A Fx 40(D) B
Juan Fx32(D) B Off – e10s prep Fx 36(D) e10s N Fx 36(D) e10s A Fx 36(D) e10s B Fx39(M) N Fx39(M) N Fx39(M) N
KaiRo Off Fx35(D) N Fx35(D) A Fx35(D) B Fx38(D) N Fx38(D) N Fx38(D) N
Liz Fx34(D) N Fx34(D) A Fx34(D) B Fx37(D) N Fx37(D) N Fx37(D) N Off
Tracy Fx33(D) A Fx33(D) B Fx36(M) N Fx36(M) A Fx36(M) B Off Fx 40(M) N Fx 40(M) A Fx 40(M) B

Release test plans

Project Test Plan Description Scope Timeframe
Firefox 37
Firefox for Android 37
QA activities for Firefox 37. Features in Fx37
Features in Firefox for Android 37
Firefox 37
Firefox 36
Firefox for Android 36
QA activities for Firefox 36. Features in Fx36
Features in Firefox for Android 36
Firefox 36
Firefox 35
Firefox for Android 35
QA activities for Firefox 35. Features in Fx35
Features in Firefox for Android 35
Firefox 35
Firefox 34
Firefox for Android 34
QA activities for Firefox 34. Features in Fx34
Features in Firefox for Android 34
Firefox 34
Automation Development of automated tests for Desktop Firefox features using Mozmill
Feature Ownership Testing, Planning, and Bug Triage of new and stable Firefox features


Older test plans are archived here: QA/Past Test Plans

Security Triage Team

The primary purpose of this team is to verify security fixes for Firefox releases. If you want to be someone who is committed to helping with security fix verification during the Beta release cycle, please add your name below. If you are interested in being part of this team but don't have the skills or bugzilla access, please contact Anthony Hughes.

Members

Automation

Test automation!

The Firefox Automation team is a group of passionate and open minded people working on automation for Firefox. We are spread around the world, but we have one collective goal to empower automation even more in the Mozilla project. If you want to get in contact with one of us please check the table below for more information.

https://wiki.mozilla.org/QA/Automation

Stability

The Crashkill or Stability team! https://wiki.mozilla.org/CrashKill