QA/Testdays: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
No edit summary
 
(48 intermediate revisions by one other user not shown)
Line 1: Line 1:
== Past Events ==
= Summary =
{| class="querytable"
'''Testdays are broken.''' They do not elicit the broad team participation they used to and have become little more than using volunteers to "dogfood" Firefox builds. As a result these events hold little value for organizers, developers, and testers alike. Traditionally testdays have been about introducing volunteers to contributing at Mozilla and acting as an on-board to greater participation on sub-projects within Mozilla. Instead they've become focused on trying to get a certain amount of testing done.
  | class="header" | Date
 
  | class="header" | Subject
In our view this is a failed approach, we need to refocus testdays on mentorship and establishing relationships. We should use testdays to teach new skills, to connect people, and to enable people to contribute in meaningful ways. We believe we can rescue testdays by understanding our history, defining a vision, developing a roadmap, refocusing our efforts, and getting community leaders to contribute to the vision.
  | class="header" | Contributors
 
  | class="header" | Bugs
Another reason testdays have become broken is that their "reinvigoration" has fallen on the shoulders of very few people. We have come to realize that it's not enough for people to participate in a testday. We need people to contribute to the vision and growth of this program. The community will wither and wane if it is not committed to supporting its own growth.
 
We encourage anyone who is interested in "reinvigorating" testdays to take ownership of an idea they believe in. If the idea already has an owner, reach out to them and ask how you can help.
 
The rest of this document lays out our strategy.
 
= What are Testdays? =
Testdays are global, virtual events organized by Mozillians for Mozillians, typically focused on testing a particular product or feature. They are meant to teach people the skills necessary to contribute at Mozilla, to connect people to each other so they can make an impact.
 
== Our Mission ==
To establish long-lasting, meaningful relationships between volunteers and projects within Mozilla through mentorship.
 
== Our Vision ==
For testdays to be a platform for collaborative mentorship, to provide opportunity for Mozillians to help each other contribute.
 
== Our Strategy ==
We're always looking to improve testdays, to make them ever enjoyable and valuable to participants, and to ensure they are delivering on our mission. Consult our [https://trello.com/b/darGadj9/testdays dashboard] for more information on current and future initiatives, or to contribute your own ideas.
 
== Our Goal ==
In collaboration with the community, develop a long-term strategy to redefine the program as value-driven events designed to teach new skills and connect contributors with various projects. We'll organize at least one event utilizing this strategy and gather feedback to drive more meaningful and active events through Q4 and beyond.
 
We'll have defined a solidifed strategy which includes:
* identifying barriers to organization of and participation in events
* a better understanding of the value of testdays based on feedback from the new event
* designing an straightforward process and or guide for organizing, communicating, executing an event informed by the strategy
* incorporating feedback from an event designed by our strategy
 
= People Involved =
{| class="wikitable"
  ! Name
! Role
  ! IRC Alias
  ! Location
  ! Contributions
  |-
  |-
  | colspan="4" | '''2012 Q2'''
  | Anthony Hughes
| Program Manager
| ashughes
| Vancouver, Canada
| Working on various initiatives to grow the program
  |-
  |-
  | [https://etherpad.mozilla.org/testday-20120614 June 14, 2012]
  | Florin Mezei
  | Web QA
| Core Contributor
  | 7
  | Florin
  | [https://bugzilla.mozilla.org/buglist.cgi?list_id=8494396&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=testday-20120614 0]
  | Cluj Napoca, Romania
  | Lead organizer of most testdays and bugdays
  |-
  |-
  | [https://etherpad.mozilla.org/testday-20120608 June 8, 2012]
  | Gabriela Montagu
  | Android Firefox
  | Core Contributor
  | 9
  | gaby2300
  | [https://bugzilla.mozilla.org/buglist.cgi?list_id=8494396&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=testday-20120608 2]
  |
| Organizing an event in Argentina for Q1 2015
  |-
  |-
  | [https://etherpad.mozilla.org/testday-20120601 June 1, 2012]
  | Aaron Train
  | Desktop Firefox
| Core Contributor
  | 15
  | AaronMT
  | [https://bugzilla.mozilla.org/buglist.cgi?list_id=8494396&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=testday-20120601 4]
  | Toronto, Canada
  | Assists ashughes in growing the program
  |-
  |-
  | [https://etherpad.mozilla.org/testday-20120518 May 18, 2012]
  | Hossain Al Ikram
  | Android Firefox
  | Active Contributor
  | 8
  | IKRAM
  | [https://bugzilla.mozilla.org/buglist.cgi?list_id=8494396&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=testday-20120518 15]
  |
| Organizing an event in Bangladesh for Q1 2015
  |-
  |-
  | [https://etherpad.mozilla.org/testday-20120504 May 4, 2012]
  | David Weir
  | Open Web Apps
  | Active Contributor
  | 19
  | satdav
  | [https://bugzilla.mozilla.org/buglist.cgi?list_id=8494396&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=testday-20120504 1]
  |
| Organizing an event in the UK for Q1 2015
  |-
  |-
  | [https://etherpad.mozilla.org/testday-20120413 April 13, 2012]
  | Bolaram Paul
  | UNCONFIRMED Critical Bugs Triage
  | Active Contributor
  | 14
  | Bolaram
  | [https://bugzilla.mozilla.org/buglist.cgi?list_id=8494396&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=testday-20120413 110]
  | Bangladesh
| contributing in many testdays
  |-
  |-
  | colspan="4" | '''2012 Q1'''
  | colspan="5" | ''Your name could be here too...''
|-
| [https://etherpad.mozilla.org/testday-20120330 March 30, 2012]
| Mozilla Reps Website
| 3
| [https://bugzilla.mozilla.org/buglist.cgi?list_id=8494396&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=testday-20120330 4]
|-
| [https://etherpad.mozilla.org/testday-20120329 March 29, 2012]
| Affiliates Website
| 6
| [https://bugzilla.mozilla.org/buglist.cgi?list_id=8494396&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=testday-20120329 6]
|-
| [https://etherpad.mozilla.org/testday-20120328 March 28, 2012]
| Addons Website
| 10
| [https://bugzilla.mozilla.org/buglist.cgi?list_id=8494396&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=testday-20120328 0]
|-
| [https://etherpad.mozilla.org/testday-20120323 March 23, 2012]
| Silent Update
| 12
| [https://bugzilla.mozilla.org/buglist.cgi?list_id=8494396&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=testday-20120323 2]
|-
| [https://etherpad.mozilla.org/testday-20120309 March 9, 2012]
| Persona
| 16
| [https://bugzilla.mozilla.org/buglist.cgi?list_id=8494396&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=testday-20120309 0]
|-
| [https://etherpad.mozilla.org/testday-20120302 March 2, 2012]
| Desktop Firefox
| 14
| [https://bugzilla.mozilla.org/buglist.cgi?list_id=8494396&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=testday-20120302 7]
|-
| [[QA/Testdays/2012-02-17|February 17, 2012]]
| Open Web Apps
| 19
| [https://bugzilla.mozilla.org/buglist.cgi?list_id=8494396&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=testday-20120217 1]
|-
| [[QA/Testdays/2012-02-10|February 10, 2012]]
| Android Firefox
| 14
| [https://bugzilla.mozilla.org/buglist.cgi?list_id=8494396&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=testday-20120210 7]
|-
| [[QA/Testdays/2012-02-03|February 3, 2012]]
| Desktop Firefox
| 21
| [https://bugzilla.mozilla.org/buglist.cgi?list_id=8494396&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=testday-20120203 24]
|-
| [[QA/Testdays/2012-01-27|January 27, 2012]]
| Desktop Firefox
| 14
| [https://bugzilla.mozilla.org/buglist.cgi?list_id=8494396&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=testday-20120127 2]
|-
| [[QA/Testdays/2012-01-13|January 13, 2012]]
| Add-on Compatibility
| 16
| [https://bugzilla.mozilla.org/buglist.cgi?list_id=8494396&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=testday-20120113 3]
|-
| [[QA/Testdays/2012-01-06|January 6, 2012]]
| Android Firefox
| 13
| [https://bugzilla.mozilla.org/buglist.cgi?list_id=8494396&status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=testday-20120106 14]
  |}
  |}
= How can you Help? =
* [https://quality.mozilla.org/category/events/month Participate] in an upcoming event
* [http://etherpad.mozilla.org/testday-strategy-feedback Contribute] an idea or ask a question toward improving testdays
* [[QA/Testdays/Experiments|Experiment]] or give us ideas of hypotheses we should test
* ''more to come...''
= Meetings =
The Testdays Initiative team meets once a week to ensure our strategy remains on track toward achieving our mission. This meeting is open to everyone so please join us and contribute to the discussion.
; Details
* When: Tuesday @ 13:00 Pacific
* Where: [https://v.mozilla.com/flex.html?roomdirect.html&key=WBuu8ks3P4IZ Anthony Hughes' Vidyo Room]
* Phone: +1 (800) 707-2533 p369 x99007
* Chat: irc.mozilla.org #qa
; Past Meetings
* [[QA/Testdays/Meetings/2015-03-24|March 24, 2015]]
* [[QA/Testdays/Meetings/2015-02-24|February 24, 2015]]
* [[QA/Testdays/Meetings/2014|2014]]
= Projects =
* [[QA/Testdays/Framework_2.0|Framework 2.0]] (Anthony Hughes)

Latest revision as of 08:44, 31 July 2015

Summary

Testdays are broken. They do not elicit the broad team participation they used to and have become little more than using volunteers to "dogfood" Firefox builds. As a result these events hold little value for organizers, developers, and testers alike. Traditionally testdays have been about introducing volunteers to contributing at Mozilla and acting as an on-board to greater participation on sub-projects within Mozilla. Instead they've become focused on trying to get a certain amount of testing done.

In our view this is a failed approach, we need to refocus testdays on mentorship and establishing relationships. We should use testdays to teach new skills, to connect people, and to enable people to contribute in meaningful ways. We believe we can rescue testdays by understanding our history, defining a vision, developing a roadmap, refocusing our efforts, and getting community leaders to contribute to the vision.

Another reason testdays have become broken is that their "reinvigoration" has fallen on the shoulders of very few people. We have come to realize that it's not enough for people to participate in a testday. We need people to contribute to the vision and growth of this program. The community will wither and wane if it is not committed to supporting its own growth.

We encourage anyone who is interested in "reinvigorating" testdays to take ownership of an idea they believe in. If the idea already has an owner, reach out to them and ask how you can help.

The rest of this document lays out our strategy.

What are Testdays?

Testdays are global, virtual events organized by Mozillians for Mozillians, typically focused on testing a particular product or feature. They are meant to teach people the skills necessary to contribute at Mozilla, to connect people to each other so they can make an impact.

Our Mission

To establish long-lasting, meaningful relationships between volunteers and projects within Mozilla through mentorship.

Our Vision

For testdays to be a platform for collaborative mentorship, to provide opportunity for Mozillians to help each other contribute.

Our Strategy

We're always looking to improve testdays, to make them ever enjoyable and valuable to participants, and to ensure they are delivering on our mission. Consult our dashboard for more information on current and future initiatives, or to contribute your own ideas.

Our Goal

In collaboration with the community, develop a long-term strategy to redefine the program as value-driven events designed to teach new skills and connect contributors with various projects. We'll organize at least one event utilizing this strategy and gather feedback to drive more meaningful and active events through Q4 and beyond.

We'll have defined a solidifed strategy which includes:

  • identifying barriers to organization of and participation in events
  • a better understanding of the value of testdays based on feedback from the new event
  • designing an straightforward process and or guide for organizing, communicating, executing an event informed by the strategy
  • incorporating feedback from an event designed by our strategy

People Involved

Name Role IRC Alias Location Contributions
Anthony Hughes Program Manager ashughes Vancouver, Canada Working on various initiatives to grow the program
Florin Mezei Core Contributor Florin Cluj Napoca, Romania Lead organizer of most testdays and bugdays
Gabriela Montagu Core Contributor gaby2300 Organizing an event in Argentina for Q1 2015
Aaron Train Core Contributor AaronMT Toronto, Canada Assists ashughes in growing the program
Hossain Al Ikram Active Contributor IKRAM Organizing an event in Bangladesh for Q1 2015
David Weir Active Contributor satdav Organizing an event in the UK for Q1 2015
Bolaram Paul Active Contributor Bolaram Bangladesh contributing in many testdays
Your name could be here too...

How can you Help?

  • Participate in an upcoming event
  • Contribute an idea or ask a question toward improving testdays
  • Experiment or give us ideas of hypotheses we should test
  • more to come...

Meetings

The Testdays Initiative team meets once a week to ensure our strategy remains on track toward achieving our mission. This meeting is open to everyone so please join us and contribute to the discussion.

Details
Past Meetings

Projects