QA/Testdays/Feedback/Q1-2015

Questionnaire

1. Please survey the people who attended your event and share any feedback you receive.

2. Please tell me about the people at your event (number of people, number of newcomers, level of energy, whether they showed interest in contributing to Mozilla after the event was over, etc).

3. Considering the traditional testday model (all-day Friday on IRC), explain to me how your event was different. For example, did you use video streaming, did you have a local event space, was the event conducted in a non-English language, was the event over a shorter period of time. Additionally, please explain the impact of doing things differently than if you'd just stuck to the old model.

4. What can we learn from your event that can be applied to other events in the future?

5. What challenges did you face? Did something not go as well as you'd hoped? Was there anything we could do to improve next time? Please explain.

6. What did you enjoy most about the event?

7. Would you be willing to organize a similar event at some point in the near future?

Juan Becerra (Mozilla Hispano Event)

Attendance

• the event had good attendance with just over 20 people active in the IRC channel

Live streaming (Air Mozilla, Vidyo)

• made the event more engaging for participants
• made it easier for moderators to explain complexities
• possibly start out events with a live demo followed by questions before getting into the content

Duration (2 hours)

• gave plenty of time to explain a couple of very specific things and to field questions
• seems like it would be much easier to commit to than a day long event

Gabriela Montagu (Mozilla Hispano Event)

See etherpad

David Weir (Mozilla UK Event)

Attendance

• based on logs, 29 people were in the channel during the event

Difficulties

• some people attending did not have the environment required for testing (Win 64) and tried using Wine to little success
• time zone was a challenge for some people

Feedback

• virtual testdays are good for mentoring people who are remote

Hossain Al Ikram (Mozilla Bangladesh Event)

1. I have already surveyed people and the result can be found at : https://drive.google.com/file/d/0B5lhtIMj3Gh0V0stckV4dU1jNW8/view . You need to zoom more to see the output. Let me know, if you can see this otherwise, I will try to give you a better view of the survey!

If you want I can take another survey with the data you want to see!

Attendance

• 60 newcomers, 5 mentors, and 10 volunteers

Feedback

• Having some time to discuss Mozilla's philosophy and the reason we do this type of thing was important
• 30% of the people who attended are active today under Ikram's mentorship
• Follow-up with frequent future events that these attendees are invited back to
• Follow-up with activities outside QA that they might contribute to (FxOS app development, Mozilla Location Service, Support, MDN, etc)
• Offline model worked well for more personal mentorship and monitoring
• Having localized lessons helped a lot with the learning process as many were uncomfortable with English
• Engage with Reps to host local and localized events, provide them the support needed

Lessons Learned

• People came from various backgrounds - not everyone has the same level of knowledge - some people can complete a task in 30 seconds, others take 10 minutes - it's important not to leave people behind.
• When people are succeeding they're having fun; when people are having fun they don't want to stop contributing
• Many people did not find l10n fun for them but did enjoy QA
• Things that are easy to test (addons, hello, etc) are the most fun
• Things that are more difficult (eg. bug triage) aren't fun until learned