QA/Automation: Difference between revisions

From MozillaWiki
< QA
Jump to navigation Jump to search
(No more meetings)
 
(23 intermediate revisions by 5 users not shown)
Line 1: Line 1:
= Summary =  
= Summary =  
The test automation team is driving the automation efforts by co-working with Test-Dev to enhance the Mozmill functional testing framework, and in automating manual tests to increase the test coverage on all platforms and localized builds of Firefox.
To offer the best quality of a software product like Firefox, test automation is a crucial part to lower the amount of time until a feature can be finally shipped, or QA can ensure that no major regressions are included in the upcoming next release of Firefox. Therefore our team is working closely together with the [[QA/Desktop_Firefox|Desktop Firefox]] team in selecting next major areas of work and analyzing the requirements for requested tests.


'''Projects Page:''' [[QA/Mozmill_Test_Automation|Mozmill Test Automation]]
To fulfill all of the requests we are heavily depending on our community. Nearly everyone of us is acting as a mentor and is happy to teach interested people to strengthen their knowledge in automation. If you are interested please join us via any of the contact links as shown below.
 
= Contact =
If you have questions stop by and talk to us in the [irc://irc.mozilla.org/#automation #automation IRC channel] ([http://logs.glob.uno/?c=automation logs from channel]) or by subscribing to our [https://lists.mozilla.org/listinfo/dev-automation automation mailing list] or [http://groups.google.com/group/mozilla.dev.automation newsgroup].


= Team =
= Team =
;Mozmill Tests
{{:QA/Automation/Team}}
* Lead: Henrik Skupin
* Geo Mealer
* Al Billings
* Anthony Hughes
* Aaron Train
* Dave Hunt
* Adrian Kalla
* Marco Zehe
 
= Meetings =
 
Dial in:
 
  Every other Wednesday at 1:30pm PDT
# 650-903-0800 or 650-215-1282 x92 Conf# 315 (US/INTL)
# 1-800-707-2533 (pin 369) Conf# 315 (US)
 
[[QA/Test_Automation/Meeting_Template|Template]]
 
<small>[[QA/Test Automation/LastMeeting|Last]] | [[QA/Test Automation/NextMeeting|Next]]</small>
 
*[[QA/Test Automation/2010-12-15|2010-12-15]]
*[[QA/Test Automation/2010-12-01|2010-12-01]]
*[[QA/Test Automation/2010-11-17|2010-11-17]]
*[[QA/Test Automation/2010-10-20|2010-10-20]]
*[[QA/Test Automation/2010-10-06|2010-10-06]]
*[[QA/Test Automation/2010-09-22|2010-09-22]]
*[[QA/Test Automation/2010-09-08|2010-09-08]]
*[[QA/Test Automation/2010-08-25|2010-08-25]]
*[[QA/Test Automation/2010-08-11|2010-08-11]]
*[[QA/Test Automation/2010-07-28|2010-07-28]]
*[[QA/Test Automation/2010-07-13|2010-07-13]]
*[[QA/Test Automation/2010-06-30|2010-06-30]]
*[[QA/Test Automation/2010-06-16|2010-06-16]]
*[[QA/Test Automation/2010-06-02|2010-06-02]]
*[[QA/Test Automation/2010-05-19|2010-05-19]]
*[[QA/Test Automation/2010-05-05|2010-05-05]]
*[[QA/Test Automation/2010-04-21|2010-04-21]]
 
=Weekly Scrum Pads=
{{:QA/Automation/QaAutomationWeeklyScrumPads}}
*[http://mozqa.ietherpad.com/mozauto-101210 2010-12-06 to 2010-12-10]
*[http://mozqa.ietherpad.com/mozauto-101203 2010-11-29 to 2010-12-03]
*[http://mozqa.ietherpad.com/mozauto-101126 2010-11-22 to 2010-11-26]
*[http://etherpad.mozilla.com:9000/mozauto-101119 2010-11-15 to 2010-11-19]


= Work Weeks and Notes =
= Meetings / Events =
We had public team meetings each and every Monday. Former meeting notes can be found on the [[/Meetings|meetings page]].


* [[QA/Test_Automation/2010Q4_workweek|2010 Q4 work week]]
= Goals =
{{:QA/Automation/Goals}}


= Task Assignments =
= Projects =
With a couple of members in the team a strategy is needed for assignments of members to a given set of tasks. Machines which are necessary to execute those tasks, have to keep free during those windows.
{{:QA/Automation/Projects}}


== Release Testing ==
= Contribution =
* BFT testrun: Henrik Skupin (European Time), Geo Mealer (West Coast Time)
{{:QA/Automation/Contribution}}
* Update testrun: Anthony Hughes

Latest revision as of 13:26, 8 August 2015

Summary

To offer the best quality of a software product like Firefox, test automation is a crucial part to lower the amount of time until a feature can be finally shipped, or QA can ensure that no major regressions are included in the upcoming next release of Firefox. Therefore our team is working closely together with the Desktop Firefox team in selecting next major areas of work and analyzing the requirements for requested tests.

To fulfill all of the requests we are heavily depending on our community. Nearly everyone of us is acting as a mentor and is happy to teach interested people to strengthen their knowledge in automation. If you are interested please join us via any of the contact links as shown below.

Contact

If you have questions stop by and talk to us in the #automation IRC channel (logs from channel) or by subscribing to our automation mailing list or newsgroup.

Team

The Firefox Automation team is a group of passionate and open minded people working on automation for Firefox. We are spread around the world, but we have one collective goal to empower automation even more in the Mozilla project. If you want to get in contact with one of us please check the table below for more information.

The Core Team

Name IRC nickname Project Assignments
Henrik Skupin :whimboo Everything related to test automation for Firefox Desktop
Maja Frydrychowicz :maja_zf
Syd Polk :spolk

Contributors

Name IRC nickname Interests
Szabolcs Hubai :xabolcs likes Nightly Tester Tools and Memchaser; knows JavaScript, want to know Python
Sandeep Murthy N/A likes Python, Marionette and automation tools


Meetings / Events

We had public team meetings each and every Monday. Former meeting notes can be found on the meetings page.

Goals

Q3 2015

  • Replace custom test runner script for firefox-ui-tests with mozharness when executing tests via Jenkins (1192369)
    • Improve overall stability and result reporting to treeherder
    • Standardized execution of tests for an easy change of the execution platform (e.g. taskcluster)
  • Investigate requirements for running firefox-ui-tests via taskcluster instead of Jenkins (1192371)
    • Joined work with taskcluster team to define requirements
    • Create roadmap for taskcluster integration

Stretched Goals

  • mozdownload has to download builds from AWS via taskcluster (278)
  • Developer documentation for Firefox UI Tests

Goals Proposals

If you have ideas and want to propose those as a goal for our team for the next quarters, please go to our goals collection etherpad and enter them all together with your name.

Projects

Some of our projects can be accomplished in a short time while others will take longer, even several months. The prioritized projects reflect the most important projects in the current quarter and include the appropriate tasks which have to be fulfilled during that time. Other active projects have lower priority.

If you are interested in already finished projects, check our projects archive. We also have a some projects that we would like to do in the future!

Firefox UI Tests

Project Technologies Description
Firefox UI Tests Python, Javascript
Dashboard Javascript, HTML, CSS, AJAX, CouchDB Dashboard to visualize Mozmill test results from the automated test-runs and the Mozmill Crowd extension
Shared Modules Javascript Building and enhancing the API and shared modules for our Mozmill tests for Firefox

Other Projects

Project Technologies Description
Automation Training - Provide automation training to larger community through 4 automation training events
Add-ons CSS, Javascript, XML To help any team in the Mozilla project we work on several extensions.
Documentation Wiki Establish the team presence across websites (Wiki, MDN) and improve the documentation to increase collaboration with the test automation community
Infrastructure Puppet Building up and maintaining the infrastructure for automation tasks
Open Web Applications Javascript, Python Implemention of necessary APIs and support the addition of tests to execute automated tests for web apps in Firefox
TPS Javascript, Python Testing and Profiling tool for Sync
MTBF Javascript, Python, Bash Stability testing tool


Contribution

All Automation related Projects

Mozmill Tests

Mozmill

Tools