QA/Automation/Projects/Test Creation: Difference between revisions
< QA | Automation | Projects
Jump to navigation
Jump to search
AndreeaMatei (talk | contribs) |
|||
| (21 intermediate revisions by 3 users not shown) | |||
| Line 12: | Line 12: | ||
|- valign="top" | |- valign="top" | ||
| '''Leads:''' | | '''Leads:''' | ||
| [mailto: | | [mailto:andreea.matei@softvisioninc.eu Andreea Matei], [mailto:mihaela.velimiroviciu@softvisioninc.eu Mihaela Velimiroviciu] | ||
|- valign="top" | |- valign="top" | ||
| '''Contributors:''' | | '''Contributors:''' | ||
| Line 18: | Line 18: | ||
|- valign="top" | |- valign="top" | ||
| '''Tracking Bug:''' | | '''Tracking Bug:''' | ||
| {{bug| | | {{bug|1035848}} | ||
|- valign="top" | |- valign="top" | ||
| '''Repository:''' | | '''Repository:''' | ||
| Line 37: | Line 37: | ||
| - | | - | ||
| 10 new automated tests | | 10 new automated tests | ||
|- valign="top" | |||
| September 30th, 2014 | |||
| - | |||
| 5 new automated tests | |||
|- valign="top" | |||
| Q4 | |||
| Using Sprints | |||
| 4 new automated tests so far | |||
|} | |} | ||
| Line 58: | Line 66: | ||
| Send email to ask for information about geolocation & tps automated tests | | Send email to ask for information about geolocation & tps automated tests | ||
| [mailto:daniel.gherasim@softvision.eu Daniel Gherasim] | | [mailto:daniel.gherasim@softvision.eu Daniel Gherasim] | ||
| | | '''Done''' | ||
|- valign="top" | |- valign="top" | ||
| Log bugs for corresponding tests (by importance: geolocation, tps, new features, other) | | Log bugs for corresponding tests (by importance: geolocation, tps, new features, other) | ||
| [mailto:mihaela.velimiroviciu@softvisioninc.eu Mihaela Velimiroviciu] | | [mailto:mihaela.velimiroviciu@softvisioninc.eu Mihaela Velimiroviciu] | ||
| In progress | | '''Done''' | ||
|- valign="top" | |||
| Q4 - Map moztrap testcases against automated tests, sorted by type or features | |||
| [mailto:mihaela.velimiroviciu@softvisioninc.eu Mihaela Velimiroviciu], [mailto:andreea.matei@softvisioninc.eu Andreea Matei],[mailto:cosmin.malutan@softvision.ro Cosmin Malutan] | |||
| '''Done''' - https://docs.google.com/spreadsheets/d/1qEaldgqa0MbFOjI4MITkvJ0yZvt7HdIe7pb9ICqBwbc/edit#gid=324233979 | |||
|- valign="top" | |||
| Q4 - Start with regression testcases, log bugs and create new tests | |||
| [mailto:mihaela.velimiroviciu@softvisioninc.eu Mihaela Velimiroviciu], [mailto:cosmin.malutan@softvision.ro Cosmin Malutan] | |||
| '''In progress''' | |||
|} | |} | ||
| Line 68: | Line 84: | ||
In the following table you can find all the tests we decide that have to be done for this goal. | In the following table you can find all the tests we decide that have to be done for this goal. | ||
* '''Q2 tests''' - tracking {{bug|1007559}} | |||
{| class="fullwidth-table sortable" | {| class="fullwidth-table sortable" | ||
|- | |- valign="top" | ||
| style="background:#EFEFEF; width:66%" | '''Test''' | | style="background:#EFEFEF; width:66%" | '''Test''' | ||
| style="background:#EFEFEF; width:14%" | '''Assigner''' | | style="background:#EFEFEF; width:14%" | '''Assigner''' | ||
| Line 76: | Line 93: | ||
| {{Bug|967568}} Create Mozmill test for Firefox's safebrowsing feature | | {{Bug|967568}} Create Mozmill test for Firefox's safebrowsing feature | ||
| [mailto:mihaela.velimiroviciu@softvisioninc.eu Mihaela Velimiroviciu] | | [mailto:mihaela.velimiroviciu@softvisioninc.eu Mihaela Velimiroviciu] | ||
| | | '''Landed''' | ||
|- valign="top" | |- valign="top" | ||
| {{Bug|1008913}} Add test to verify geolocation sharing option "Always Share Location" | | {{Bug|1008913}} Add test to verify geolocation sharing option "Always Share Location" | ||
| [mailto:daniel.gherasim@softvision.ro Daniel Gherasim] | | [mailto:daniel.gherasim@softvision.ro Daniel Gherasim] | ||
| | | '''Landed''' | ||
|- valign="top" | |- valign="top" | ||
| {{Bug|1008914}} Add test to verify geolocation sharing option "Never Share Location" | | {{Bug|1008914}} Add test to verify geolocation sharing option "Never Share Location" | ||
| | | [mailto:daniel.gherasim@softvision.ro Daniel Gherasim] | ||
| | | '''Landed''' | ||
|- valign="top" | |- valign="top" | ||
| {{Bug|1008919}} Add test to verify geolocation sharing option "Not Now" | | {{Bug|1008919}} Add test to verify geolocation sharing option "Not Now" | ||
| [mailto:daniel.gherasim@softvision.ro Daniel Gherasim] | |||
| '''Landed''' | |||
|- valign="top" | |||
| {{Bug|1008941}} Add test to verify dismissing the geolocation sharing hanger | |||
| [mailto:mihaela.velimiroviciu@softvisioninc.eu Mihaela Velimiroviciu] | |||
| Deferred to Q3 | |||
|- valign="top" | |||
| {{Bug|1008953}} Add test to verify geolocation doesn't return a location when wifi is disabled | |||
| None | | None | ||
| | | Deferred to Q3 | ||
|- valign="top" | |||
| {{Bug|1009441}} Add automated test to verify the UI and preferences of a signed in account | |||
| [mailto:mihaela.velimiroviciu@softvisioninc.eu Mihaela Velimiroviciu] | |||
| Deferred to Q3 | |||
|- valign="top" | |||
| {{Bug|1009446}} Add automated test to verify the UI and preferences of a disconnected account | |||
| [mailto:catalin.suciu@softvisioninc.eu Catalin Suciu] | |||
| Deferred to Q3 | |||
|- valign="top" | |||
| {{Bug|1009460}} Add automated test to verify the UI and preferences after forgetting the email for unverified user | |||
| [mailto:cosmin.malutan@softvision.ro Cosmin Malutan] | |||
| Deferred to Q3 | |||
|- valign="top" | |||
| {{Bug|1018927}} Add automated test to verify that sync prefs are saved after restart | |||
| [mailto:daniel.gherasim@softvision.ro Daniel Gherasim] | |||
| Deferred to Q3 | |||
|- valign="top" | |||
| {{Bug|1018931}} Add automated test to verify that sync options specified at sign in are persisted after restart | |||
| [mailto:daniel.gherasim@softvision.ro Daniel Gherasim] | |||
| Deferred to Q3 | |||
|- valign="top" | |||
| {{Bug|991877}} Add a test for PeerConnection.close() | |||
| [mailto:nils@mozilla.com Nils Ohlmeier] | |||
| '''Landed''' | |||
|} | |||
* '''Q3 tests''' - tracking {{bug|1035848}} | |||
{| class="fullwidth-table sortable" | |||
|- valign="top" | |||
| style="background:#EFEFEF; width:66%" | '''Test''' | |||
| style="background:#EFEFEF; width:14%" | '''Assigner''' | |||
| style="background:#EFEFEF; width:20%" | '''Status''' | |||
|- valign="top" | |- valign="top" | ||
| {{Bug|1008941}} Add test to verify dismissing the geolocation sharing hanger | | {{Bug|1008941}} Add test to verify dismissing the geolocation sharing hanger | ||
| | | [mailto:mihaela.velimiroviciu@softvisioninc.eu Mihaela Velimiroviciu] | ||
| | | '''Landed''' | ||
|- valign="top" | |- valign="top" | ||
| {{Bug|1008953}} Add test to verify geolocation doesn't return a location when wifi is disabled | | {{Bug|1008953}} Add test to verify geolocation doesn't return a location when wifi is disabled | ||
| Line 100: | Line 158: | ||
| {{Bug|1009441}} Add automated test to verify the UI and preferences of a signed in account | | {{Bug|1009441}} Add automated test to verify the UI and preferences of a signed in account | ||
| [mailto:mihaela.velimiroviciu@softvisioninc.eu Mihaela Velimiroviciu] | | [mailto:mihaela.velimiroviciu@softvisioninc.eu Mihaela Velimiroviciu] | ||
| | | In Progress | ||
|- valign="top" | |- valign="top" | ||
| {{Bug|1009446}} Add automated test to verify the UI and preferences of a disconnected account | | {{Bug|1009446}} Add automated test to verify the UI and preferences of a disconnected account | ||
| Line 108: | Line 166: | ||
| {{Bug|1009460}} Add automated test to verify the UI and preferences after forgetting the email for unverified user | | {{Bug|1009460}} Add automated test to verify the UI and preferences after forgetting the email for unverified user | ||
| [mailto:cosmin.malutan@softvision.ro Cosmin Malutan] | | [mailto:cosmin.malutan@softvision.ro Cosmin Malutan] | ||
| | | In progress | ||
|- valign="top" | |||
| {{Bug|1018927}} Add automated test to verify that sync prefs are saved after restart | |||
| [mailto:daniel.gherasim@softvision.ro Daniel Gherasim] | |||
| In progress | |||
|- valign="top" | |- valign="top" | ||
| {{Bug| | | {{Bug|1018931}} Add automated test to verify that sync options specified at sign in are persisted after restart | ||
| [mailto: | | [mailto:daniel.gherasim@softvision.ro Daniel Gherasim] | ||
| | | In progress | ||
|} | |} | ||
* '''Q4 tests''' - tracking in the sprint documents below | |||
** Sprint 1: https://docs.google.com/spreadsheets/d/1osGKNhEAfVXp01o4ajCFrqaM0s9TgSxjc5P1S2wGeFM/edit#gid=1524877682 | |||
** Sprint 2: https://docs.google.com/spreadsheets/d/1osGKNhEAfVXp01o4ajCFrqaM0s9TgSxjc5P1S2wGeFM/edit#gid=555086435 | |||
** Sprint 3: https://docs.google.com/spreadsheets/d/1osGKNhEAfVXp01o4ajCFrqaM0s9TgSxjc5P1S2wGeFM/edit#gid=1110510437 | |||
== Documentation == | == Documentation == | ||
Latest revision as of 15:03, 27 October 2014
Overview
Given the continuous increasing number of features and changes made from a version to another in firefox, manual testing over and over again off all this could be difficult and time consuming. Test automation can automate some repetitive but necessary tasks in a formalized testing process already in place, or add additional testing that would be difficult to perform manually.
Our goal is to increase the number of automated tests and low down the human work done when testing.
| Name: | Test Creation |
| Leads: | Andreea Matei, Mihaela Velimiroviciu |
| Contributors: | n/a |
| Tracking Bug: | bug 1035848 |
| Repository: | mozilla-central, mozmill tests |
| Etherpad: | https://etherpad.mozilla.org/tests-to-automate |
Roadmap
| Date | Version | Details |
| June 30th, 2014 | - | 10 new automated tests |
| September 30th, 2014 | - | 5 new automated tests |
| Q4 | Using Sprints | 4 new automated tests so far |
How To Contribute
If you are interested in helping us on creating new tests, please follow this tutorials and get in contact with the project leads (you can most likely find us on the #automation channel on irc).
- mozmill tests: https://developer.mozilla.org/en-US/docs/Mozilla/QA/Mozmill_tests
- browser chrome tests: https://developer.mozilla.org/en-US/docs/Browser_chrome_tests
- mochitests: https://developer.mozilla.org/en-US/docs/Mochitest
- If it's something you don't understand from this tutorials please contact us.
List of Tasks
List of tasks to be done for this goal. Will be updated every week.
| Test | Assigner | Status |
| Send email to ask for information about geolocation & tps automated tests | Daniel Gherasim | Done |
| Log bugs for corresponding tests (by importance: geolocation, tps, new features, other) | Mihaela Velimiroviciu | Done |
| Q4 - Map moztrap testcases against automated tests, sorted by type or features | Mihaela Velimiroviciu, Andreea Matei,Cosmin Malutan | Done - https://docs.google.com/spreadsheets/d/1qEaldgqa0MbFOjI4MITkvJ0yZvt7HdIe7pb9ICqBwbc/edit#gid=324233979 |
| Q4 - Start with regression testcases, log bugs and create new tests | Mihaela Velimiroviciu, Cosmin Malutan | In progress |
List of Tests
In the following table you can find all the tests we decide that have to be done for this goal.
- Q2 tests - tracking bug 1007559
| Test | Assigner | Status |
| bug 967568 Create Mozmill test for Firefox's safebrowsing feature | Mihaela Velimiroviciu | Landed |
| bug 1008913 Add test to verify geolocation sharing option "Always Share Location" | Daniel Gherasim | Landed |
| bug 1008914 Add test to verify geolocation sharing option "Never Share Location" | Daniel Gherasim | Landed |
| bug 1008919 Add test to verify geolocation sharing option "Not Now" | Daniel Gherasim | Landed |
| bug 1008941 Add test to verify dismissing the geolocation sharing hanger | Mihaela Velimiroviciu | Deferred to Q3 |
| bug 1008953 Add test to verify geolocation doesn't return a location when wifi is disabled | None | Deferred to Q3 |
| bug 1009441 Add automated test to verify the UI and preferences of a signed in account | Mihaela Velimiroviciu | Deferred to Q3 |
| bug 1009446 Add automated test to verify the UI and preferences of a disconnected account | Catalin Suciu | Deferred to Q3 |
| bug 1009460 Add automated test to verify the UI and preferences after forgetting the email for unverified user | Cosmin Malutan | Deferred to Q3 |
| bug 1018927 Add automated test to verify that sync prefs are saved after restart | Daniel Gherasim | Deferred to Q3 |
| bug 1018931 Add automated test to verify that sync options specified at sign in are persisted after restart | Daniel Gherasim | Deferred to Q3 |
| bug 991877 Add a test for PeerConnection.close() | Nils Ohlmeier | Landed |
- Q3 tests - tracking bug 1035848
| Test | Assigner | Status |
| bug 1008941 Add test to verify dismissing the geolocation sharing hanger | Mihaela Velimiroviciu | Landed |
| bug 1008953 Add test to verify geolocation doesn't return a location when wifi is disabled | None | Not started |
| bug 1009441 Add automated test to verify the UI and preferences of a signed in account | Mihaela Velimiroviciu | In Progress |
| bug 1009446 Add automated test to verify the UI and preferences of a disconnected account | Catalin Suciu | Not started |
| bug 1009460 Add automated test to verify the UI and preferences after forgetting the email for unverified user | Cosmin Malutan | In progress |
| bug 1018927 Add automated test to verify that sync prefs are saved after restart | Daniel Gherasim | In progress |
| bug 1018931 Add automated test to verify that sync options specified at sign in are persisted after restart | Daniel Gherasim | In progress |
- Q4 tests - tracking in the sprint documents below
- Sprint 1: https://docs.google.com/spreadsheets/d/1osGKNhEAfVXp01o4ajCFrqaM0s9TgSxjc5P1S2wGeFM/edit#gid=1524877682
- Sprint 2: https://docs.google.com/spreadsheets/d/1osGKNhEAfVXp01o4ajCFrqaM0s9TgSxjc5P1S2wGeFM/edit#gid=555086435
- Sprint 3: https://docs.google.com/spreadsheets/d/1osGKNhEAfVXp01o4ajCFrqaM0s9TgSxjc5P1S2wGeFM/edit#gid=1110510437
Documentation
- Introduction into Test Frameworks: https://developer.mozilla.org/en-US/docs/Mozilla/QA/Automated_testing
References
- Mochitests: https://developer.mozilla.org/en-US/docs/Mochitest
- Browser Chrome tests: https://developer.mozilla.org/en-US/docs/Browser_chrome_tests
- Mozmill tests: https://developer.mozilla.org/en-US/docs/Mozilla/Projects/Mozmill
- TPS tests: https://developer.mozilla.org/en-US/docs/TPS