MozillaWiki

QA/Automation/Projects/Test Creation: Difference between revisions

Page Discussion

QA/Automation/Projects/Test Creation (view source)

Revision as of 15:03, 27 October 2014

6,349 bytes added ,  27 October 2014
→‎List of Tasks
 
(38 intermediate revisions by 5 users not shown)
Line 1: Line 1:
=Overview=
=Overview=
Our goal is to increase the number of automated tests in our repositories.
Given the continuous increasing number of features and changes made from a version to another in firefox, manual testing over and over again off all this could be difficult and time consuming. Test automation can automate some repetitive but necessary tasks in a formalized testing process already in place, or add additional testing that would be difficult to perform manually.
 
Our goal is to increase the number of automated tests and low down the human work done when testing.


{| style="width: 90%; margin: 0 0 1em 1em" |
{| style="width: 90%; margin: 0 0 1em 1em" |
Line 10: Line 12:
  |- valign="top"
  |- valign="top"
  | '''Leads:'''
  | '''Leads:'''
  | [mailto:daniel.gherasim@softvision.ro Daniel Gherasim], [mailto:mihaela.velimiroviciu@softvisioninc.eu Mihaela Velimiroviciu]
  | [mailto:andreea.matei@softvisioninc.eu Andreea Matei], [mailto:mihaela.velimiroviciu@softvisioninc.eu Mihaela Velimiroviciu]
  |- valign="top"
  |- valign="top"
  | '''Contributors:'''
  | '''Contributors:'''
Line 16: Line 18:
  |- valign="top"
  |- valign="top"
  | '''Tracking Bug:'''  
  | '''Tracking Bug:'''  
  | {{bug|1007559}}
  | {{bug|1035848}}
  |- valign="top"
  |- valign="top"
  | '''Repository:'''  
  | '''Repository:'''  
Line 35: Line 37:
| -
| -
| 10 new automated tests
| 10 new automated tests
|- valign="top"
| September 30th, 2014
| -
| 5 new automated tests
|- valign="top"
| Q4
| Using Sprints
| 4 new automated tests so far
|}
== How To Contribute ==
If you are interested in helping us on creating new tests, please follow this tutorials and get in contact with the project leads (you can most likely find us on the #automation channel on irc).
* mozmill tests: https://developer.mozilla.org/en-US/docs/Mozilla/QA/Mozmill_tests
* browser chrome tests: https://developer.mozilla.org/en-US/docs/Browser_chrome_tests
* mochitests: https://developer.mozilla.org/en-US/docs/Mochitest
* If it's something you don't understand from this tutorials please contact us.
== List of Tasks ==
List of tasks to be done for this goal. Will be updated every week.
{| class="fullwidth-table sortable"
|-
| style="background:#EFEFEF; width:66%" | '''Test'''
| style="background:#EFEFEF; width:14%" | '''Assigner'''
| style="background:#EFEFEF; width:20%" | '''Status'''
|- valign="top"
| Send email to ask for information about geolocation & tps automated tests
| [mailto:daniel.gherasim@softvision.eu Daniel Gherasim]
| '''Done'''
|- valign="top"
| Log bugs for corresponding tests (by importance: geolocation, tps, new features, other)
| [mailto:mihaela.velimiroviciu@softvisioninc.eu Mihaela Velimiroviciu]
| '''Done'''
|- valign="top"
| Q4 - Map moztrap testcases against automated tests, sorted by type or features
| [mailto:mihaela.velimiroviciu@softvisioninc.eu Mihaela Velimiroviciu], [mailto:andreea.matei@softvisioninc.eu Andreea Matei],[mailto:cosmin.malutan@softvision.ro Cosmin Malutan]
| '''Done''' - https://docs.google.com/spreadsheets/d/1qEaldgqa0MbFOjI4MITkvJ0yZvt7HdIe7pb9ICqBwbc/edit#gid=324233979
|- valign="top"
| Q4 - Start with regression testcases, log bugs and create new tests
| [mailto:mihaela.velimiroviciu@softvisioninc.eu Mihaela Velimiroviciu], [mailto:cosmin.malutan@softvision.ro Cosmin Malutan]
| '''In progress'''
|}
|}


Line 40: Line 84:
In the following table you can find all the tests we decide that have to be done for this goal.
In the following table you can find all the tests we decide that have to be done for this goal.


* '''Q2 tests''' - tracking {{bug|1007559}}
{| class="fullwidth-table sortable"
{| class="fullwidth-table sortable"
|-
|- valign="top"
| style="background:#EFEFEF; width:66%" | '''Test'''
| style="background:#EFEFEF; width:14%" | '''Assigner'''
| style="background:#EFEFEF; width:20%" | '''Status'''
|- valign="top"
| {{Bug|967568}} Create Mozmill test for Firefox's safebrowsing feature
| [mailto:mihaela.velimiroviciu@softvisioninc.eu Mihaela Velimiroviciu]
| '''Landed'''
|- valign="top"
| {{Bug|1008913}} Add test to verify geolocation sharing option "Always Share Location"
| [mailto:daniel.gherasim@softvision.ro Daniel Gherasim]
| '''Landed'''
|- valign="top"
| {{Bug|1008914}} Add test to verify geolocation sharing option "Never Share Location"
| [mailto:daniel.gherasim@softvision.ro Daniel Gherasim]
| '''Landed'''
|- valign="top"
| {{Bug|1008919}} Add test to verify geolocation sharing option "Not Now"
| [mailto:daniel.gherasim@softvision.ro Daniel Gherasim]
| '''Landed'''
|- valign="top"
| {{Bug|1008941}} Add test to verify dismissing the geolocation sharing hanger
| [mailto:mihaela.velimiroviciu@softvisioninc.eu Mihaela Velimiroviciu]
| Deferred to Q3
|- valign="top"
| {{Bug|1008953}} Add test to verify geolocation doesn't return a location when wifi is disabled
| None
| Deferred to Q3
|- valign="top"
| {{Bug|1009441}} Add automated test to verify the UI and preferences of a signed in account
| [mailto:mihaela.velimiroviciu@softvisioninc.eu Mihaela Velimiroviciu]
| Deferred to Q3
|- valign="top"
| {{Bug|1009446}} Add automated test to verify the UI and preferences of a disconnected account
| [mailto:catalin.suciu@softvisioninc.eu Catalin Suciu]
| Deferred to Q3
|- valign="top"
| {{Bug|1009460}} Add automated test to verify the UI and preferences after forgetting the email for unverified user
| [mailto:cosmin.malutan@softvision.ro  Cosmin Malutan]
| Deferred to Q3
|- valign="top"
| {{Bug|1018927}} Add automated test to verify that sync prefs are saved after restart
| [mailto:daniel.gherasim@softvision.ro Daniel Gherasim]
| Deferred to Q3
|- valign="top"
| {{Bug|1018931}} Add automated test to verify that sync options specified at sign in are persisted after restart
| [mailto:daniel.gherasim@softvision.ro Daniel Gherasim]
| Deferred to Q3
|- valign="top"
| {{Bug|991877}} Add a test for PeerConnection.close()
| [mailto:nils@mozilla.com Nils Ohlmeier]
| '''Landed'''
|}
 
 
* '''Q3 tests''' - tracking {{bug|1035848}}
{| class="fullwidth-table sortable"
|- valign="top"
| style="background:#EFEFEF; width:66%" | '''Test'''  
| style="background:#EFEFEF; width:66%" | '''Test'''  
| style="background:#EFEFEF; width:14%" | '''Assigner'''  
| style="background:#EFEFEF; width:14%" | '''Assigner'''  
| style="background:#EFEFEF; width:20%" | '''Status'''
| style="background:#EFEFEF; width:20%" | '''Status'''
|- valign="top"
|- valign="top"
| Create Mozmill test for Firefox's safebrowsing feature ({{Bug|967568}})
| {{Bug|1008941}} Add test to verify dismissing the geolocation sharing hanger
| [mailto:mihaela.velimiroviciu@softvisioninc.eu Mihaela Velimiroviciu]
| [mailto:mihaela.velimiroviciu@softvisioninc.eu Mihaela Velimiroviciu]
| '''Landed'''
|- valign="top"
| {{Bug|1008953}} Add test to verify geolocation doesn't return a location when wifi is disabled
| None
| Not started
|- valign="top"
| {{Bug|1009441}} Add automated test to verify the UI and preferences of a signed in account
| [mailto:mihaela.velimiroviciu@softvisioninc.eu Mihaela Velimiroviciu]
| In Progress
|- valign="top"
| {{Bug|1009446}} Add automated test to verify the UI and preferences of a disconnected account
| [mailto:catalin.suciu@softvisioninc.eu Catalin Suciu]
| Not started
|- valign="top"
| {{Bug|1009460}} Add automated test to verify the UI and preferences after forgetting the email for unverified user
| [mailto:cosmin.malutan@softvision.ro  Cosmin Malutan]
| In progress
|- valign="top"
| {{Bug|1018927}} Add automated test to verify that sync prefs are saved after restart
| [mailto:daniel.gherasim@softvision.ro Daniel Gherasim]
| In progress
|- valign="top"
| {{Bug|1018931}} Add automated test to verify that sync options specified at sign in are persisted after restart
| [mailto:daniel.gherasim@softvision.ro Daniel Gherasim]
| In progress
| In progress
|}
|}
* '''Q4 tests''' - tracking in the sprint documents below
** Sprint 1: https://docs.google.com/spreadsheets/d/1osGKNhEAfVXp01o4ajCFrqaM0s9TgSxjc5P1S2wGeFM/edit#gid=1524877682
** Sprint 2: https://docs.google.com/spreadsheets/d/1osGKNhEAfVXp01o4ajCFrqaM0s9TgSxjc5P1S2wGeFM/edit#gid=555086435
** Sprint 3: https://docs.google.com/spreadsheets/d/1osGKNhEAfVXp01o4ajCFrqaM0s9TgSxjc5P1S2wGeFM/edit#gid=1110510437


== Documentation ==
== Documentation ==
Line 58: Line 190:
* Browser Chrome tests: https://developer.mozilla.org/en-US/docs/Browser_chrome_tests
* Browser Chrome tests: https://developer.mozilla.org/en-US/docs/Browser_chrome_tests
* Mozmill tests: https://developer.mozilla.org/en-US/docs/Mozilla/Projects/Mozmill
* Mozmill tests: https://developer.mozilla.org/en-US/docs/Mozilla/Projects/Mozmill
* TPS tests: https://developer.mozilla.org/en-US/docs/TPS
AndreeaMatei
Confirmed users
571

edits

Retrieved from "https://wiki.mozilla.org/Special:MobileDiff/974803...1028310"