canmove, Confirmed users
2,041
edits
B2G/QA/WebAPI Test Plan: Difference between revisions
no edit summary
No edit summary |
|||
| (26 intermediate revisions by 5 users not shown) | |||
| Line 1: | Line 1: | ||
=OBSOLETE= | |||
Please note that this test plan is now obsolete, and is no longer underway. | |||
=Boot2Gecko WebAPI Test Plan= | =Boot2Gecko WebAPI Test Plan= | ||
| Line 8: | Line 12: | ||
|- | |- | ||
| '''Contributors''' | | '''Contributors''' | ||
| [mailto:mwargers@mozilla.com Martijn Wargers] (irc: mw22)<br/>[mailto:dclarke@mozilla.com David Clarke] (irc: onecyrenus) | | [mailto:mwargers@mozilla.com Martijn Wargers] (irc: mw22)<br /> | ||
[mailto:dclarke@mozilla.com David Clarke] (irc: onecyrenus)<br /> | |||
[mailto:jsmith@mozilla.com Jason Smith] (irc: jsmith) | |||
|- | |- | ||
| '''Status''' | | '''Status''' | ||
| Pre-release, approaching [https://docs.google.com/spreadsheet/ccc?key= | | Pre-release, approaching [https://docs.google.com/spreadsheet/ccc?key=0AiBigu584YY7dGlNSlY0QzhJb3M5anRBa1gxalV0Y3c#gid=0 Milestone 5] | ||
|- | |- | ||
| '''Tracker''' | | '''Tracker''' | ||
| Line 18: | Line 24: | ||
| '''Project Page''' | | '''Project Page''' | ||
| [[WebAPI]] | | [[WebAPI]] | ||
|- | |||
| '''References''' | |||
| [[/Instructions for Contributors|Instructions for Contributors]] | |||
|} | |} | ||
| Line 38: | Line 47: | ||
=== Interactive Exercises === | === Interactive Exercises === | ||
Some APIs have effects | Some APIs have effects that cannot be verified through unattended automation. One example would be whether a microphone is open and receiving sound. Another example would be whether the phone is actually vibrating in response to an API call. These APIs must be verified interactively. | ||
It would be tempting to use Gaia to exercise the API, but Gaia apps cannot be guaranteed to be using the APIs in a controlled fashion; that would require inappropriately locking in their implementation. So for these APIs, it is best to test using code specifically designed to exercise the APIs in a known fashion. In addition, as CI automation cannot be currently run on a final target device, it may be useful to have exercises even for APIs we address primarily through CI. | It would be tempting to use Gaia to exercise the API, but Gaia apps cannot be guaranteed to be using the APIs in a controlled fashion; that would require inappropriately locking in their implementation. So for these APIs, it is best to test using code specifically designed to exercise the APIs in a known fashion. In addition, as CI automation cannot be currently run on a final target device, it may be useful to have exercises even for APIs we address primarily through CI. | ||
| Line 45: | Line 54: | ||
Tentatively, the plan is to implement exercises as pages where possible for expediency's sake, but to eventually move them into a standalone app that developers and the testing community can experiment with. | Tentatively, the plan is to implement exercises as pages where possible for expediency's sake, but to eventually move them into a standalone app that developers and the testing community can experiment with. | ||
Also see the [[/On_Device|On Device Test Plan]]. | |||
== API Sub-Plan List == | == API Sub-Plan List == | ||
| Line 62: | Line 73: | ||
| [[/Web Activities|Web Activities]] | | [[/Web Activities|Web Activities]] | ||
| Delegate an activity to another application. | | Delegate an activity to another application. | ||
| | | Ready | ||
| Developer contacted | | Developer contacted | ||
|- | |- | ||
| Line 68: | Line 79: | ||
| Control device vibration for things like haptic feedback in games. | | Control device vibration for things like haptic feedback in games. | ||
| Ready | | Ready | ||
| | | Developer contacted [https://bugzilla.mozilla.org/show_bug.cgi?id=679966 First round done by developer] | ||
|- | |- | ||
| [[/Alarm|Alarm]] | | [[/Alarm|Alarm]] | ||
| Schedule a notification, or for an application to be started, at a specific time. | | Schedule a notification, or for an application to be started, at a specific time. | ||
| Ready | | Ready | ||
| | | Tests in Suite | ||
|- | |- | ||
| [[/Push Notifications|Push Notifications]] | | [[/Push Notifications|Push Notifications]] | ||
| Line 83: | Line 94: | ||
| Get current device position | | Get current device position | ||
| Ready | | Ready | ||
| | | Developer contacted | ||
|- | |- | ||
| [[/Device Storage|Device Storage]] | | [[/Device Storage|Device Storage]] | ||
| Add/Read/Modify files stored on a central location on the device. | | Add/Read/Modify files stored on a central location on the device. | ||
| Ready | | Ready | ||
| | | First Round Completed, Blocked on Outstanding Bug | ||
|- | |- | ||
| [[/Contacts|Contacts]] | | [[/Contacts|Contacts]] | ||
| Line 158: | Line 169: | ||
| Turn on/off screen, cpu, device power, etc. Listen and inspect resource lock events. | | Turn on/off screen, cpu, device power, etc. Listen and inspect resource lock events. | ||
| Ready (Priv) | | Ready (Priv) | ||
| | | Tests in Suite | ||
|- | |- | ||
| [[/WiFi Info|Wifi Info]] | | [[/WiFi Info|Wifi Info]] | ||
| Line 165: | Line 176: | ||
| Not Started | | Not Started | ||
|- | |- | ||
| [[/ | | [[/WebPayment|WebPayment]] | ||
| | | Allow payments for virtual goods | ||
| Ready | | Ready | ||
| | | Unit test automation present, Gaia UI Test automation currently being investigated | ||
|} | |} | ||
<small>Template for new Sub-Plans can be found [[B2G/QA/WebAPI Test Plan/Template|here]].</small> | <small>Template for new Sub-Plans can be found [[B2G/QA/WebAPI Test Plan/Template|here]].</small> | ||