QA/B2G/How To Test Firefox OS/App Page Template: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(Template for App page creation)
 
(Updated info)
 
(10 intermediate revisions by 3 users not shown)
Line 1: Line 1:
=App Title=
=App Title=
==Stability (Open to Test)==
==Stability (Open to Test)==
* Link to: Developer's status
:Link to: Developer's status
==How to test this App==
==How to test this App==
* Link to: One and Done Items
:Link to: One and Done Items
* [https://docs.google.com/a/qanalydocs.com/spreadsheets/d/1RhI81B01gzLYTeRVqFM8RC2_UiuGtFssGtX_pRycgqE/edit#gid=1193446165 Application Coverage]
:[https://docs.google.com/a/qanalydocs.com/spreadsheets/d/1RhI81B01gzLYTeRVqFM8RC2_UiuGtFssGtX_pRycgqE/edit#gid=1193446165 Application Coverage]
* Access Points
:Access Points
** list ways to access the app
::*list ways to access the app
* Data Management
:Data Management
** list data types/content app utilizes
::*list data types/content app utilizes
* Areas to test
:Areas to test
** list areas of app to test (Main view, compose, settings, edit, details view, etc)
::*list areas of app to test (Main view, compose, settings, edit, details view, etc)
* User Actions
:User Actions
** list all actions user can perform in app
::*list all actions user can perform in app
* Positive & Negative Testing
:Positive & Negative Testing
** http://www.guru99.com/positive-vs-negative-testing.html
::http://www.guru99.com/positive-vs-negative-testing.html
** Positive Examples
:Positive Examples
*** list some positive examples
::*list some positive examples
** Negative Examples
:Negative Examples
*** list some negative examples
::*list some negative examples
* Boundary Testing
:Boundary Testing
** http://en.wikipedia.org/wiki/Boundary_testing
::http://en.wikipedia.org/wiki/Boundary_testing
*** list some examples of boundary testing
::*list some examples of boundary testing
* Race Conditions
:Race Conditions
** http://en.wikipedia.org/wiki/Race_condition
::http://en.wikipedia.org/wiki/Race_condition
*** list some examples of Race Conditions to test
::*list some examples of Race Conditions to test
== FXOS Contacts==
== FXOS Contacts==
:Team Members
:Team Members
* Link to: Team Site
::*[https://wiki.mozilla.org/FirefoxOS Team Site]
**https://wiki.mozilla.org/FirefoxOS/functionalteams
:[Component] QA Owner
:Component QA Owner
::*NAME_MAILTO:
* NAME_MAILTO:
==Fixed in last 7 days==
==Fixed in last 7 days==
==Open Bugs==
==Open Bugs==
* Last 7 days  
{| class="wikitable collapsible" style="width: 100%"
:<bugzilla>
! Last 7 days  
|-
|
<bugzilla>
{
{
     "list_id":"11825956",
     "f1":"creation_ts",
    "o1":"changedafter",
    "v1":"-7d",
    "o2":"changedbefore",
    "v2":"now%2023%3A59%3A59%20",
    "f2":"creation_ts",
     "resolution":"---",
     "resolution":"---",
    "chfieldto":"Now",
    "chfield":"[Bug%20creation]",
     "query_format":"advanced",
     "query_format":"advanced",
     "chfieldfrom":"-7d",
     "bug_status":"REOPENED, ASSIGNED, NEW, UNCONFIRMED",
    "bug_status":"UNCONFIRMED",
     "component":"Gaia::[COMPONENT]",
    "bug_status":"NEW",
     "product":"Firefox OS",
    "bug_status":"ASSIGNED",
    "include_fields": "id, summary, status, resolution, component, assigned_to, depends_on, blocks, whiteboard, cf_feature_b2g, cf_blocking_b2g"
    "bug_status":"REOPENED",
     "component":"Gaia::Contacts",
     "product":"Firefox%20OS"
    "include_fields": "id, summary, status, resolution, component, assigned_to, depends_on, blocks, whiteboard, cf_feature_b2g, cf_blocking_b2g"
}
}
</bugzilla>
</bugzilla>
* Link to: All open bugs  
|}
:<bugzilla>
{| class="wikitable collapsible collapsed" style="width: 100%"
! All open bugs  
|-
|
<bugzilla>
{
{
    "list_id":"11826378",
     "resolution":"---",
     "resolution":"---",
     "query_format":"advanced",
     "query_format":"advanced",
     "bug_status":"UNCONFIRMED",
     "bug_status":"REOPENED, ASSIGNED, NEW, UNCONFIRMED",
    "bug_status":"NEW",
     "component":"Gaia::[COMPONENT]",
    "bug_status":"ASSIGNED",
    "bug_status":"REOPENED"
     "component":"Gaia::Contacts",
     "product":"Firefox OS",
     "product":"Firefox OS",
    "include_fields": "id, summary, status, resolution, component, assigned_to, depends_on, blocks, whiteboard, cf_feature_b2g, cf_blocking_b2g"
    "include_fields": "id, summary, status, resolution, component, assigned_to, depends_on, blocks, whiteboard, cf_feature_b2g, cf_blocking_b2g"
}
}
</bugzilla>
</bugzilla>
* All open blockers/noms
|}
:<bugzilla>
{| class="wikitable collapsible collapsed" style="width: 100%"
! All open blockers/noms  
|-
|
<bugzilla>
{
{
     "f1":"cf_blocking_b2g",
     "o2":"substring",
     "o1":"anywordssubstr",
    "v2":"2.2",
     "f2":"cf_blocking_b2g",
     "resolution":"---",
     "resolution":"---",
    "chfieldto":"Now",
    "chfield":"[Bug%20creation]",
     "query_format":"advanced",
     "query_format":"advanced",
     "bug_status":"UNCONFIRMED",
     "bug_status":"REOPENED, ASSIGNED, NEW, UNCONFIRMED",
    "bug_status":"NEW",
     "component":"Gaia::[COMPONENT]",
    "bug_status":"ASSIGNED",
     "product":"Firefox OS",
    "bug_status":"REOPENED",
     "include_fields": "id, summary, status, resolution, component, assigned_to, depends_on, blocks, whiteboard, cf_feature_b2g, cf_blocking_b2g"
    "v1":"%2B%2C%20%3F",
     "component":"Gaia%3A%3AContacts",
     "product":"Firefox%20OS",
     "list_id":"11826443",
    "include_fields": "id, summary, status, resolution, component, assigned_to, depends_on, blocks, whiteboard, cf_feature_b2g, cf_blocking_b2g"
}
}
</bugzilla>
</bugzilla>
|}
==Sprint Details==
==Sprint Details==
==Design Documents==
==Design Documents==
:UX Specs  
:UX Specs  
::https://mozilla.app.box.com/applications
:Building Blocks
:Building Blocks
* https://wiki.mozilla.org/Gaia/Design/BuildingBlocks
::https://wiki.mozilla.org/Gaia/Design/BuildingBlocks
* https://etherpad.mozilla.org/b2g-features-checklist
::https://etherpad.mozilla.org/b2g-features-checklist
==User Stories Metas==
==User Stories Metas==
:Open User Stories
{| class="wikitable collapsible collapsed" style="width: 100%"
*<bugzilla>
! All metas 
|-
|<bugzilla>
{
    "o1":"anywords",
    "v1":"meta",
    "f1":"short_desc",
    "query_format":"advanced",
    "component":"Gaia::[COMPONENT]",
    "product":"Firefox OS",
    "include_fields": "id, summary, status, resolution, component, assigned_to, depends_on, blocks, whiteboard, cf_feature_b2g, cf_blocking_b2g"
}
</bugzilla>
|}
{| class="wikitable collapsible collapsed" style="width: 100%"
! Open User Stories  
|-
|
<bugzilla>
{
{
     "list_id":"11826127",
     "o1":"substring",
     "short_desc":"User%20Story",
     "v1":"User Story",
    "f1":"short_desc",
    "resolution":"---",
     "query_format":"advanced",
     "query_format":"advanced",
     "short_desc_type":"allwordssubstr",
     "bug_status":"REOPENED, ASSIGNED, NEW, UNCONFIRMED",
    "bug_status":"UNCONFIRMED",
     "component":"Gaia::[COMPONENT]",
    "bug_status":"NEW",
     "product":"Firefox OS",
    "bug_status":"ASSIGNED",
    "include_fields": "id, summary, status, resolution, component, assigned_to, depends_on, blocks, whiteboard, cf_feature_b2g, cf_blocking_b2g"
    "bug_status":"REOPENED",
     "component":"Gaia%3A%3AContacts",
     "product":"Firefox%20OS",
    "include_fields": "id, summary, status, resolution, component, assigned_to, depends_on, blocks, whiteboard, cf_feature_b2g, cf_blocking_b2g"
}
}
</bugzilla>
</bugzilla>
:All User Stories
|}
*<bugzilla>
{| class="wikitable collapsible collapsed" style="width: 100%"
! All User Stories  
|-
|<bugzilla>
{
{
     "list_id":"11826127",
     "o1":"substring",
     "short_desc":"User%20Story",
     "v1":"User Story",
    "f1":"short_desc",
     "query_format":"advanced",
     "query_format":"advanced",
    "short_desc_type":"allwordssubstr",
     "component":"Gaia::[COMPONENT]",
     "component":"Gaia%3A%3AContacts",
     "product":"Firefox OS",
     "product":"Firefox%20OS",
    "include_fields": "id, summary, status, resolution, component, assigned_to, depends_on, blocks, whiteboard, cf_feature_b2g, cf_blocking_b2g"
    "include_fields": "id, summary, status, resolution, component, assigned_to, depends_on, blocks, whiteboard, cf_feature_b2g, cf_blocking_b2g"
}
}
</bugzilla>
</bugzilla>
|}
==Setup==
==Setup==
* list all setup needs to use app
:1. list all setup needs to use app
:2.
==Automation Scripts==
==Automation Scripts==
:Link to: How to Run Automation
:How to Run Automation
* https://docs.google.com/a/qanalydocs.com/document/d/1Rf0i57kN9Fof_HgTKnnqZ3ADD0htSfploHCvGGBaL7o/edit
::*[http://blargon7.com/2013/07/running-firefox-os-ui-tests-without-a-device-revised/ Running without a device]
gaiatest --testvars=gaiatest/testvars.json --address=localhost:2828 --restart --timeout=100000 gaiatest/tests/functional/[app-title]/manifest.ini
::*[https://developer.mozilla.org/en-US/Firefox_OS/Platform/Automated_testing/gaia-ui-tests Intro to Gaia UI Tests]
:Automated Email Smoketests
::*[https://developer.mozilla.org/en-US/Firefox_OS/Platform/Automated_testing/gaia-ui-tests/Gaia_UI_Tests_Run_Tests Running the Gaia UI Tests]
* list scripts available for this app
:gaiatest --testvars=gaiatest/testvars.json --address=localhost:2828 --restart --timeout=100000 gaiatest/tests/functional/[app-title]/manifest.ini
:Automated [COMPONENT] Smoketests
::*list scripts available for this app
from below link -V or find in gaia repository
from below link -V or find in gaia repository
:All Gaia-UI Functional Tests
:All Gaia-UI Functional Tests
* https://github.com/mozilla-b2g/gaia/tree/master/tests/python/gaia-ui-tests/gaiatest/tests/functional + /app-title
::https://github.com/mozilla-b2g/gaia/tree/master/tests/python/gaia-ui-tests/gaiatest/tests/functional + /app-title
* Unit Tests
:Unit Tests
** n/a
::*n/a
* Other Functional Tests
** TBD
==Logging==
==Logging==
Please provide the logcat by running adb logcat -v time -s GeckoDump:V Gecko:V GeckoConsole:V OomLogger:V | tee FILENAME-TO-LOG-TO.    Please start running this command BEFORE you attempt to reproduce the  problem.  logcat uses a circular buffer that discards older entries  when  the buffer fills up, so if you run logcat only after the problem  happens, you may not have all of the logic.  Once you are done, hit  control-C and send us the file.   
:Please provide the logcat by running adb logcat -v time -s GeckoDump:V Gecko:V GeckoConsole:V OomLogger:V | tee FILENAME-TO-LOG-TO.    Please start running this command BEFORE you attempt to reproduce the  problem.  logcat uses a circular buffer that discards older entries  when  the buffer fills up, so if you run logcat only after the problem  happens, you may not have all of the logic.  Once you are done, hit  control-C and send us the file.   
==Bug Writing==
==Bug Writing==
* Link to Bug Writing Document
:Link to Bug Writing Document

Latest revision as of 22:16, 16 January 2015

App Title

Stability (Open to Test)

Link to: Developer's status

How to test this App

Link to: One and Done Items
Application Coverage
Access Points
  • list ways to access the app
Data Management
  • list data types/content app utilizes
Areas to test
  • list areas of app to test (Main view, compose, settings, edit, details view, etc)
User Actions
  • list all actions user can perform in app
Positive & Negative Testing
http://www.guru99.com/positive-vs-negative-testing.html
Positive Examples
  • list some positive examples
Negative Examples
  • list some negative examples
Boundary Testing
http://en.wikipedia.org/wiki/Boundary_testing
  • list some examples of boundary testing
Race Conditions
http://en.wikipedia.org/wiki/Race_condition
  • list some examples of Race Conditions to test

FXOS Contacts

Team Members
[Component] QA Owner
  • NAME_MAILTO:

Fixed in last 7 days

Open Bugs

Last 7 days

Bugzilla query error

Bugzilla API returned an error: 1

Sprint Details

Design Documents

UX Specs
https://mozilla.app.box.com/applications
Building Blocks
https://wiki.mozilla.org/Gaia/Design/BuildingBlocks
https://etherpad.mozilla.org/b2g-features-checklist

User Stories Metas

Setup

1. list all setup needs to use app
2.

Automation Scripts

How to Run Automation
gaiatest --testvars=gaiatest/testvars.json --address=localhost:2828 --restart --timeout=100000 gaiatest/tests/functional/[app-title]/manifest.ini
Automated [COMPONENT] Smoketests
  • list scripts available for this app

from below link -V or find in gaia repository

All Gaia-UI Functional Tests
https://github.com/mozilla-b2g/gaia/tree/master/tests/python/gaia-ui-tests/gaiatest/tests/functional + /app-title
Unit Tests
  • n/a

Logging

Please provide the logcat by running adb logcat -v time -s GeckoDump:V Gecko:V GeckoConsole:V OomLogger:V | tee FILENAME-TO-LOG-TO. Please start running this command BEFORE you attempt to reproduce the problem. logcat uses a circular buffer that discards older entries when the buffer fills up, so if you run logcat only after the problem happens, you may not have all of the logic. Once you are done, hit control-C and send us the file.

Bug Writing

Link to Bug Writing Document
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/B2G/How_To_Test_Firefox_OS/App_Page_Template&oldid=1048487"