QA/B2G/How To Test Firefox OS/Camera: Difference between revisions

Jump to navigation Jump to search
First true compiled Camera Wiki from template: completed bugzilla queries + collapsible.
(Updated to better match template formatting.)
(First true compiled Camera Wiki from template: completed bugzilla queries + collapsible.)
Line 2: Line 2:


==Stability (Open to Test)==
==Stability (Open to Test)==
* Link to: Developer's status
:Link to: Developer's status


==How to test this App==
==How to test this App==
: One and Done: https://oneanddone.mozilla.org/en-US/tasks/80/
:One and Done: https://oneanddone.mozilla.org/en-US/tasks/80/
: Application Coverage: [https://docs.google.com/a/qanalydocs.com/spreadsheets/d/1RhI81B01gzLYTeRVqFM8RC2_UiuGtFssGtX_pRycgqE/edit#gid=1401311229 Application Coverage]
:[https://docs.google.com/a/qanalydocs.com/spreadsheets/d/1RhI81B01gzLYTeRVqFM8RC2_UiuGtFssGtX_pRycgqE/edit#gid=1401311229 Application Coverage: Camera]


:Access Points
:Access Points
Line 27: Line 27:
::*Camera Share Activity
::*Camera Share Activity
::*Video Recording
::*Video Recording


: User Actions
: User Actions
::* Take a Picture
::*Take a Picture
::* Record a video
::*Record a video
::* Change your focus (manual/automatic)
::*Change your focus (manual/automatic)
::* Enable/disable the flash
::*Enable/disable the flash
::* Toggle Camera (front/back)
::*Toggle Camera (front/back)
::* Camera Settings
::*Camera Settings
::* Camera Zoom
::*Camera Zoom
::* Preview picture/video
::*Preview picture/video


:Positive & Negative Testing
:Positive & Negative Testing
:http://www.guru99.com/positive-vs-negative-testing.html
::http://www.guru99.com/positive-vs-negative-testing.html
:Positive Examples
:Positive Examples
::* Take a picture
::*Take a picture
::* Record a video
::*Record a video
:Negative Examples
:Negative Examples
::* Take pictures when phone memory is full
::*Take pictures when phone memory is full
::* Record a video in a pitch black room, no flash
::*Record a video in a pitch black room, no flash
::* Record a video while obscuring the camera lens
::*Record a video while obscuring the camera lens
::* Toggle between front/back camera while one is obscured
::*Toggle between front/back camera while one is obscured


:Boundary Testing
:Boundary Testing
::http://en.wikipedia.org/wiki/Boundary_testing
::http://en.wikipedia.org/wiki/Boundary_testing
::* Take a lot of pictures to fill preview images
::*Take a lot of pictures to fill preview images
::* Take pictures when phone memory is full
::*Take pictures when phone memory is full
::* Record a <1 second video
::*Record a <1 second video
::* Record a max length video
::*Record a max length video
::* Record a video that will exceed phone's memory
::*Record a video that will exceed phone's memory


 
:Race Conditions
: Race Conditions
::http://en.wikipedia.org/wiki/Race_condition
::http://en.wikipedia.org/wiki/Race_condition
::* Receive a phone call when capturing a photo
::*Receive a phone call when capturing a photo
::* Take a screenshot when capturing a photo
::*Take a screenshot when capturing a photo
::* Receive a call as soon as a video recording has started/ended
::*Receive a call as soon as a video recording has started/ended
::* Receive an alarm as soon as a video recording has started/ended
::*Receive an alarm as soon as a video recording has started/ended
::* Take a screenshot as you begin recording a video
::*Take a screenshot as you begin recording a video
 


== FXOS Contacts==
== FXOS Contacts==
Line 74: Line 71:
::https://wiki.mozilla.org/FirefoxOS/functionalteams
::https://wiki.mozilla.org/FirefoxOS/functionalteams
:Camera QA Owner
:Camera QA Owner
::*NAME_MAILTO: No-Jun
::*No-Jun Park




Line 80: Line 77:


==Open Bugs==
==Open Bugs==
 
{| class="wikitable collapsible" style="width: 100%"
===Last 7 days===
! Last 7 days  
 
|-
----
|
 
<bugzilla>
<bugzilla>
{
{
     "list_id":"11825956",
     "f1":"creation_ts",
    "o1":"changedafter",
    "v1":"-7d",
    "o2":"changedbefore",
    "v2":"now%2023%3A59%3A59%20",
    "f2":"creation_ts",
     "resolution":"---",
     "resolution":"---",
    "chfieldto":"Now",
    "chfield":"[Bug%20creation]",
     "query_format":"advanced",
     "query_format":"advanced",
     "chfieldfrom":"-7d",
     "bug_status":"REOPENED, ASSIGNED, NEW, UNCONFIRMED",
    "bug_status":"UNCONFIRMED",
     "component":"Gaia::Camera",
    "bug_status":"NEW",
     "product":"Firefox OS",
    "bug_status":"ASSIGNED",
    "include_fields": "id, summary, status, resolution, component, assigned_to, depends_on, blocks, whiteboard, cf_feature_b2g, cf_blocking_b2g"
    "bug_status":"REOPENED",
     "component":"Gaia%3A%3ACamera",
     "product":"Firefox%20OS"
    "include_fields": "id, summary, status, resolution, component, assigned_to, depends_on, blocks, whiteboard, cf_feature_b2g, cf_blocking_b2g"
}
}
</bugzilla>
</bugzilla>
 
|}
===Link to: All open bugs===
{| class="wikitable collapsible collapsed" style="width: 100%"
 
! All open bugs  
----
|-
 
|
<bugzilla>
<bugzilla>
{
{
    "list_id":"11826378",
     "resolution":"---",
     "resolution":"---",
     "query_format":"advanced",
     "query_format":"advanced",
     "bug_status":"UNCONFIRMED",
     "bug_status":"REOPENED, ASSIGNED, NEW, UNCONFIRMED",
    "bug_status":"NEW",
     "component":"Gaia::Camera",
    "bug_status":"ASSIGNED",
    "bug_status":"REOPENED"
     "component":"Gaia%3A%3ACamera",
     "product":"Firefox OS",
     "product":"Firefox OS",
    "include_fields": "id, summary, status, resolution, component, assigned_to, depends_on, blocks, whiteboard, cf_feature_b2g, cf_blocking_b2g"
    "include_fields": "id, summary, status, resolution, component, assigned_to, depends_on, blocks, whiteboard, cf_feature_b2g, cf_blocking_b2g"
}
}
</bugzilla>
</bugzilla>
 
|}
===All open blockers/noms===
{| class="wikitable collapsible collapsed" style="width: 100%"
 
! All open blockers/noms  
----
|-
 
|
<bugzilla>
<bugzilla>
{
{
     "f1":"cf_blocking_b2g",
     "o2":"substring",
     "o1":"anywordssubstr",
    "v2":"2.2",
     "f2":"cf_blocking_b2g",
     "resolution":"---",
     "resolution":"---",
    "chfieldto":"Now",
    "chfield":"[Bug%20creation]",
     "query_format":"advanced",
     "query_format":"advanced",
     "bug_status":"UNCONFIRMED",
     "bug_status":"REOPENED, ASSIGNED, NEW, UNCONFIRMED",
    "bug_status":"NEW",
     "component":"Gaia::Camera",
    "bug_status":"ASSIGNED",
     "product":"Firefox OS",
    "bug_status":"REOPENED",
     "include_fields": "id, summary, status, resolution, component, assigned_to, depends_on, blocks, whiteboard, cf_feature_b2g, cf_blocking_b2g"
    "v1":"%2B%2C%20%3F",
     "component":"Gaia%3A%3ACamera",
     "product":"Firefox%20OS",
     "list_id":"11826443",
    "include_fields": "id, summary, status, resolution, component, assigned_to, depends_on, blocks, whiteboard, cf_feature_b2g, cf_blocking_b2g"
}
}
</bugzilla>
</bugzilla>
|}


==Sprint Details==
==Sprint Details==
Line 150: Line 137:
==Design Documents==
==Design Documents==
:UX Specs  
:UX Specs  
::Link to spec sheet
::https://mozilla.app.box.com/applications/1/864504046


:Building Blocks
:Building Blocks
Line 157: Line 144:


==User Stories Metas==
==User Stories Metas==
:Link
:http://mzl.la/1srk5k0
 
===Open User Stories===
 
----


{| class="wikitable collapsible collapsed" style="width: 100%"
! Open User Stories 
|-
|
<bugzilla>
<bugzilla>
{
{
     "list_id":"11826127",
     "o1":"substring",
     "short_desc":"User%20Story",
     "v1":"User Story",
    "f1":"short_desc",
    "resolution":"---",
     "query_format":"advanced",
     "query_format":"advanced",
     "short_desc_type":"allwordssubstr",
     "bug_status":"REOPENED, ASSIGNED, NEW, UNCONFIRMED",
    "bug_status":"UNCONFIRMED",
     "component":"Gaia::Contacts",
    "bug_status":"NEW",
     "product":"Firefox OS",
    "bug_status":"ASSIGNED",
    "include_fields": "id, summary, status, resolution, component, assigned_to, depends_on, blocks, whiteboard, cf_feature_b2g, cf_blocking_b2g"
    "bug_status":"REOPENED",
     "component":"Gaia%3A%3ACamera",
     "product":"Firefox%20OS",
    "include_fields": "id, summary, status, resolution, component, assigned_to, depends_on, blocks, whiteboard, cf_feature_b2g, cf_blocking_b2g"
}
}
</bugzilla>
</bugzilla>
----
|}
===All User Stories===


----
{| class="wikitable collapsible collapsed" style="width: 100%"
 
! All User Stories 
<bugzilla>
|-
|<bugzilla>
{
{
     "list_id":"11826127",
     "o1":"substring",
     "short_desc":"User%20Story",
     "v1":"User Story",
    "f1":"short_desc",
     "query_format":"advanced",
     "query_format":"advanced",
    "short_desc_type":"allwordssubstr",
     "component":"Gaia::Contacts",
     "component":"Gaia%3A%3ACamera",
     "product":"Firefox OS",
     "product":"Firefox%20OS",
    "include_fields": "id, summary, status, resolution, component, assigned_to, depends_on, blocks, whiteboard, cf_feature_b2g, cf_blocking_b2g"
    "include_fields": "id, summary, status, resolution, component, assigned_to, depends_on, blocks, whiteboard, cf_feature_b2g, cf_blocking_b2g"
}
}
</bugzilla>
</bugzilla>
 
|}
 
==Setup==
==Setup==
:1. Camera Compatible phone
:1. Camera Compatible phone
Line 201: Line 185:


==Automation Scripts==
==Automation Scripts==
:Link to: How to Run Automation
:How to Run Automation
::[https://docs.google.com/a/qanalydocs.com/document/d/1Rf0i57kN9Fof_HgTKnnqZ3ADD0htSfploHCvGGBaL7o/edit Automation Doc]
::*[http://blargon7.com/2013/07/running-firefox-os-ui-tests-without-a-device-revised/ Running without a device]
::*[https://developer.mozilla.org/en-US/Firefox_OS/Platform/Automated_testing/gaia-ui-tests Intro to Gaia UI Tests]
::*[https://developer.mozilla.org/en-US/Firefox_OS/Platform/Automated_testing/gaia-ui-tests/Gaia_UI_Tests_Run_Tests Running the Gaia UI Tests]
:gaiatest --testvars=gaiatest/testvars.json --address=localhost:2828 --restart --timeout=100000 gaiatest/tests/functional/camera/manifest.ini
:gaiatest --testvars=gaiatest/testvars.json --address=localhost:2828 --restart --timeout=100000 gaiatest/tests/functional/camera/manifest.ini




:Automated Camera Smoketests
:Automated Camera Smoketests
::test_camera_capture_video.py
::*test_camera_capture_video.py
::test_camera_multiple_shots.py
::*test_camera_multiple_shots.py
::test_camera_capture_video.py
::*test_camera_capture_video.py




Line 222: Line 208:


==Logging==
==Logging==
Please provide the logcat by running adb logcat -v time -s GeckoDump:V Gecko:V GeckoConsole:V OomLogger:V | tee FILENAME-TO-LOG-TO.    Please start running this command BEFORE you attempt to reproduce the  problem.  logcat uses a circular buffer that discards older entries  when  the buffer fills up, so if you run logcat only after the problem  happens, you may not have all of the logic.  Once you are done, hit  control-C and send us the file.   
:Please provide the logcat by running adb logcat -v time -s GeckoDump:V Gecko:V GeckoConsole:V OomLogger:V | tee FILENAME-TO-LOG-TO.    Please start running this command BEFORE you attempt to reproduce the  problem.  logcat uses a circular buffer that discards older entries  when  the buffer fills up, so if you run logcat only after the problem  happens, you may not have all of the logic.  Once you are done, hit  control-C and send us the file.   


==Bug Writing==
==Bug Writing==
:Link to Bug Writing Document
:Link to Bug Writing Document
69

edits

Navigation menu