B2G/QA/Gaia Test Plan/Template

Introduction

Purpose

See https://wiki.mozilla.org/Gaia/<app name, i.e. Clock>

Resource Plan

People on Project

HW/SW Specification/Requirements

HW:

• Testing will be conducted on the Aries (Sony Compact Z3C) and the Flame device.
• Headphones; 2 and 3 prong types : see https://en.wikipedia.org/wiki/Phone_connector_%28audio%29#TRRS_standards
• Headphones; bluetooth w/ AVRCP : https://en.wikipedia.org/wiki/List_of_Bluetooth_profiles#Audio.2FVideo_Remote_Control_Profile_.28AVRCP.29

Test Strategy

Major Test Area Strategy

• Unit test
  • Dev driven : https://github.com/mozilla-b2g/gaia/tree/master/apps/<clock>/test/unit
• Smoke test
  • https://moztrap.mozilla.org/manage/cases/?filter-suite=241 ( Done daily)
  • Specific smoke tests : https://moztrap.mozilla.org/manage/case/1772/
• Manual Functionality test
  • https://moztrap.mozilla.org/manage/cases/<suite id>
  • Exploratory testing : <mapping link>
  • Test cases based on ACC
• Automation Integration test
  • https://github.com/mozilla-b2g/gaia/tree/master/apps/<clock>/test/marionette
• Automation End-to-end tests
  • https://github.com/mozilla-b2g/gaia/tree/master/tests/python/gaia-ui-tests/gaiatest/tests/functional/<clock>
• Security test :
  • security team does the testing : https://wiki.mozilla.org/Security/Reviews/Gaia/clock
• Stress test :
  • No current stress test
  • Possible to add to MTBF :
    • https://wiki.mozilla.org/QA/Automation/Projects/MTBF
    • https://developer.mozilla.org/en-US/docs/Mozilla/Firefox_OS/Automated_testing/MTBF_tests
• Performance test
  • Raptor testing
    • https://developer.mozilla.org/en-US/docs/Mozilla/Firefox_OS/Automated_testing/Raptor
    • dashboard : https://raptor.mozilla.org/
• l10n test
  • RTL : https://moztrap.mozilla.org/manage/cases/?filter-suite=974

Test Deliverables

• Test Cases
  • Outcome of test case runs:
    • Maybe wiki the test run and have a link in the email and paste in here?

Dependencies/Risk

• Dependencies on SNTP (default settings) : http://mxr.mozilla.org/mozilla-central/source/b2g/app/b2g.js#928
• Possibly with QC’s XPCOM for some QC hardware; May need to configure QC file
• Dependencies on settings app
• Dependencies on system clock

Scope

• In scope:
  • <app> application and interactions with the system.
• Out of scope :
  • underwater testing

Signoff/Exit Criteria

• zero blocker bugs for 2.6
• ui-review +

References

Repositories

Gaia : https://github.com/mozilla-b2g/gaia/tree/master/apps/clock

Bugs tracking features

No new features in 2.6

Specs/Design Diagrams

https://mozilla.app.box.com/applications/1/864504610

Scrum

No scrum for Clock

Meeting Notes

No meetings for Clock

Supplemental Documentation

Terminology

Project Schedule

https://wiki.mozilla.org/Firefox_OS/Releases/2.6

Test Outline

https://public.etherpad-mozilla.org/p/test-outline-clock

Test Cases

Clock ACC Matrix

https://docs.google.com/spreadsheets/d/1Tk8xW2oT9qvs5cFXf5XMGnEnWDAmgKINtWJU_USpRNo/edit#gid=0

Moztrap Test Cases

https://moztrap.mozilla.org/manage/cases/?filter-suite=684

Glossary