QA/B2G/How To Test Firefox OS/Loop

From MozillaWiki
Jump to: navigation, search

Loop

Stability (Open to Test)

Link to: Developer's status

How to test this App

Link to: One and Done Items
Loop Application Coverage
Access Points
  • Contacts App
  • Homescreen
  • Messages App
Data Management
  • Converstions
  • Rooms
  • Contacts
  • Registered Accounts
Areas to test
  • Loop FTE
  • Sign in Page
  • Room View
  • Calls View
  • Loop Settings
  • Conversation View
User Actions
  • Sign in with Phone Number/Firefox Account
  • New Room/Conversation
  • Delete Room/Conversation
  • Pick Contact
  • "X" to minimize options on Room/Call View
  • Change Default Call mode to Video/Audio
  • Change Camera to Front/Back
Positive & Negative Testing
http://www.guru99.com/positive-vs-negative-testing.html
Positive Examples
  • Sign in with Phone Number
  • Create a new room
  • Delete a Conversation
Negative Examples
  • Sign in with a non existent Firefox account
  • Send a Room link to an invalid phone number
  • Sign into the same account on multiple devices with FxA
Boundary Testing
http://en.wikipedia.org/wiki/Boundary_testing
  • Have 1000+ Contacts in the contacts list
  • Open 100+ New Rooms/Conversations
  • Have 50+ People Join the same room
Race Conditions
http://en.wikipedia.org/wiki/Race_condition
  • Receive a phone call with a device that you are calling via Loop
  • Join a Room while turning on airplane mode

FXOS Contacts

Team Members
Loop QA Owner
  • Massimo Barone

Fixed in last 7 days

Open Bugs

Last 7 days

Bugzilla query error

Sprint Details

Design Documents

UX Specs
https://mozilla.app.box.com/applications
Building Blocks
https://wiki.mozilla.org/Gaia/Design/BuildingBlocks
https://etherpad.mozilla.org/b2g-features-checklist

User Stories Metas

Setup

1. Download the latest Firefox Loop Client from: https://github.com/mozilla-b2g/firefoxos-loop-client
2. Install Grunt using instructions at the bottom of the page via the link listed in step 1
3. Open Terminal and run the following commands with ADB and Devtools enabled, and the phone on homescreen
  • 1. cd (firefoxos-loop-client folder location)
  • 2. git pull
  • 3. grunt build
4. When asked if you want to allow the connection, select "OK"
5. A banner will appear saying the app installed and the connection request window will appear again. Select "OK"

Automation Scripts

How to Run Automation
gaiatest --testvars=gaiatest/testvars.json --address=localhost:2828 --restart --timeout=100000 gaiatest/tests/functional/manifest.ini
Automated Loop Smoketests
  • None
All Gaia-UI Functional Tests
https://github.com/mozilla-b2g/gaia/tree/master/tests/python/gaia-ui-tests/gaiatest/tests/functional
Unit Tests
  • n/a

Logging

Please provide the logcat by running adb logcat -v time -s GeckoDump:V Gecko:V GeckoConsole:V OomLogger:V | tee FILENAME-TO-LOG-TO. Please start running this command BEFORE you attempt to reproduce the problem. logcat uses a circular buffer that discards older entries when the buffer fills up, so if you run logcat only after the problem happens, you may not have all of the logic. Once you are done, hit control-C and send us the file.

Bug Writing

Link to Bug Writing Document