Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that Presentation API is correctly implemented.

Ownership

Developer contact: Shih-Chiang Chien (:schien)

QA: Mihai Pop (:MihaiP)

Overall Status

[AT RISK] Nightly 53: it's going to be prefed on, on 15-11-2016

• At risk due to bug 1313368 - [Presentation API] Fennec stalls when trying to load a page (This is reproducing only on particular devices and on Presentation API pages, so we don't know exactly how many users this issue is affecting)

Testing Summary

Scope of testing

The testing will be focusing on:

• Verify that the manual tests made by W3C for presentation API pass
• Monitor crash rate, stability, and power consumption
• Check that no important issues are regressing from the feature work

Environments

Testing will be performed on following devices:

• Nexus Player
• Chromecast
• Phones and Tablets
  • Android 4.4+

Specifications

• https://www.w3.org/TR/presentation-api/#api

User stories

• Use cases and requirements for Presentation API
  • https://github.com/w3c/presentation-api/blob/gh-pages/uc-req.md

Acceptance Criteria

• The feature does not introduce new regressions that affect performance and stability
• All w3c tests pass
• No negative feedback from users

Testing details

• Environment:

- Receiver (Presentation Display): "Nexus Player + TV" or "Chromecast +TV"
- Sender: Android device with Android 4.4 or higher
- Fennec Build: https://people-mozilla.org/~schien/presentation-api/fennec-52.0a1.en-US.android-arm.apk

• Test cases(Latest test result: 14.11.2016):

- https://docs.google.com/spreadsheets/d/1uub8yabL0-_7TUaBPZ7sbhqYNcn936IYQSU6vNhMULY/edit#gid=1378915478
  - All tests passed except a known w3c issue, and 2 tests are Not Applicable
- https://docs.google.com/spreadsheets/d/1xfbFJw2nfSAL3Bd4LIXMkdUseI1Cq3aZW8ZrDmU5Hc4/edit#gid=284504573
  - 11/12 tests PASSED

Bug Work

Tracking bugs

• Bugs to track the Presentation API feature
• Dependencies
• meta bug: bug 1184036 - (1-UA_Presentation_API) [meta] 1-UA support for Presentation API

ex:

84 Total; 1 Open (1.19%); 78 Resolved (92.86%); 5 Verified (5.95%);

Signoff

Criteria

• All test cases should be executed
• All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed

Results

Nightly testing

• Not landed yet

Aurora testing

• Not landed yet

Beta testing

• Not landed yet