QA/Fennec/Control media content when switching between apps

From MozillaWiki
< QA‎ | Fennec
Jump to: navigation, search

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that users can control media content when switching between apps

Ownership

Developer contact: Alastor Wu

QA: Sorina Florean [:sorina]

Overall Status

[LANDED] Nightly 51:

[NOT LANDED] Aurora: NA

[NOT LANDED] Beta: NA

Testing Summary

Scope of testing

The testing will be focus on:

  • verifying that users can control media content if they are switching between apps
  • verifying that media control is visible in user control interface in lock screen

Environments

Testing will be performed on following devices:

  • Phones
    • 5.x
    • 6.x
  • Tablet
    • 5.x
    • 6.x

Specifications

  • Chrome already does that, allow the user to control media content played in Fennec to be controlled while Fennec is in the background to no disrupt users workflow.
  • When the user is playing the music from arbitrary web contents, then:

(1) Audio competing happens (other higher-level interruption)

  • The music should be paused, and its control icon should be changed from "pause" to "play" that indicates the music is paused now.
  • If the remote media-control exists, its control icon should also be changed from "pause" to "play".

(2) Audio competing ended

  • The music should be resumed, and its control icon should be changed from "play" to "pause" that indicates the music is playing now.
  • If the remote media-control exists, its control icon should also be changed from "play" to "pause".

(3) Use the remote media-control to pause

  • The music should be paused, and its control icon should be changed from "pause" to "play" that indicates the music is paused now.

(4) Use the remote media-control to play

  • The music should be paused, and its control icon should be changed from "play" to "pause" that indicates the music is playing now.

User stories

  • As a user, I want to control media content played back in Fennec easily, when switching to another app, without going back to Fennec
  • As a user, I want to touch play/pause button and directly control the playing state of the media content
  • As a user, I want to swipe the control interface and stop the media content
  • As a user I want to click the control interface and open the Fennec app

Acceptance Criteria

  • Media control is visible in user control interface in lock screen and utility tray
  • Media control works

KPI/Metrics:

  • Probe to measure if this media control is being used by users, i.e. interaction with it, play, stop, next etc.

Testing details

Test Cases

Testing days

Date: 2016-05-09

  • Created Test Plan

Date: 2016-05-27

  • Verified bug:
    • bug 1235612 - Audio indicator/mute button shown for page with no audible sound

Date: 2016-06-02

  • Exploratory testing on latest Nightly

Date: 2016-06-14

  • Exploratory testing on latest Nightly with Nexus 5 (Android 6.0.1) and LG G4 (Android 5.1)

Date: 2016-07-05

  • Exploratory testing on latest Nightly with Asus ZenPad 8 (Android 5.0.2)

Date: 2016-07-12

  • Exploratory testing on latest Nightly and latest Aurora with:
    • Asus ZenPad 8 (Android 5.0.2)
    • LG G4 (Android 5.1)
    • Nexus 5 (Android 6.0.1)
  • Verified bug:
    • bug 1257738 - Implement the audio competing mechanism on Fennec

Date: 2016-07-14

  • Created Test Cases
    • New bug 1286818 - Can't swipe media notification when video is playing

Date: 2016-07-28

  • Verified bug:
    • bug 1282391 - Cleanup the media controls when the Fennec gets killed

Date: 2016-08-05

  • Test cases
  • Verified bug:
    • bug 1288971 - The icon on the media control is out of sync
    • bug 1288972 - The media control is hidden when user set the security to "Hide sensitive notification content"
  • New bug:
    • bug 1292585 - Media control notification is out of sync

Date: 2016-08-31

  • Exploratory testing on latest Nightly with Nexus 5 (Android 6.0.1) and LG G4 (Android 5.1)

Date: 2016-09-07

Bug Work

  • Meta bug
    • bug 1240423 - Implement the remote media-control on Fennec
Full Query
ID Priority Summary Status Assigned to
1235612 -- Audio indicator/mute button shown for page with no audible sound VERIFIED Alastor Wu [:alwu]
1242874 -- Enable pause/play control ability for the AudioChannel API RESOLVED Alastor Wu [:alwu]
1249579 P2 Request audio focus on Fennec RESOLVED Alastor Wu [:alwu]
1257738 P2 Implement the audio competing mechanism on Fennec VERIFIED Alastor Wu [:alwu]
1269672 -- move audible data checking from MDSM to DecodedAudioDataSink RESOLVED Alastor Wu [:alwu]
1277373 -- Android lint and checktests permafailing with SyntaxError: unexpected EOF while parsing after bug 1240423 landed. RESOLVED Alastor Wu [:alwu]
1286818 -- Can't swipe media notification when video is playing RESOLVED
1288970 -- Can't swipe media notification when video is playing VERIFIED
1290467 P2 Media control notification is not displayed when no-audio media is playing RESOLVED Alastor Wu [:alwu]

9 Total; 0 Open (0%); 6 Resolved (66.67%); 3 Verified (33.33%);


Still issues

Bug fixed

[RESOLVED FIXED] Bug 1235612 - Audio indicator/mute button shown for page with no audible sound

2016-05-27: verified fixed on Firefox for Android 49.0a1 (2016-05-27) with Asus ZEnPad 8 (Android 5.0.2) and LG G4 (Android 5.1)

[RESOLVED FIXED] Bug 1257738 - Implement the audio competing mechanism on Fennec

2016-07-12: verified fixed on Fennec 49.0a2 and 50.0a1 (2016-07-11) with LG G4 (Android 5.1) and Nexus 5 (Android 6.0.1)

[RESOLVED FIXED] Bug 1242874 - Enable pause/play control ability for the AudioChannel API
[RESOLVED FIXED] Bug 1249579 - Request audio focus on Fennec
[RESOLVED FIXED] Bug 1269672 - move audible data checking from MDSM to DecodedAudioDataSink

Signoff

Criteria

  • All test cases should be executed
  • All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed


Results

Nightly testing

  • There were no blockers found while testing this feature.
  • All bugs are fixed and verified

Aurora testing NA Beta testing NA