QA/Fennec/Fennec Audio Controls Enhancement

From MozillaWiki
Jump to navigation Jump to search

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that users are aware of the current media playing status and also deals with the multiple tab scenarios

Ownership

Developer contact: [mailto:]

QA: Sorina Florean [:sorina]

Overall Status

[LANDED] Nightly 52:

[LANDED] Aurora 52:15-11-2016

[LANDED] Beta: 52:25-01-2017

Testing Summary

Scope of testing

The testing will be focus on:

  • verifying that users are aware of the current media playing status
  • verifying that users can deal the multiple tab scenario

Environments

Testing will be performed on following devices:

  • Phones
    • 5.x
    • 6.x
  • Tablet
    • 5.x
    • 6.x
    • 7.x

Specifications

  • Chrome already does that, allow the user to control media content played in Fennec to be controlled while Fennec is in the background to no disrupt users workflow.
  • When the user is playing the music from arbitrary web contents, then:

(1) Audio competing happens (other higher-level interruption)

  • The music should be paused, and its control icon should be changed from "pause" to "play" that indicates the music is paused now.
  • If the remote media-control exists, its control icon should also be changed from "pause" to "play".

(2) Audio competing ended

  • The music should be resumed, and its control icon should be changed from "play" to "pause" that indicates the music is playing now.
  • If the remote media-control exists, its control icon should also be changed from "play" to "pause".

(3) Use the remote media-control to pause

  • The music should be paused, and its control icon should be changed from "pause" to "play" that indicates the music is paused now.

(4) Use the remote media-control to play

  • The music should be paused, and its control icon should be changed from "play" to "pause" that indicates the music is playing now.
  • Media control notification - Android 6.0.1
Screenshot 20160916-131143.png
  • Media control notification - Android 5.1
Screenshot 2016-09-16-13-16-41.png

User stories

  • As a user, I want to control media content played back in Fennec easily, when switching to another app, without going back to Fennec
  • As a user, I want to touch play/pause button and directly control the playing state of the media content
  • As a user, I want to swipe the control interface and stop the media content
  • As a user I want to click the control interface and open the Fennec app

Acceptance Criteria

  • Media control is visible in user control interface in lock screen and utility tray
  • Media control works

Testing details

Test Cases

Testing days

Date: 2016-09-05

Date: 2016-09-14

Date: 2016-09-16

  • Exploratory testing
  • New bug 1303292 - Site icon from media control notification is not displayed on tablets

Date: 2016-09-26

  • Exploratory testing and TC on latest Nightly
  • New bug 1305430 - Favicon is displayed on media control notification only after the "pause" button is tapped

Date: 2016-09-29

Date: 2016-10-06

  • Exploratory testing on latest Nightly (2016-10-06) with Asus ZenPad 8 (Android 5.0.2) and Nexus 5 (Android 6.0.1)

Date: 2016-10-10

  • Verified bugs:
    • bug 1302084 - Strange window popped up after tapping the stop button "||"
    • bug 1303292 - Site icon from media control notification is not displayed on tablets
    • bug 1305430 - Favicon is displayed on media control notification only after the "pause" button is tapped

Date: 2016-10-13

  • Exploratory testing and Tc on latest Nightly (2016-10-13) with LG G4 (Android 5.1) and Nexus 9 (Android 6.0.1)

Date: 2016-10-21

  • Exploratory testing on latest Nightly with LG G4 (Android 5.1) and HTC Desire 820 (Android 6.0.1)

Date: 2016-10-28

  • Exploratory testing on latest Nightly with Nexus 9 (Android 6.0.1)

Date: 2016-11-01

Date: 2016-11-02

  • Exploratory testing on latest Nightly with Huawei Honor (Android 5.1.1) and HTC Desire 820 (Android 6.0.1)

Date: 2016-11-10

Date: 2016-11-18

  • Exploratory testing on latest Aurora with LG G4 (Android 6.0.1) and Nexus 9 (Android 7.0)

Date: 2016-12-06

  • TC and exploratory testing on latest Aurora and Nightly with Asus ZenPad 8 (Android 6.0.1) and Huawei Honor 5x (Android 5.1.1)

Date: 2017-01-06

  • New bugs:
    • bug 1329209 - Video is not resumed when switching between two browsers
    • bug 1329122 - Media control notification is displayed for no-audio pages if is open in the same tab after an audio content was played
  • TC and exploratory testing on latest Aurora and Nightly with Asus ZenPad 8 (Android 6.0.1) and Nexus 9 (Android 7.0)

Date: 2017-01-23

Exploratory testing on latest Aurora and Nightly with Huawei MediaPad M2 - Android 5.1.1 and Samsung Galaxy Note 4 - Android 5.0.1.

Date: 2017-01-31

Exploratory testing on Firefox 52 Beta 2 with Samsung Galaxy Note 4 (Android 5.0.1)

Bug Work

  • Meta bug

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 403 [1] => Forbidden ) ) 1


  • bug 1268367 - [meta] Fennec Audio Controls Enhancement -remote media control and audio competing

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 403 [1] => Forbidden ) ) 1


Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 403 [1] => Forbidden ) ) 1


  • bug 1264901 - (fennec-media-control) Implement the remote media-control front-end

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 403 [1] => Forbidden ) ) 1


Still issues

[NEW] Bug 1302453 - Media notification is out of sync
[NEW] Bug 1303292 - Site icon from media control notification is not displayed on tablets
[NEW] Bug 1278624 - Investigate: Support media notification on devices < lollipop
[NEW] Bug 1278626 - Improve icons of media notification

Bug fixed

[RESOLVED FIXED] Bug 1235612 - Audio indicator/mute button shown for page with no audible sound
[RESOLVED FIXED] Bug 1269672 - Move audible data checking from MDSM to DecodedAudioDataSink
[RESOLVED FIXED] Bug 1290467 - Media control notification is not displayed when no-audio media is playing
[RESOLVED FIXED] Bug 1239372 - The tab sound indicator should not be hiding when using mouse clicking to seek the video
[RESOLVED FIXED] Bug 1240423 - Implement the remote media-control on Fennec
[RESOLVED FIXED] Bug 1249579 - Request audio focus on Fennec
[RESOLVED FIXED] Bug 1257738 - Implement the audio competing mechanism on Fennec
[RESOLVED FIXED] Bug 1287029 - Remote media-control test case
[RESOLVED FIXED] Bug 1290510 - Put media control notification behind a Nightly flag
[RESOLVED FIXED] Bug 1292585 - Media control notification is out of sync
[RESOLVED FIXED] Bug 1285739 - Audio notification will not disappear when playing out Google translation
[RESOLVED FIXED] Bug 1288971 - The icon on the media control is out of sync
[RESOLVED FIXED] Bug 1288972 - The media control is hidden when user set the security to "Hide sensitive notification content"
[RESOLVED FIXED] Bug 1289356 - Media actions are inconsistent after pressing Home
[RESOLVED FIXED] Bug 1290029 - Would be nice to back to the page for the music that you just played after taping the music information field
[RESOLVED FIXED] Bug 1284387 - Video controls aren't removed when tab closed
[RESOLVED FIXED] Bug 1278255 - Action in media notification always has title "Pause"
[RESOLVED FIXED] Bug 1279137 - Update notifications icons for media controls
[RESOLVED FIXED] Bug 1282391 - Cleanup the media controls when the Fennec gets killed

Signoff

Criteria

  • All test cases should be executed
  • All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed


Results

Nightly testing

  • Users can control media content when switching between apps
  • Media control notification is displayed with page title, URL, favicon and play/pause button
  • The play/pause button from media notification is synced with the play/pause controls from tab
  • Tapping on media notification opens the media content in tab
  • Media notification from video 1 is changed with media notification from video 2 if the play button from video 2 was tapped
  • The media content is paused when user get a call
  • The sensitive media is hidden if the user is playing them in private tab
  • Media content is paused when another media is on, from another app or browser
  • User can swipe the media notification when the media content is paused

Aurora testing

  • Users can control media content when switching between apps
  • Media control notification is displayed with page title, URL, favicon and play/pause button
  • The play/pause button from media notification is synced with the play/pause controls from tab
  • Tapping on media notification opens the media content in tab
  • Media notification from video 1 is changed with media notification from video 2 if the play button from video 2 was tapped
  • The media content is paused when user get a call
  • The sensitive media is hidden if the user is playing them in private tab
  • Media content is paused when another media is on, from another app or browser
  • User can swipe the media notification when the media content is paused

Beta testing

  • Users can control media content when switching between apps
  • Media control notification is displayed with page title, URL, favicon and play/pause button
  • The play/pause button from media notification is synced with the play/pause controls from tab
  • Tapping on media notification opens the media content in tab
  • Media notification from video 1 is changed with media notification from video 2 if the play button from video 2 was tapped
  • The media content is paused when user get a call
  • The sensitive media is hidden if the user is playing them in private tab
  • Media content is paused when another media is on, from another app or browser
  • User can swipe the media notification when the media content is paused