QA/Fennec/Fennec Audio Controls Enhancement
Contents
- 1 Overview
- 2 Testing Summary
- 3 Testing details
- 3.1 Test Cases
- 3.2 Testing days
- 3.2.1 Date: 2016-09-05
- 3.2.2 Date: 2016-09-14
- 3.2.3 Date: 2016-09-16
- 3.2.4 Date: 2016-09-26
- 3.2.5 Date: 2016-09-29
- 3.2.6 Date: 2016-10-06
- 3.2.7 Date: 2016-10-10
- 3.2.8 Date: 2016-10-13
- 3.2.9 Date: 2016-10-21
- 3.2.10 Date: 2016-10-28
- 3.2.11 Date: 2016-11-01
- 3.2.12 Date: 2016-11-02
- 3.2.13 Date: 2016-11-10
- 3.2.14 Date: 2016-11-18
- 3.2.15 Date: 2016-12-06
- 3.2.16 Date: 2017-01-06
- 3.2.17 Date: 2017-01-23
- 3.2.18 Date: 2017-01-31
- 3.2.19 Date: 2017-02-24
- 3.2.20 Date: 2017-03-03
- 4 Bug Work
- 5 Signoff
Overview
Purpose
The purpose of this wiki is to serve as a general test plan for verifying that users are aware of the current media playing status and also deals with the multiple tab scenarios
Ownership
Developer contact: [mailto:]
Overall Status
[LANDED] Nightly 52:
[LANDED] Aurora 52:15-11-2016
[LANDED] Beta: 52:25-01-2017
Testing Summary
Scope of testing
The testing will be focus on:
- verifying that users are aware of the current media playing status
- verifying that users can deal the multiple tab scenario
Environments
Testing will be performed on following devices:
- Phones
- 5.x
- 6.x
- 7.x
- Tablet
- 5.x
- 6.x
- 7.x
Specifications
- Chrome already does that, allow the user to control media content played in Fennec to be controlled while Fennec is in the background to no disrupt users workflow.
- When the user is playing the music from arbitrary web contents, then:
(1) Audio competing happens (other higher-level interruption)
- The music should be paused, and its control icon should be changed from "pause" to "play" that indicates the music is paused now.
- If the remote media-control exists, its control icon should also be changed from "pause" to "play".
(2) Audio competing ended
- The music should be resumed, and its control icon should be changed from "play" to "pause" that indicates the music is playing now.
- If the remote media-control exists, its control icon should also be changed from "play" to "pause".
(3) Use the remote media-control to pause
- The music should be paused, and its control icon should be changed from "pause" to "play" that indicates the music is paused now.
(4) Use the remote media-control to play
- The music should be paused, and its control icon should be changed from "play" to "pause" that indicates the music is playing now.
- Media control notification - Android 6.0.1
- Media control notification - Android 5.1
User stories
- As a user, I want to control media content played back in Fennec easily, when switching to another app, without going back to Fennec
- As a user, I want to touch play/pause button and directly control the playing state of the media content
- As a user, I want to swipe the control interface and stop the media content
- As a user I want to click the control interface and open the Fennec app
Acceptance Criteria
- Media control is visible in user control interface in lock screen and utility tray
- Media control works
Testing details
Test Cases
- Test Case title
- https://docs.google.com/spreadsheets/d/1d5Y82ULYniSppOC2mgp0st65pueMzDtzg_scI0KxQA0/edit#gid=0
Testing days
Date: 2016-09-05
- Created Test Plan
- Test Cases: https://docs.google.com/spreadsheets/d/1d5Y82ULYniSppOC2mgp0st65pueMzDtzg_scI0KxQA0/edit#gid=0
Date: 2016-09-14
- Testing on latest Nightly with Nexus 5, LG G4 and Asus ZenPad 8
- Test Cases: https://docs.google.com/spreadsheets/d/1d5Y82ULYniSppOC2mgp0st65pueMzDtzg_scI0KxQA0/edit#gid=0
Date: 2016-09-16
- Exploratory testing
- New bug 1303292 - Site icon from media control notification is not displayed on tablets
Date: 2016-09-26
- Exploratory testing and TC on latest Nightly
- New bug 1305430 - Favicon is displayed on media control notification only after the "pause" button is tapped
Date: 2016-09-29
- Porting test cases to TestRail : https://testrail.stage.mozaws.net/index.php?/suites/view/143&group_by=cases:section_id&group_id=633&group_order=asc
- Exploratory testing and Tc on latest Nightly : https://docs.google.com/spreadsheets/d/1d5Y82ULYniSppOC2mgp0st65pueMzDtzg_scI0KxQA0/edit#gid=0
Date: 2016-10-06
- Exploratory testing on latest Nightly (2016-10-06) with Asus ZenPad 8 (Android 5.0.2) and Nexus 5 (Android 6.0.1)
Date: 2016-10-10
- Verified bugs:
- bug 1302084 - Strange window popped up after tapping the stop button "||"
- bug 1303292 - Site icon from media control notification is not displayed on tablets
- bug 1305430 - Favicon is displayed on media control notification only after the "pause" button is tapped
Date: 2016-10-13
- Exploratory testing and Tc on latest Nightly (2016-10-13) with LG G4 (Android 5.1) and Nexus 9 (Android 6.0.1)
Date: 2016-10-21
- Exploratory testing on latest Nightly with LG G4 (Android 5.1) and HTC Desire 820 (Android 6.0.1)
Date: 2016-10-28
- Exploratory testing on latest Nightly with Nexus 9 (Android 6.0.1)
Date: 2016-11-01
- Exploratory testing on latest Nightly with Nexus 9 (Android 6.0.1), Nexus 5 (Android 6.0.1) and LG G4 (Android 5.1)
- TC: https://docs.google.com/spreadsheets/d/1d5Y82ULYniSppOC2mgp0st65pueMzDtzg_scI0KxQA0/edit#gid=0
- Verified: bug 1302453 - Media notification is out of sync
- The feature is stable and users can control media content
Date: 2016-11-02
- Exploratory testing on latest Nightly with Huawei Honor (Android 5.1.1) and HTC Desire 820 (Android 6.0.1)
Date: 2016-11-10
- Exploratory testing on Presentation APITest (build: https://people-mozilla.org/~schien/presentation-api/fennec-52.0a1.en-US.android-arm.apk) with LG G4 (Android 6.0.1)
- Exploratory testing on latest Nightly with HTC Desire 820 (Android 6.0.1)
Date: 2016-11-18
- Exploratory testing on latest Aurora with LG G4 (Android 6.0.1) and Nexus 9 (Android 7.0)
Date: 2016-12-06
- TC and exploratory testing on latest Aurora and Nightly with Asus ZenPad 8 (Android 6.0.1) and Huawei Honor 5x (Android 5.1.1)
Date: 2017-01-06
- New bugs:
- bug 1329209 - Video is not resumed when switching between two browsers
- bug 1329122 - Media control notification is displayed for no-audio pages if is open in the same tab after an audio content was played
- TC and exploratory testing on latest Aurora and Nightly with Asus ZenPad 8 (Android 6.0.1) and Nexus 9 (Android 7.0)
Date: 2017-01-23
Exploratory testing on latest Aurora and Nightly with Huawei MediaPad M2 - Android 5.1.1 and Samsung Galaxy Note 4 - Android 5.0.1.
Date: 2017-01-31
Exploratory testing on Firefox 52 Beta 2 with Samsung Galaxy Note 4 (Android 5.0.1)
- Issue: https://bugzilla.mozilla.org/show_bug.cgi?id=1326114#c4
- Enhancement:
- bug 1335452 - Media control notification displayed for one video
Date: 2017-02-24
Exploratory testing and TCs on Firefox 52 Beta 8 with Motorola Nexus 6 (Android 7.0):
Exploratory testing and TCs on latest Nightly with Huawei MediaPad M2 (Android 5.1.1):
Verified bugs:
- bug 1340191 - No Audio Notification for BBC Radio
- bug 1326114 - Audio Tab notification does not go away when tab is closed
Date: 2017-03-03
Verified bugs:
- bug 1340191 - No Audio Notification for BBC Radio
- bug 1326114 - Audio Tab notification does not go away when tab is closed
- Sign-off 52 Beta 11:
- Android 7.1.1 - https://testrail.stage.mozaws.net/index.php?/runs/view/2895&group_by=cases:section_id&group_order=asc&group_id=2030
- Android 5.0.1 - https://testrail.stage.mozaws.net/index.php?/runs/view/2896&group_by=cases:section_id&group_order=asc&group_id=1996
- Android 6.0.1- https://testrail.stage.mozaws.net/index.php?/runs/view/2897&group_by=cases:section_id&group_order=asc&group_id=2018
Bug Work
- Meta bug
- bug 1268368 - [meta] Fennec Audio Controls Enhancement
10 Total; 0 Open (0%); 5 Resolved (50%); 5 Verified (50%);
- bug 1268367 - [meta] Fennec Audio Controls Enhancement -remote media control and audio competing
| ID | Priority | Summary | Status | Assigned to |
|---|---|---|---|---|
| 1239372 | -- | The tab sound indicator should not be hiding when using mouse clicking to seek the video | VERIFIED | Alastor Wu [:alwu] |
| 1240423 | P2 | Implement the remote media-control on Fennec | RESOLVED | Alastor Wu [:alwu] |
| 1242874 | -- | Enable pause/play control ability for the AudioChannel API | RESOLVED | Alastor Wu [:alwu] |
| 1249579 | P2 | Request audio focus on Fennec | RESOLVED | Alastor Wu [:alwu] |
| 1257738 | P2 | Implement the audio competing mechanism on Fennec | VERIFIED | Alastor Wu [:alwu] |
| 1264901 | -- | Implement the remote media-control front-end | RESOLVED | Sebastian Kaspari (:sebastian; :pocmo) |
| 1287029 | -- | Remote media-control test case | RESOLVED |
7 Total; 0 Open (0%); 5 Resolved (71.43%); 2 Verified (28.57%);
- bug 1290836 - Re-enable media control for all versions
17 Total; 0 Open (0%); 12 Resolved (70.59%); 5 Verified (29.41%);
- bug 1264901 - (fennec-media-control) Implement the remote media-control front-end
20 Total; 0 Open (0%); 12 Resolved (60%); 8 Verified (40%);
Still issues
[NEW] Bug 1302453 - Media notification is out of sync
[NEW] Bug 1303292 - Site icon from media control notification is not displayed on tablets
[NEW] Bug 1278624 - Investigate: Support media notification on devices < lollipop
[NEW] Bug 1278626 - Improve icons of media notification
Bug fixed
[RESOLVED FIXED] Bug 1235612 - Audio indicator/mute button shown for page with no audible sound
[RESOLVED FIXED] Bug 1269672 - Move audible data checking from MDSM to DecodedAudioDataSink
[RESOLVED FIXED] Bug 1290467 - Media control notification is not displayed when no-audio media is playing
[RESOLVED FIXED] Bug 1239372 - The tab sound indicator should not be hiding when using mouse clicking to seek the video
[RESOLVED FIXED] Bug 1240423 - Implement the remote media-control on Fennec
[RESOLVED FIXED] Bug 1249579 - Request audio focus on Fennec
[RESOLVED FIXED] Bug 1257738 - Implement the audio competing mechanism on Fennec
[RESOLVED FIXED] Bug 1287029 - Remote media-control test case
[RESOLVED FIXED] Bug 1290510 - Put media control notification behind a Nightly flag
[RESOLVED FIXED] Bug 1292585 - Media control notification is out of sync
[RESOLVED FIXED] Bug 1285739 - Audio notification will not disappear when playing out Google translation
[RESOLVED FIXED] Bug 1288971 - The icon on the media control is out of sync
[RESOLVED FIXED] Bug 1288972 - The media control is hidden when user set the security to "Hide sensitive notification content"
[RESOLVED FIXED] Bug 1289356 - Media actions are inconsistent after pressing Home
[RESOLVED FIXED] Bug 1290029 - Would be nice to back to the page for the music that you just played after taping the music information field
[RESOLVED FIXED] Bug 1284387 - Video controls aren't removed when tab closed
[RESOLVED FIXED] Bug 1278255 - Action in media notification always has title "Pause"
[RESOLVED FIXED] Bug 1279137 - Update notifications icons for media controls
[RESOLVED FIXED] Bug 1282391 - Cleanup the media controls when the Fennec gets killed
Signoff
Criteria
- All test cases should be executed
- All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed
Results
Nightly testing
- Users can control media content when switching between apps
- Media control notification is displayed with page title, URL, favicon and play/pause button
- The play/pause button from media notification is synced with the play/pause controls from tab
- Tapping on media notification opens the media content in tab
- Media notification from video 1 is changed with media notification from video 2 if the play button from video 2 was tapped
- The media content is paused when user get a call
- The sensitive media is hidden if the user is playing them in private tab
- Media content is paused when another media is on, from another app or browser
- User can swipe the media notification when the media content is paused
Aurora testing
- Users can control media content when switching between apps
- Media control notification is displayed with page title, URL, favicon and play/pause button
- The play/pause button from media notification is synced with the play/pause controls from tab
- Tapping on media notification opens the media content in tab
- Media notification from video 1 is changed with media notification from video 2 if the play button from video 2 was tapped
- The media content is paused when user get a call
- The sensitive media is hidden if the user is playing them in private tab
- Media content is paused when another media is on, from another app or browser
- User can swipe the media notification when the media content is paused
Beta testing
- Users can control media content when switching between apps
- Media control notification is displayed with page title, URL, favicon and play/pause button
- The play/pause button from media notification is synced with the play/pause controls from tab
- Tapping on media notification opens the media content in tab
- Media notification from video 1 is changed with media notification from video 2 if the play button from video 2 was tapped
- The media content is paused when user get a call
- The sensitive media is hidden if the user is playing them in private tab
- Media content is paused when another media is on, from another app or browser
- User can swipe the media notification when the media content is paused
