QA/Fennec/Estimated Reading Time
From MozillaWiki
Last updated: 2017/03/30
Overview
Purpose
The purpose of this wiki is to serve as a general test plan for verifying that users can see the articles estimated reading time in Reader mode.
Ownership
Developer contact:
Overall Status
[LANDED] Nightly: 2016-12-13
[LANDED] Aurora: 2017-01-28
[LANDED] Beta: 2017-03-08
Testing Summary
Timeline
- Priority 1
- bug 1265304 - Display estimated reading time in Reader Mode
- bug 1318605 - Do language detection for cases where we don't obtain a dir attribute
- bug 1323415 - Use plural form for reader mode article reading time strings
- bug 1323331 - Refactor AboutReader to remove the promise based language resolution supplied to NarrateControls
Scope of testing
The testing will focus on verifying the Reader Mode now displays the estimated reading time for the page, using orientation and language according with the page language detected.
Environments
Testing will be performed on following devices:
- Phones
- 4.x
- 5.x
- 6.x
- Tablet
- 4.x
- 5.x
- 6.0
- 7.0
Languages covered
- First run - Fennec 53 Aurora
- English US
- Hebrew - עברית
- Arabic - العامية
- Persian - Farsi - فارسی
- Urdu - اُردُو
- Uyghur - ئۇيغۇر
Specifications
- bug 1265304 - Display estimated reading time in Reader Mode
- To calculate the average reading time for each language, uses upper and lower bounds found in this study: http://iovs.arvojournals.org/article.aspx?articleid=2166061
User stories
- As a user, I want to know how long would take to read a text, without scrolling down the page to form an idea.
Acceptance Criteria
- All Test cases have passed.
Testing details
Test Cases
- TestRail - Estimated Reading Time test cases
- https://docs.google.com/spreadsheets/d/1tQIBQtGVcYSBZIxWT6WcjqtWUy_cIU7x8jhezDB1KD8/edit#gid=0
Testing days
Date:02-13-2017
- Created Test Plan
- Created Test Cases
Date:02-15-2017
- Testing on latest Aurora 53.0a2 on the following devices:
- LG G4 (Android 6.0)
- Lenovo A536 (Android 4.4.2)
- Asus Transformers Pad TF300T (Android 4.2.1)
- Asus ZenPad 8.0 Z380KL (Android 6.0.1)
Date:02-20-2017
- Testing on latest Aurora 53.0a2 on the following devices:
- Huawei MediaPad M2 (Android 5.1.1)
- HTC Nexus 9 (Android 7.1.1)
- Verified bugs:
- bug 1323415 - Use plural form for reader mode article reading time strings
- bug 1318605 - Do language detection for cases where we don't obtain a dir attribute
Date:02-21-2017
- Added test cases in TestRail
- Exploratory testing on Aurora 53.0a2
Date:03-13-2017
- Testing on latest Beta 53.0b1 on the following devices:
- Prestigio Grace X5 (Android 4.4.2)
- Samsung Galaxy Note 4 (Android 5.0.1)
- LG G4 (Android 6.0)
- Asus ZenPad 8.0 Z380KL (Android 6.0.1)
- HTC Nexus 9 (Android 7.1.1)
- Lenovo Yoga Tablet 2 (Android 4.4.2)
Bug Work
Tracking bugs
- bugs to track the feature
ex:
7 Total; 1 Open (14.29%); 3 Resolved (42.86%); 3 Verified (42.86%);
Signoff
Criteria
- All Test cases have passed.
Results
Nightly testing
- NA
Aurora testing
- All tests have passed on Aurora 53.0a2. No new/known issues found while testing this feature.
Beta testing
- All tests have passed on Beta 53.0b1. No new/known issues found while testing this feature.