Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that users can see the articles estimated reading time in Reader mode.

Ownership

Developer contact: fiveNinePlusR@gmail.com

QA: Timea Zsoldos (:zs_timi)

Overall Status

[LANDED] Nightly: 2016-12-13

[LANDED] Aurora: 2017-01-28

[LANDED] Beta: 2017-03-07

Testing Summary

Timeline

• Priority 1
  • bug 1265304 - Display estimated reading time in Reader Mode

Scope of testing

The testing will focus on verifying the Reader Mode now displays the estimated reading time for the page, using orientation and language according with the page language detected.

Environments

Testing will be performed on following systems:

• Windows 10 32-bit
• Windows 8.1 64-bit
• Ubuntu 16.04 64-bit
• Mac OS X 10.11

Languages covered

• First run - 53 Aurora
  • English US
  • Hebrew - עברית‎
  • Arabic - العامية
  • Persian - Farsi - فارسی

Specifications

• bug 1265304 - Display estimated reading time in Reader Mode
• To calculate the average reading time for each language, uses upper and lower bounds found in this study: http://iovs.arvojournals.org/article.aspx?articleid=2166061

User stories

• As a user, I want to know how long would take to read a text, without scrolling down the page to form an idea.

Acceptance Criteria

• All Test cases have passed.

Testing details

Test Cases

• TestRail - Estimated Reading Time test cases
• https://docs.google.com/spreadsheets/d/1VpQsGr2F3cddXyvzaXLyklTeDzGgzpIp9mH783VlA0I/edit#gid=0

Testing days

Date: 02-23-2017

• Created Test Plan
• Created Test Cases

Date: 02-27-2017

• Testing on latest Aurora 53.0a2 on the following systems:
  • Windows 8.1 x64
  • Mac OS X 10.11

Date: 02-28-2017

• Testing on latest Aurora 53.0a2 on the following systems:
  • Ubuntu 16.04 x64
  • Mac OS X 10.11

Date: 03-02-2017

• Testing on latest Aurora 53.0a2 on the following system:
  • Windows 10 x86

Date: 03-29-2017

• Testing on 53.0b7 on the following system:
  • Windows 8.1 x64
  • Ubuntu 14.04 x64
  • Mac OS X 10.11

• Verified bugs:
  • bug 1265304 - Display estimated reading time in Reader Mode

Results

Nightly testing

• NA

Aurora testing

• New issue found while testing this feature:

Full Query

ID	Summary	Priority	Status
1340502	Pageshow no longer fires with persisted=true when restoring wikipedia from history (Reader Mode icon in URL-bar is not displayed when close the reader mode view on wikipedia)	P2	RESOLVED

1 Total; 0 Open (0%); 1 Resolved (100%); 0 Verified (0%);

Beta testing

• NA

Bug Work

Tracking bugs

• bugs to track the feature

ex:

Full Query

ID	Summary	Priority	Status
1265304	Display estimated reading time in Reader Mode	P5	VERIFIED

1 Total; 0 Open (0%); 0 Resolved (0%); 1 Verified (100%);

Signoff

Criteria

• All Test cases have passed.

Results

Nightly testing

• NA

Aurora testing

• Tested using latest Aurora across platforms.
• Test results: https://testrail.stage.mozaws.net/index.php?/plans/view/2826

Beta testing

• Tested using 53.0b7 across platforms.
• Test results: https://testrail.stage.mozaws.net/index.php?/plans/view/3383