QA/Fennec/Photon-Mobile-Toolbar

From MozillaWiki
< QA‎ | Fennec
Jump to: navigation, search
Last updated: 2017/09/15

Approvals Required / Received

The following individuals are required to/have approved this Test Plan:

Name Title Department Approval Date Method
QA Manager Product Integrity Date Email
Software Engineer Engineering Date Email
EPM Product Management Date Email

Overview

Purpose

  • The purpose of this wiki is to serve as a general test plan for verifying the Android UI for Photon Mobile, on Android devices.
  • Only UI changes are made in this feature. The user flows and functionality will not be affected.
  • Testing responsibilities will be shared between Ioana Chiorean and Oana Horvath.
  • Full UI test cases will be created and executed.

Scope

This wiki details the testing that will be performed by the Fennec QA project team for the Android Photon UI project. It defines the overall testing requirements and provides an integrated view of the project test activities. Its purpose is to document:

  • What will be tested
  • How testing will be performed

Ownership

Overall Status

[NOT LANDED] Nightly: n/a

[NOT LANDED] Beta: n/a

Testing Summary

Scope of testing

All Photon-UI related bugs will be covered and verified, on multiple Android devices, with the supported OS.

Environments

Testing will be performed on the following Android devices:

  • Phones
    • 4.x
    • 5.x
    • 6.x
    • 7.x
  • Tablet
    • 4.x
    • 5.x
    • 6.x
    • 7.x

Specifications

Acceptance Criteria

  • All [Test cases] have passed and all P1 bugs are fixed.

Testing details

Test Cases

Testing days

Date: 08-09-2017

  • Test plan creation
  • Verified bugs"
    • bug 1366661 - (photon) Light Weight Theme with new awesome bar UI
    • bug 1366673 - (photon) Tab icon motion for adding a new tab
    • bug 1379066 - (photon) Awesome bar basic visual refresh
    • bug 1379551 - (photon) - Change tab indicator height
    • bug 1378032 - (photon) Disable setTabsCounterPrivateMode in tablet
    • bug 1366668 - (photon) Awesome bar visual refresh for tablet

Bug Work

Tracking bugs

  • Bugs to track the feature
    • Meta bug: bug 1355774 - (meta) Photon Mobile on Firefox for Android
    • Meta bug: bug 1379650 - [Meta][Feature] Photon Mobile: TOOLBAR
Full Query
ID Priority Summary Status Resolution Assigned to Depends on
1366661 -- (photon) Light Weight Theme with new awesome bar UI VERIFIED FIXED Jing-wei Wu [:jwu] 1389164
1366668 -- (photon) Awesome bar visual refresh for tablet VERIFIED FIXED Jing-wei Wu [:jwu] 1378625, 1389051
1366673 -- (photon) Tab icon motion for adding a new tab VERIFIED FIXED Jing-wei Wu [:jwu]
1378032 -- (photon) Disable setTabsCounterPrivateMode in tablet VERIFIED FIXED Jing-wei Wu [:jwu] 1366673
1379066 -- (photon) Awesome bar basic visual refresh VERIFIED FIXED Julian Chu [:walkingice]
1379551 -- (photon) - Change tab indicator height VERIFIED FIXED Julian Chu [:walkingice]
1389457 P1 (photon) On Android 4.4 devices, the private mode tabs counter icon is black RESOLVED FIXED Jing-wei Wu [:jwu]
1400164 P1 (photon) New tabs open with the close button invisible, on tablets VERIFIED FIXED Jing-wei Wu [:jwu]

8 Total; 0 Open (0%); 1 Resolved (12.5%); 7 Verified (87.5%);


Signoff

Criteria

  • All [Test cases] have passed and all major bugs are fixed.
  • All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/RelMan/QA)

Results

Nightly testing

  • n/a
  • Full Test suite
  • Link to TestRail Tests Runs

Beta testing

  • n/a
  • Full Test suite
  • Link to TestRail Tests Runs

Checklist

Exit Criteria Status Notes/Details
Testing Prerequisites (specs, use cases)
Testing Infrastructure setup
Test Plan Creation Done
Test Cases Creation In progress
Automation Coverage
Performance Testing
All Defects Logged
Critical/Blockers Fixed and Verified
Metrics/Telemetry
Basic/Core functionality Nightly testing
QA mid-Nightly Signoff Email to be sent
QA Nightly - Full Testing
QA pre-Beta Signoff Email to be sent
QA Beta - Full Testing
QA pre-Release Signoff Email to be sent