QA/Fennec/Photon-Mobile-Toolbar
From MozillaWiki
Last updated: 2017/09/15
Approvals Required / Received
The following individuals are required to/have approved this Test Plan:
Name | Title | Department | Approval Date | Method |
---|---|---|---|---|
QA Manager | Product Integrity | Date | ||
Software Engineer | Engineering | Date | ||
EPM | Product Management | Date |
Overview
Purpose
- The purpose of this wiki is to serve as a general test plan for verifying the Android UI for Photon Mobile, on Android devices.
- Only UI changes are made in this feature. The user flows and functionality will not be affected.
- Testing responsibilities will be shared between Ioana Chiorean and Oana Horvath.
- Full UI test cases will be created and executed.
Scope
This wiki details the testing that will be performed by the Fennec QA project team for the Android Photon UI project. It defines the overall testing requirements and provides an integrated view of the project test activities. Its purpose is to document:
- What will be tested
- How testing will be performed
Ownership
- Developer contact:
- QA:
Overall Status
[NOT LANDED] Nightly: n/a
[NOT LANDED] Beta: n/a
Testing Summary
Scope of testing
All Photon-UI related bugs will be covered and verified, on multiple Android devices, with the supported OS.
Environments
Testing will be performed on the following Android devices:
- Phones
- 4.x
- 5.x
- 6.x
- 7.x
- Tablet
- 4.x
- 5.x
- 6.x
- 7.x
Specifications
- bug 1355774 - (meta) Photon Mobile on Firefox for Android
- UX specs: https://drive.google.com/file/d/0B-9PIePlQZRlRTJNZTl0U2ZXM0U/view
- https://docs.google.com/presentation/d/1gLfgorSUiGJn6FDbs0x-s4-oqJctZOyWl7kVQmceR_g/edit#slide=id.p
Acceptance Criteria
- All [Test cases] have passed and all P1 bugs are fixed.
Testing details
Test Cases
Testing days
Date: 08-09-2017
- Test plan creation
- Verified bugs"
- bug 1366661 - (photon) Light Weight Theme with new awesome bar UI
- bug 1366673 - (photon) Tab icon motion for adding a new tab
- bug 1379066 - (photon) Awesome bar basic visual refresh
- bug 1379551 - (photon) - Change tab indicator height
- bug 1378032 - (photon) Disable setTabsCounterPrivateMode in tablet
- bug 1366668 - (photon) Awesome bar visual refresh for tablet
Bug Work
Tracking bugs
- Bugs to track the feature
- Meta bug: bug 1355774 - (meta) Photon Mobile on Firefox for Android
- Meta bug: bug 1379650 - [Meta][Feature] Photon Mobile: TOOLBAR
ID | Priority | Summary | Status | Resolution | Assigned to | Depends on |
---|---|---|---|---|---|---|
1366661 | -- | (photon) Light Weight Theme with new awesome bar UI | VERIFIED | FIXED | Jing-wei Wu [:jwu] | 1389164 |
1366668 | -- | (photon) Awesome bar visual refresh for tablet | VERIFIED | FIXED | Jing-wei Wu [:jwu] | 1378625, 1389051 |
1366673 | -- | (photon) Tab icon motion for adding a new tab | VERIFIED | FIXED | Jing-wei Wu [:jwu] | |
1378032 | -- | (photon) Disable setTabsCounterPrivateMode in tablet | VERIFIED | FIXED | Jing-wei Wu [:jwu] | 1366673 |
1379066 | -- | (photon) Awesome bar basic visual refresh | VERIFIED | FIXED | Julian Chu [:walkingice] | |
1379551 | -- | (photon) - Change tab indicator height | VERIFIED | FIXED | Julian Chu [:walkingice] | |
1389457 | P1 | (photon) On Android 4.4 devices, the private mode tabs counter icon is black | RESOLVED | FIXED | Jing-wei Wu [:jwu] | |
1400164 | P1 | (photon) New tabs open with the close button invisible, on tablets | VERIFIED | FIXED | Jing-wei Wu [:jwu] |
8 Total; 0 Open (0%); 1 Resolved (12.5%); 7 Verified (87.5%);
Signoff
Criteria
- All [Test cases] have passed and all major bugs are fixed.
- All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/RelMan/QA)
Results
Nightly testing
- n/a
- Full Test suite
- Link to TestRail Tests Runs
Beta testing
- n/a
- Full Test suite
- Link to TestRail Tests Runs
Checklist
Exit Criteria | Status | Notes/Details |
---|---|---|
Testing Prerequisites (specs, use cases) | ||
Testing Infrastructure setup | ||
Test Plan Creation | Done | |
Test Cases Creation | In progress | |
Automation Coverage | ||
Performance Testing | ||
All Defects Logged | ||
Critical/Blockers Fixed and Verified | ||
Metrics/Telemetry | ||
Basic/Core functionality Nightly testing | ||
QA mid-Nightly Signoff | Email to be sent | |
QA Nightly - Full Testing | ||
QA pre-Beta Signoff | Email to be sent | |
QA Beta - Full Testing | ||
QA pre-Release Signoff | Email to be sent |