QA/Fennec/Photon-Mobile-Miscellaneous
From MozillaWiki
Last updated: 2017/09/15
Approvals Required / Received
The following individuals are required to/have approved this Test Plan:
| Name | Title | Department | Approval Date | Method |
|---|---|---|---|---|
| QA Manager | Product Integrity | Date | ||
| Software Engineer | Engineering | Date | ||
| EPM | Product Management | Date |
Overview
Purpose
- The purpose of this wiki is to serve as a general test plan for verifying the Search suggestions component of the Photon UI, on Android devices.
- Only UI changes are made in this feature. The user flows and functionality will not be affected.
- Testing responsibilities will be shared between Ioana Chiorean and Oana Horvath.
- Full UI test cases will be created and executed.
Scope
This wiki details the testing that will be performed by the Fennec QA project team for the Android Photon UI project. It defines the overall testing requirements and provides an integrated view of the project test activities. Its purpose is to document:
- What will be tested
- How testing will be performed
Ownership
- Developer contact:
- QA:
Overall Status
[LANDED] Nightly 57.0a1
[NOT LANDED] Beta: n/a
Testing Summary
Scope of testing
All Photon-UI related bugs will be covered and verified, on multiple Android devices, with the supported OS.
Environments
Testing will be performed on the following Android devices:
- Phones
- 4.x
- 5.x
- 6.x
- 7.x
- Tablet
- 4.x
- 5.x
- 6.x
- 7.x
Specifications
- bug 1355774 - (meta) Photon Mobile on Firefox for Android
- UX specs: https://drive.google.com/file/d/0B-9PIePlQZRlRTJNZTl0U2ZXM0U/view
- https://docs.google.com/presentation/d/1gLfgorSUiGJn6FDbs0x-s4-oqJctZOyWl7kVQmceR_g/edit#slide=id.p
Acceptance Criteria
- All Test cases have passed and all P1 bugs are fixed.
Testing details
Test Cases
Testing days
Date: 08-14-2017
- Test plan creation
- Bugs Verified:
- bug 1366659 - (Photon) Follow iOS private tab interaction design
- bug 1366703 - (Photon) Follow up of private tab visual refresh
Date: 08-23-2017
- Verified bug:
- bug 1387349 - (photon) follow up with icons update
- Logged bugs:
- bug 1393072 - (photon) Small tablets: in private mode, the bookmark & share icons are not visible
- bug 1393082 - Top sites thumbnails would look better if they fit on one row
- bug 1393084 - (photon) Page text selection handlers should be updated
Date: 08-25-2017
- Verified:
- bug 1388554 - "Recently Closed" History panel icon is cropped
- bug 1388556 - Extra space above "Desktop Bookmarks" folder in Bookmarks home panel
- bug 1389342 - Weird alignment of device icons in Synced History
- bug 1376995 - (photon) Update status bar color while switching between normal mode and private mode
- bug 1390791 - (photon) Adjust text size in tab counter dynamically
- bug 1391160 - (photon) Status bar icons are invisible after back from fullscreen mode
- Logged bug:
- bug 1393754 - (photon) Status bar color does not change on all devices
Date: 08-31-2017
- Verified bugs:
- bug 1389164 - [photon] Light text in toolbar is unreadable when using dark lightweight theme on Android
- bug 1391160 - (photon) Status bar icons are invisible after back from fullscreen mode
- bug 1390735 - (photon) Support tint color for PageAction icon
- bug 1394361 - (photon) tab title is cropped and not align to close button
- NI: bug 1393754 - (photon) Status bar color does not change on all devices
Date: 09-04-2017
Verified:
- bug 1393084 - (photon) Page text selection handlers should be updated
- bug 1394310 - (photon) Change primary color from orange to blue
- bug 1387349 - (photon) follow up with icons update
Bug Work
Tracking bugs
- Bugs to track the feature
- Meta bug: bug 1355774 - (meta) Photon Mobile on Firefox for Android
- Meta bug: bug 1379658 - [Meta] Photon Mobile: Misc. UI Refresh
33 Total; 0 Open (0%); 8 Resolved (24.24%); 25 Verified (75.76%);
Signoff
Criteria
- All Test cases have passed and all major bugs are fixed.
- All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/RelMan/QA)
Results
Nightly testing
- n/a
- Full Test suite
- Link to TestRail Tests Runs
Beta testing
- n/a
- Full Test suite
- Link to TestRail Tests Runs
Checklist
| Exit Criteria | Status | Notes/Details |
|---|---|---|
| Testing Prerequisites (specs, use cases) | ||
| Testing Infrastructure setup | ||
| Test Plan Creation | Done | |
| Test Cases Creation | In progress | |
| Automation Coverage | ||
| Performance Testing | ||
| All Defects Logged | ||
| Critical/Blockers Fixed and Verified | ||
| Metrics/Telemetry | ||
| Basic/Core functionality Nightly testing | ||
| QA mid-Nightly Signoff | Email to be sent | |
| QA Nightly - Full Testing | ||
| QA pre-Beta Signoff | Email to be sent | |
| QA Beta - Full Testing | ||
| QA pre-Release Signoff | Email to be sent |
