QA/Fennec/Photon-Mobile-Onboarding
From MozillaWiki
Last updated: 2017/09/15
Approvals Required / Received
The following individuals are required to/have approved this Test Plan:
Name | Title | Department | Approval Date | Method |
---|---|---|---|---|
QA Manager | Product Integrity | Date | ||
Software Engineer | Engineering | Date | ||
EPM | Product Management | Date |
Overview
Purpose
- The purpose of this wiki is to serve as a general test plan for verifying the Search suggestions component of the Photon UI, on Android devices.
- Only UI changes are made in this feature. The user flows and functionality will not be affected.
- Testing responsibilities will be shared between Ioana Chiorean and Oana Horvath.
- Full UI test cases will be created and executed.
Scope
This wiki details the testing that will be performed by the Fennec QA project team for the Android Photon UI project. It defines the overall testing requirements and provides an integrated view of the project test activities. Its purpose is to document:
- What will be tested
- How testing will be performed
Ownership
- Developer contact:
- QA:
Overall Status
[LANDED] Nightly 57.0a1
[NOT LANDED] Beta: n/a
Testing Summary
Scope of testing
All Photon-UI related bugs will be covered and verified, on multiple Android devices, with the supported OS.
Environments
Testing will be performed on the following Android devices:
- Phones
- 4.x
- 5.x
- 6.x
- 7.x
- Tablet
- 4.x
- 5.x
- 6.x
- 7.x
Specifications
- bug 1355774 - (meta) Photon Mobile on Firefox for Android
- Onboarding Visual spec: https://drive.google.com/open?id=0B-9PIePlQZRldUpRZHBWbWtlbGs
- Onboarding copy: https://docs.google.com/a/mozilla.com/document/d/1SLT0L0OfxH5_niMARMxfY7PzfsfmuhVWTG9WmTEb-7o/edit?usp=sharing
- Onboarding UX spec: https://mozilla.invisionapp.com/share/S2CX2JKQA
Acceptance Criteria
- All Test cases have passed and all P1 bugs are fixed.
Testing details
Test Cases
Testing days
Date: 08-14-2017
- Test plan creation
Date: 08-24-2017
- Testing overall functionality on different devices
- Logged bugs:
- bug 1393425 - (photon) - Make scrollbar invisible for Welcome Screen
- bug 1393426 - (photon) Scrolling in welcome screen is jumpy
Bug Work
Tracking bugs
- Bugs to track the feature
- Meta bug: bug 1355774 - (meta) Photon Mobile on Firefox for Android
- Meta bug: bug 1366664 - (photon) (baseline) New onboarding experience to reflect the new look
No results.
0 Total; 0 Open (0%); 0 Resolved (0%); 0 Verified (0%);
Signoff
Criteria
- All Test cases have passed and all major bugs are fixed.
- All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/RelMan/QA)
Results
Nightly testing
- n/a
- Full Test suite
- Link to TestRail Tests Runs
Beta testing
- n/a
- Full Test suite
- Link to TestRail Tests Runs
Checklist
Exit Criteria | Status | Notes/Details |
---|---|---|
Testing Prerequisites (specs, use cases) | ||
Testing Infrastructure setup | ||
Test Plan Creation | Done | |
Test Cases Creation | In progress | |
Automation Coverage | ||
Performance Testing | ||
All Defects Logged | ||
Critical/Blockers Fixed and Verified | ||
Metrics/Telemetry | ||
Basic/Core functionality Nightly testing | ||
QA mid-Nightly Signoff | Email to be sent | |
QA Nightly - Full Testing | ||
QA pre-Beta Signoff | Email to be sent | |
QA Beta - Full Testing | ||
QA pre-Release Signoff | Email to be sent |