QA/Fennec/Photon-Mobile-SearchSuggestions
From MozillaWiki
Last updated: 2017/09/15
Approvals Required / Received
The following individuals are required to/have approved this Test Plan:
Name | Title | Department | Approval Date | Method |
---|---|---|---|---|
QA Manager | Product Integrity | Date | ||
Software Engineer | Engineering | Date | ||
EPM | Product Management | Date |
Overview
Purpose
- The purpose of this wiki is to serve as a general test plan for verifying the Search suggestions component of the Photon UI, on Android devices.
- Only UI changes are made in this feature. The user flows and functionality will not be affected.
- Testing responsibilities will be shared between Ioana Chiorean and Oana Horvath.
- Full UI test cases will be created and executed.
Scope
This wiki details the testing that will be performed by the Fennec QA project team for the Android Photon UI project. It defines the overall testing requirements and provides an integrated view of the project test activities. Its purpose is to document:
- What will be tested
- How testing will be performed
Ownership
- Developer contact:
- QA:
Overall Status
[LANDED] Nightly 57.0a1
[NOT LANDED] Beta: n/a
Testing Summary
Scope of testing
All Photon-UI related bugs will be covered and verified, on multiple Android devices, with the supported OS.
Environments
Testing will be performed on the following Android devices:
- Phones
- 4.x
- 5.x
- 6.x
- 7.x
- Tablet
- 4.x
- 5.x
- 6.x
- 7.x
Specifications
- bug 1355774 - (meta) Photon Mobile on Firefox for Android
- UX specs: https://drive.google.com/file/d/0B-9PIePlQZRlRTJNZTl0U2ZXM0U/view
- https://docs.google.com/presentation/d/1gLfgorSUiGJn6FDbs0x-s4-oqJctZOyWl7kVQmceR_g/edit#slide=id.p
Acceptance Criteria
- All Test cases have passed and all P1 bugs are fixed.
Testing details
Test Cases
Testing days
Date: 08-10-2017
- Test plan creation
- Verified bugs
- bug 1366660 - (photon) Transition for Search suggestion when input keyword into URL bar - fixed
- bug 1366678 - (photon) Frequency search result visual refresh
- bug 1366704 - (photon) follow up of search suggestion on the visual refresh of private mode
- bug 1366679 - (photon) Search Suggestions
Logged bugs:
- bug 1389054 - Blank white pages when bringing Fennec to foreground - with "Don't keep activities" ON
- bug 1389092 - (photon) Make site suggestions, history & bookmarks text larger
Bug Work
Tracking bugs
- Bugs to track the feature
- Meta bug: bug 1355774 - (meta) Photon Mobile on Firefox for Android
- Meta bug: bug 1379652 - [Meta][Feature] Photon Mobile: SEARCH SUGGESTION
ID | Priority | Summary | Status | Resolution | Assigned to | Depends on |
---|---|---|---|---|---|---|
1366660 | -- | (photon) Transition for Search suggestion when input keyword into URL bar | VERIFIED | FIXED | Jing-wei Wu [:jwu] | |
1366678 | -- | (photon) Frequency search result visual refresh | VERIFIED | FIXED | Jing-wei Wu [:jwu] | 1401869 |
1366679 | -- | (photon) Search Suggestions | VERIFIED | FIXED | Jing-wei Wu [:jwu] | |
1366704 | -- | (photon) follow up of search suggestion on the visual refresh of private mode | VERIFIED | FIXED | Jing-wei Wu [:jwu] | 1366679 |
1389092 | -- | (photon) Make site suggestions, history & bookmarks text larger | RESOLVED | FIXED | Jing-wei Wu [:jwu] |
5 Total; 0 Open (0%); 1 Resolved (20%); 4 Verified (80%);
Signoff
Criteria
- All Test cases have passed and all major bugs are fixed.
- All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/RelMan/QA)
Results
Nightly testing
- n/a
- Full Test suite
- Link to TestRail Tests Runs
Beta testing
- n/a
- Full Test suite
- Link to TestRail Tests Runs
Checklist
Exit Criteria | Status | Notes/Details |
---|---|---|
Testing Prerequisites (specs, use cases) | ||
Testing Infrastructure setup | ||
Test Plan Creation | Done | |
Test Cases Creation | In progress | |
Automation Coverage | ||
Performance Testing | ||
All Defects Logged | ||
Critical/Blockers Fixed and Verified | ||
Metrics/Telemetry | ||
Basic/Core functionality Nightly testing | ||
QA mid-Nightly Signoff | Email to be sent | |
QA Nightly - Full Testing | ||
QA pre-Beta Signoff | Email to be sent | |
QA Beta - Full Testing | ||
QA pre-Release Signoff | Email to be sent |