QA/Fennec/Photon-Mobile-SearchSuggestions

From MozillaWiki
< QA‎ | Fennec
Jump to: navigation, search
Last updated: 2017/09/15

Approvals Required / Received

The following individuals are required to/have approved this Test Plan:

Name Title Department Approval Date Method
QA Manager Product Integrity Date Email
Software Engineer Engineering Date Email
EPM Product Management Date Email

Overview

Purpose

  • The purpose of this wiki is to serve as a general test plan for verifying the Search suggestions component of the Photon UI, on Android devices.
  • Only UI changes are made in this feature. The user flows and functionality will not be affected.
  • Testing responsibilities will be shared between Ioana Chiorean and Oana Horvath.
  • Full UI test cases will be created and executed.

Scope

This wiki details the testing that will be performed by the Fennec QA project team for the Android Photon UI project. It defines the overall testing requirements and provides an integrated view of the project test activities. Its purpose is to document:

  • What will be tested
  • How testing will be performed

Ownership

Overall Status

[LANDED] Nightly 57.0a1

[NOT LANDED] Beta: n/a

Testing Summary

Scope of testing

All Photon-UI related bugs will be covered and verified, on multiple Android devices, with the supported OS.

Environments

Testing will be performed on the following Android devices:

  • Phones
    • 4.x
    • 5.x
    • 6.x
    • 7.x
  • Tablet
    • 4.x
    • 5.x
    • 6.x
    • 7.x

Specifications

Acceptance Criteria

  • All Test cases have passed and all P1 bugs are fixed.

Testing details

Test Cases

Testing days

Date: 08-10-2017

  • Test plan creation
  • Verified bugs
    • bug 1366660 - (photon) Transition for Search suggestion when input keyword into URL bar - fixed
    • bug 1366678 - (photon) Frequency search result visual refresh
    • bug 1366704 - (photon) follow up of search suggestion on the visual refresh of private mode
    • bug 1366679 - (photon) Search Suggestions

Logged bugs:

    • bug 1389054 - Blank white pages when bringing Fennec to foreground - with "Don't keep activities" ON
    • bug 1389092 - (photon) Make site suggestions, history & bookmarks text larger

Bug Work

Tracking bugs

  • Bugs to track the feature
    • Meta bug: bug 1355774 - (meta) Photon Mobile on Firefox for Android
    • Meta bug: bug 1379652 - [Meta][Feature] Photon Mobile: SEARCH SUGGESTION
Full Query
ID Priority Summary Status Resolution Assigned to Depends on
1366660 -- (photon) Transition for Search suggestion when input keyword into URL bar VERIFIED FIXED Jing-wei Wu [:jwu]
1366678 -- (photon) Frequency search result visual refresh VERIFIED FIXED Jing-wei Wu [:jwu] 1401869
1366679 -- (photon) Search Suggestions VERIFIED FIXED Jing-wei Wu [:jwu]
1366704 -- (photon) follow up of search suggestion on the visual refresh of private mode VERIFIED FIXED Jing-wei Wu [:jwu] 1366679
1389092 -- (photon) Make site suggestions, history & bookmarks text larger RESOLVED FIXED Jing-wei Wu [:jwu]

5 Total; 0 Open (0%); 1 Resolved (20%); 4 Verified (80%);


Signoff

Criteria

  • All Test cases have passed and all major bugs are fixed.
  • All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed (as determined by engineering/RelMan/QA)

Results

Nightly testing

  • n/a
  • Full Test suite
  • Link to TestRail Tests Runs

Beta testing

  • n/a
  • Full Test suite
  • Link to TestRail Tests Runs

Checklist

Exit Criteria Status Notes/Details
Testing Prerequisites (specs, use cases)
Testing Infrastructure setup
Test Plan Creation Done
Test Cases Creation In progress
Automation Coverage
Performance Testing
All Defects Logged
Critical/Blockers Fixed and Verified
Metrics/Telemetry
Basic/Core functionality Nightly testing
QA mid-Nightly Signoff Email to be sent
QA Nightly - Full Testing
QA pre-Beta Signoff Email to be sent
QA Beta - Full Testing
QA pre-Release Signoff Email to be sent