QA/Fennec/Re-Organize Menu

From MozillaWiki
< QA‎ | Fennec
Jump to: navigation, search

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that settings menu is reorganized, so it has the same and consistent wording than any feature that is also on Desktop

Ownership

Teodora Vermesan, irc: TeoVermesan

Margaret Leibovic, irc::margaret

Overall Status

[LANDED] Nightly 45: first landed on - 05-11-2015

[LANDED] Aurora 44: first landed on - 15-12-2015

[LANDED] Beta 45 b1: first landed on - 28-01-2016

Testing Summary

Scope

The testing will be focus on

  • verifying that settings sub-menus are re-organized to match desktop

Environments

Testing will be performed on following devices:

  • Phones
    • 2.3.x
    • 4.x
    • 5.x
    • 6.0
  • Tablet
    • 4.x
    • 5.x
    • 6.0

Specifications

  • Reorganize / rework the Settings menu to take into account:
    • latest features / functionality (ensure groupings make sense)
    • scalable to include new partnerships that can 'plug in'
    • enable/ disable new features (like kinderfox, magnification) in an intuitive manner
    • takes into account the re-thinking around privacy settings and how they're presented to the user
  • Based on Gemma's competitive report, we should do the following improvements and quick wins
    • Add Sub-Headings: Unlike Firefox, the three other browsers user sub-headings as way to organize content.
    • Add "Accessibility" to Fennec (but not iOS)
    • Dolphin and Opera offer top-level options to clear private data. Chrome does not offer this option at the top-level. It may help differentiate Firefox as “more private” if we do.
    • The ability to “Clear private data” at the top-level of the settings menu on Firefox for iOS seems more consistent with our brand.
    • Change Sync to Sign-in (to be consistent with iOS and other browsers)
    • Like Chrome and Dolphin, Firefox for iOS offers “Search” choice as a top-level option.
    • Rename "Customize" category to "General"
    • Move "Search" category to top level
    • Rename "Display" category to "Accessibility"
    • Rename "Developer Tools" category to "Advanced"
    • Move "Language" settting to "General" section
    • Move clear private data setting to top level.
    • Move restore tabs pref from to "Advanced".
    • Move tap-to-load images pref from to "Advanced".
    • Move titlebar pref to "General".
    • Move full-screen browsing pref to "General".
    • Rearrange search settings to match spec.
    • Rearrange privacy prefs to match spec.
    • Move data reporting prefs to "Privacy".
    • Move settings items that don't belong elsewhere to "Advanced".
    • Remove disabled tests and associated strings.

User Stories

  • As a user, I want to easily find features, settings and tools I look for
  • As a user, I want to discover new features, settings and tools
  • As Mozilla, I want to have the same and consistent wording than any feature that is also on Desktop

Testing details

Test Cases

Phone

Tablet

Testing Days

Date:04-11-2015

Date:06-11-2015

  • Settings
Screenshot 2015-11-06-11-32-54.png





  • General
Screenshot 2015-11-06-11-33-01.png





  • Search
Screenshot 2015-11-06-11-33-26.png





Screenshot 2015-11-06-11-33-30.png





  • Privacy
Screenshot 2015-11-06-11-34-00.png





Screenshot 2015-11-06-11-34-04.png





  • Accessibility
Screenshot 2015-11-06-11-34-10.png





  • Advanced
Screenshot 2015-11-26-14-23-04.png





Screenshot 2015-11-06-11-34-32.png





  • Clear Private Data now
Screenshot 2015-11-06-11-34-53.png





  • Mozilla
Screenshot 2015-11-06-11-34-58.png





Date:12-11-2015

Date:13-11-2015

Date:26-11-2015

Phone

  • Settings
Screenshot 2015-11-26-14-21-19.png





  • General
Screenshot 2015-11-26-14-21-25.png





  • Search
Screenshot 2015-11-06-11-33-26.png





Screenshot 2015-11-26-14-24-28.png





  • Privacy
Screenshot 2015-11-26-14-24-34.png





Screenshot 2015-11-26-14-39-00.png





  • Accessibility
Screenshot 2015-11-06-11-34-10.png





  • Advanced
Screenshot 2015-11-26-14-23-04.png





Screenshot 2015-11-26-14-32-57.png





  • Clear Private Data
Screenshot 2015-12-21-17-15-00.png





  • Mozilla
Screenshot 2015-11-06-11-34-58.png





Tablet

  • General
Screenshot 2015-11-26-14-56-10.png





  • Search
Screenshot 2015-11-26-14-56-22.png





Screenshot 2015-11-26-14-56-25.png





  • Privacy
Screenshot 2015-11-26-14-56-33.png





Screenshot 2015-11-26-14-56-37.png





  • Accessibility
Screenshot 2015-11-26-14-56-42.png





  • Advanced
Screenshot 2015-11-26-14-56-49.png





  • Mozilla
Screenshot 2015-11-26-14-56-53.png





Date:27-11-2015

Gingerbread

  • Settings
Device-2015-11-27-161825.png





  • General
Device-2015-11-27-161835.png





  • Search
Device-2015-11-27-161843.png





Device-2015-11-27-161849.png





  • Privacy
Device-2015-11-27-161858.png





Device-2015-11-27-161931.png





  • Accessibility
Device-2015-11-27-161945.png





  • Advanced
Device-2015-11-27-162001.png





  • Clear Private Data
Device-2015-11-27-162008.png





  • Mozilla
Device-2015-11-27-162016.png





Date:08-12-2015

  • Move "Clear private data now" option from General submenu on Tablet
Screenshot 2015-12-07-15-44-28.png





Date:21-12-2015

Aurora

  • Settings
Screenshot 2015-12-21-15-48-05.png





  • General
Screenshot 2015-12-21-15-48-13.png





  • Search
Screenshot 2015-12-21-15-49-27.png





Screenshot 2015-12-21-15-49-35.png





  • Privacy
Screenshot 2015-12-21-15-49-44.png





Screenshot 2015-12-21-15-49-52.png





  • Accessibility
Screenshot 2015-12-21-15-50-12.png





  • Advanced
Screenshot 2015-12-21-15-50-20.png





Screenshot 2015-12-21-15-50-29.png





  • Clear Private Data
Screenshot 2015-12-21-15-50-40.png





  • Mozilla
Screenshot 2015-12-21-15-50-51.png





Nightly

Screenshot 2015-11-26-14-21-19.png





  • General
Screenshot 2015-12-21-17-13-55.png





  • Search
Screenshot 2015-11-06-11-33-26.png





Screenshot 2015-11-26-14-24-28.png





  • Privacy
Screenshot 2015-11-26-14-24-34.png





Screenshot 2015-11-26-14-39-00.png





  • Accessibility
Screenshot 2015-11-06-11-34-10.png





  • Advanced
Screenshot 2015-11-26-14-23-04.png





Screenshot 2015-11-26-14-32-57.png





  • Clear Private Data
Screenshot 2015-12-21-17-15-00.png





  • Mozilla
Screenshot 2015-11-06-11-34-58.png





Date:13-01-2016

Aurora

  • Settings
Screenshot 2015-12-21-15-48-05.png





  • General
Screenshot 2015-12-21-15-48-13.png





  • Search
Screenshot 2015-12-21-15-49-27.png





Screenshot 2015-12-21-15-49-35.png





  • Privacy
Screenshot 2015-12-21-15-49-44.png





Screenshot 2015-12-21-15-49-52.png





  • Accessibility
Screenshot 2015-12-21-15-50-12.png





  • Advanced
Screenshot 2016-01-13-12-39-31.png





Screenshot 2016-01-13-12-39-46.png





  • Clear Private Data
Screenshot 2015-12-21-15-50-40.png





  • Mozilla
Screenshot 2015-12-21-15-50-51.png





Nightly

Screenshot 2015-11-26-14-21-19.png





  • General
Screenshot 2015-12-21-17-13-55.png





  • Search
Screenshot 2015-11-06-11-33-26.png





Screenshot 2015-11-26-14-24-28.png





  • Privacy
Screenshot 2015-11-26-14-24-34.png





Screenshot 2015-11-26-14-39-00.png





  • Accessibility
Screenshot 2015-11-06-11-34-10.png





  • Advanced
Screenshot 2015-11-26-14-23-04.png





Screenshot 2015-11-26-14-32-57.png





  • Clear Private Data
Screenshot 2016-01-13-12-36-49.png





  • Mozilla
Screenshot 2015-11-06-11-34-58.png





Date:01-02-2016

Beta

  • Settings
Screenshot 20160201-110218.png





  • General
Screenshot 20160201-110228.png





  • Search
Screenshot 20160201-110236.png





Screenshot 20160201-110240.png





  • Privacy
Screenshot 20160201-110254.png





Screenshot 2015-12-21-15-49-52.png





  • Accessibility
Screenshot 20160201-110311.png





  • Advanced
Screenshot 20160201-110335.png





  • Clear Private Data
Screenshot 20160201-110343.png





  • Mozilla
Screenshot 20160201-110348.png





Aurora

  • Settings
Screenshot 2015-12-21-15-48-05.png





  • General
Screenshot 2015-12-21-15-48-13.png





  • Search
Screenshot 2015-12-21-15-49-27.png





Screenshot 2015-11-26-14-24-28.png





  • Privacy
Screenshot 2015-12-21-15-49-44.png





Screenshot 2015-12-21-15-49-52.png





  • Accessibility
Screenshot 2015-12-21-15-50-12.png





  • Advanced
Screenshot 2016-01-13-12-39-31.png





Screenshot 2016-01-13-12-39-46.png





  • Clear Private Data
Screenshot 2016-01-13-12-36-49.png





  • Mozilla
Screenshot 2015-12-21-15-50-51.png





Nightly

Screenshot 2015-11-26-14-21-19.png





  • General
Screenshot 2015-12-21-17-13-55.png





  • Search
Screenshot 2015-11-06-11-33-26.png





Screenshot 2015-11-26-14-24-28.png





  • Privacy
Screenshot 2015-11-26-14-24-34.png





Screenshot 2015-11-26-14-39-00.png





  • Accessibility
Screenshot 2015-11-06-11-34-10.png





  • Advanced
Screenshot 2015-11-26-14-23-04.png





Screenshot 2015-11-26-14-32-57.png





  • Clear Private Data
Screenshot 2016-01-13-12-36-49.png





  • Mozilla
Screenshot 2015-11-06-11-34-58.png





Bug work

Bug tracking

  • bugs to track the updates for re-organizing menu

ex:

Full Query
ID Summary Priority Status
1217073 Update restricted profile toggles to account for new settings organization -- RESOLVED
1220829 Don't create settings sub-page for language -- RESOLVED
1220833 Update data reporting notification to point to privacy preference screen -- VERIFIED
1221534 Move "Clear private data now" option from General submenu on Tablet -- RESOLVED
1221559 Link "Choose what to share" to Privacy sub-menu -- RESOLVED
1221679 Changing language on phone will update language settings page title with "General" -- RESOLVED

6 Total; 0 Open (0%); 5 Resolved (83.33%); 1 Verified (16.67%);


Issues

  • no issues

Bug fixed

[RESOLVED FIXED] Bug 1217073 - Update restricted profile toggles to account for new settings organization
[RESOLVED FIXED] Bug 1220833 - Update data reporting notification to point to privacy preference screen

↳ 2015-11-11 : verified fixed on Nightly 45.0a1 (2015-11-10) using Nexus 9 (Android 6.0) and Xiaomi Mi i4 (Android 5.0.2)

[RESOLVED FIXED] Bug 1221679 - Changing language on phone will update language settings page title with "General"
[RESOLVED FIXED] Bug 1224197 - Link "Change" button from about:telemetry to Privacy sub-menu
[RESOLVED FIXED] Bug 1221534 - Move "Clear private data now" option from General submenu on Tablet

↳ 2015-12-07 : verified fixed on Firefox for Android 45.0a1 (2015-12-06) using Sony Xperia Z2 (Android 5.0.2)

[RESOLVED FIXED] Bug 1226130 - "Clear private data on exit" option is visible in restricted profile

↳ 2016-01-07 : verified fixed on Aurora build (45.0a2 07-01-2016), on a Samsung Galaxy Tab S2 (Android 5.0.2)

Sign off

Criteria

  • All test cases should be executed
  • All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed

Results

Nightly testing

  • There were no blockers found while testing this feature.
  • All bugs are fixed and verified
  • Settings menu is reorganized

Aurora testing

  • There were no blockers found while testing this feature.
  • All bugs are fixed and verified
  • Settings menu is reorganized

Beta testing

  • There were no blockers found while testing this feature.
  • All bugs are fixed and verified
  • Settings menu is reorganized
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Fennec/Re-Organize_Menu&oldid=1115205"