QA/Fennec/Re-Organize Menu

From MozillaWiki
Jump to navigation Jump to search

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for verifying that settings menu is reorganized, so it has the same and consistent wording than any feature that is also on Desktop

Scope

The testing will be focus on

  • verifying that settings sub-menus are re-organized to match desktop

Ownership

Teodora Vermesan, irc: TeoVermesan

Margaret Leibovic, irc::margaret

Overal Status

[LANDED] Nightly 45: first landed on - 05-11-2015

[NOT LANDED] Aurora 42:

[NOT LANDED] Beta 43:

Testing Summary

Environments

Testing will be performed on following devices:

  • Phones
    • 2.3.x
    • 4.x
    • 5.x
    • 6.0
  • Tablet
    • 4.x
    • 5.x
    • 6.0

Specifications

  • Reorganize / rework the Settings menu to take into account:
    • latest features / functionality (ensure groupings make sense)
    • scalable to include new partnerships that can 'plug in'
    • enable/ disable new features (like kinderfox, magnification) in an intuitive manner
    • takes into account the re-thinking around privacy settings and how they're presented to the user
  • Based on Gemma's competitive report, we should do the following improvements and quick wins
    • Add Sub-Headings: Unlike Firefox, the three other browsers user sub-headings as way to organize content.
    • Add "Accessibility" to Fennec (but not iOS)
    • Dolphin and Opera offer top-level options to clear private data. Chrome does not offer this option at the top-level. It may help differentiate Firefox as “more private” if we do.
    • The ability to “Clear private data” at the top-level of the settings menu on Firefox for iOS seems more consistent with our brand.
    • Change Sync to Sign-in (to be consistent with iOS and other browsers)
    • Like Chrome and Dolphin, Firefox for iOS offers “Search” choice as a top-level option.
    • Rename "Customize" category to "General"
    • Move "Search" category to top level
    • Rename "Display" category to "Accessibility"
    • Rename "Developer Tools" category to "Advanced"
    • Move "Language" settting to "General" section
    • Move clear private data setting to top level.
    • Move restore tabs pref from to "Advanced".
    • Move tap-to-load images pref from to "Advanced".
    • Move titlebar pref to "General".
    • Move full-screen browsing pref to "General".
    • Rearrange search settings to match spec.
    • Rearrange privacy prefs to match spec.
    • Move data reporting prefs to "Privacy".
    • Move settings items that don't belong elsewhere to "Advanced".
    • Remove disabled tests and associated strings.

User Stories

  • As a user, I want to easily find features, settings and tools I look for
  • As a user, I want to discover new features, settings and tools
  • As Mozilla, I want to have the same and consistent wording than any feature that is also on Desktop

Testing details

Date

Date:04-11-2015

Date:06-11-2015

  • Settings
Screenshot 2015-11-06-11-32-54.png





  • General
Screenshot 2015-11-06-11-33-01.png





  • Search
Screenshot 2015-11-06-11-33-26.png





Screenshot 2015-11-06-11-33-30.png





  • Privacy
Screenshot 2015-11-06-11-34-00.png





Screenshot 2015-11-06-11-34-04.png





  • Accessibility
Screenshot 2015-11-06-11-34-10.png





  • Advanced
Screenshot 2015-11-26-14-23-04.png





Screenshot 2015-11-06-11-34-32.png





  • Clear Private Data now
Screenshot 2015-11-06-11-34-53.png





  • Mozilla
Screenshot 2015-11-06-11-34-58.png





Date:12-11-2015

Date:13-11-2015

Date:26-11-2015

Phone

  • Settings
Screenshot 2015-11-26-14-21-19.png





  • General
Screenshot 2015-11-26-14-21-25.png





  • Search
Screenshot 2015-11-06-11-33-26.png





Screenshot 2015-11-26-14-24-28.png





  • Privacy
Screenshot 2015-11-26-14-24-34.png





Screenshot 2015-11-26-14-39-00.png





  • Accessibility
Screenshot 2015-11-06-11-34-10.png





  • Advanced
Screenshot 2015-11-26-14-23-04.png





Screenshot 2015-11-26-14-32-57.png





  • Clear Private Data
Screenshot 2015-11-26-14-23-25.png





  • Mozilla
Screenshot 2015-11-06-11-34-58.png





Tablet

  • General
Screenshot 2015-11-26-14-56-10.png





  • Search
Screenshot 2015-11-26-14-56-22.png





Screenshot 2015-11-26-14-56-25.png





  • Privacy
Screenshot 2015-11-26-14-56-33.png





Screenshot 2015-11-26-14-56-37.png





  • Accessibility
Screenshot 2015-11-26-14-56-42.png





  • Advanced
Screenshot 2015-11-26-14-56-49.png





  • Mozilla
Screenshot 2015-11-26-14-56-53.png





Bug tracking

  • bugs to track the updates for opening external links in Private Browsing

ex:

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 429 [1] => Unknown Error ) ) 1


Bug work

Still Issues

[NEW] Bug 1221534 - Move "Clear private data now" option from General submenu on Tablet
[NEW] Bug 1226130 - "Clear private data on exit" option is visible in restricted profile


Bug fixed

[RESOLVED FIXED] Bug 1217073 - Update restricted profile toggles to account for new settings organization
[RESOLVED FIXED] Bug 1220833 - Update data reporting notification to point to privacy preference screen
[RESOLVED FIXED] Bug 1221679 - Changing language on phone will update language settings page title with "General"
[RESOLVED FIXED] Bug 1224197 - Link "Change" button from about:telemetry to Privacy sub-menu

Sign off

Criteria

  • All test cases should be executed
  • All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed


Results

Nightly testing

  • There were no blockers found while testing this feature.
  • Issues"
    • Move "Clear private data now" option from General submenu on Tablet
    • "Clear private data on exit" option is visible in restricted profile

Aurora testing NA

Beta testing NA