Overview
Purpose
The purpose of this wiki is to serve as a general test plan for verifying that settings menu is reorganized, so it has the same and consistent wording than any feature that is also on Desktop
Scope
The testing will be focus on
- verifying that settings sub-menus are re-organized to match desktop
Ownership
Teodora Vermesan, irc: TeoVermesan
Margaret Leibovic, irc::margaret
Overal Status
[LANDED] Nightly 45: first landed on - 05-11-2015
[NOT LANDED] Aurora 42:
[NOT LANDED] Beta 43:
Testing Summary
Environments
Testing will be performed on following devices:
- Phones
- 2.3.x
- 4.x
- 5.x
- 6.0
- Tablet
- 4.x
- 5.x
- 6.0
Specifications
- Reorganize / rework the Settings menu to take into account:
- latest features / functionality (ensure groupings make sense)
- scalable to include new partnerships that can 'plug in'
- enable/ disable new features (like kinderfox, magnification) in an intuitive manner
- takes into account the re-thinking around privacy settings and how they're presented to the user
- Based on Gemma's competitive report, we should do the following improvements and quick wins
- Add Sub-Headings: Unlike Firefox, the three other browsers user sub-headings as way to organize content.
- Add "Accessibility" to Fennec (but not iOS)
- Dolphin and Opera offer top-level options to clear private data. Chrome does not offer this option at the top-level. It may help differentiate Firefox as “more private” if we do.
- The ability to “Clear private data” at the top-level of the settings menu on Firefox for iOS seems more consistent with our brand.
- Change Sync to Sign-in (to be consistent with iOS and other browsers)
- Like Chrome and Dolphin, Firefox for iOS offers “Search” choice as a top-level option.
- Rename "Customize" category to "General"
- Move "Search" category to top level
- Rename "Display" category to "Accessibility"
- Rename "Developer Tools" category to "Advanced"
- Move "Language" settting to "General" section
- Move clear private data setting to top level.
- Move restore tabs pref from to "Advanced".
- Move tap-to-load images pref from to "Advanced".
- Move titlebar pref to "General".
- Move full-screen browsing pref to "General".
- Rearrange search settings to match spec.
- Rearrange privacy prefs to match spec.
- Move data reporting prefs to "Privacy".
- Move settings items that don't belong elsewhere to "Advanced".
- Remove disabled tests and associated strings.
User Stories
- As a user, I want to easily find features, settings and tools I look for
- As a user, I want to discover new features, settings and tools
- As Mozilla, I want to have the same and consistent wording than any feature that is also on Desktop
Testing details
Date
Date:04-11-2015
- Exploratory Testing using Nexus 9 (Android 6.0)
Date:06-11-2015
- Settings
- General
- Search
- Privacy
- Accessibility
- Advanced
- Clear Private Data now
- Mozilla
Date:12-11-2015
- test cases for phone
Date:13-11-2015
- Exploratory Testing using Nexus 6 (Android 5.1) and Sony Xperia (Android 5.1)
- test cases for tablet:
Date:26-11-2015
Phone
- Settings
- General
- Search
- Privacy
- Accessibility
- Advanced
- Clear Private Data
- Mozilla
Tablet
- General
- Search
- Privacy
- Accessibility
- Advanced
- Mozilla
Bug tracking
- bugs to track the updates for opening external links in Private Browsing
ex:
Bugzilla query error
Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 429 [1] => Unknown Error ) ) 1
Bug work
Still Issues
[NEW] Bug 1221534 - Move "Clear private data now" option from General submenu on Tablet
[NEW] Bug 1226130 - "Clear private data on exit" option is visible in restricted profile
Bug fixed
[RESOLVED FIXED] Bug 1217073 - Update restricted profile toggles to account for new settings organization
[RESOLVED FIXED] Bug 1220833 - Update data reporting notification to point to privacy preference screen
[RESOLVED FIXED] Bug 1221679 - Changing language on phone will update language settings page title with "General"
[RESOLVED FIXED] Bug 1224197 - Link "Change" button from about:telemetry to Privacy sub-menu
Sign off
Criteria
- All test cases should be executed
- All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed
Results
Nightly testing
- There were no blockers found while testing this feature.
Aurora testing NA
Beta testing NA