QA/Fennec/iOS/tools menu

From MozillaWiki
< QA‎ | Fennec‎ | iOS
Jump to: navigation, search

Overview

Purpose

The purpose of this wiki is to serve as a general test plan for testing the new menu UI and the options available in it

Ownership

Developer contact: Emily Toop (:fluffyemily)

QA: Catalin Suciu (:csuciu)

Overall Status

Nightly[LANDED]
Beta[NOT LANDED]

Requirements

  • Provide users with a Menu (a collection of most frequently used features)
  • Menu should include the following:New Tab, New Private Tab, Bookmarks, History, Synced Tabs, Find in Page, Request Desktop Site, Settings, Help

Specifications

User stories

  • As a user, I want to be able to have an easy and quick access to frequently used functions

Acceptance Criteria

  • I can find the Menu and it's easily accessible
  • Menu contains frequently needed features

Signoff criteria

  • All test cases are executed on devices with the following display sizes: 3.5", 4", 5", 5.5", 7", 9", 12.9"
  • All test cases are executed on devices with iOS8.x and iOS 9.x
  • All blockers, criticals must be fixed and verified or have an agreed-upon timeline for being fixed

Testing Summary

Scope of testing

The testing will be focus on:

  • verifying that the Menu button is correctly placed in toolbars
  • verifying that the Menu dialog is correctly displayed
  • verifying that the Menu button is correctly placed in tabs tray
  • verifying that the Menu dialog is correctly displayed in tabs tray
  • verifying that all the options from the menu and from the tabs tray toolbar are triggering the requested action
  • verifying that the New Private Tab option is not available on devices with iOS 8.x

Test Cases

  • Open Firefox and check the placement of the Menu button in portrait and in landscape
    • Expected: [iPhone] The Menu button is placed in the bottom toolbar in portrait and in the top toolbar in landscape
    • Expected: [IPad] The Menu button is placed in the top toolbar in both modes, portrait and landscape
  • Put the device in portrait and open Tools Menu
    • Expected: [iPhone] The menu opens from the bottom of the screen
    • Expected: [iPad] The menu opens in a popover from the top of the screen
  • Open the Tools Menu in portrait mode, then change orientation to landscape
    • Expected: [iPhone] The menu should be dismissed when switching orientation
    • Expected: [iPad] The menu should not be dismissed when rotating the screen
  • Go to tabs tray, open the Tools Menu and rotate the screen
    • Expected: The menu is not dismissed when rotating the screen
  • In portrait, open the Tools Menu and check the position of the Panel Icons
    • Expected: All Panel Icons are displayed in the top row in portrait
  • In landscape, open the Tools Menu and check the position of the Panel Icons
    • Expected: All Panel Icons are displayed in the bottom row in portrait
  • Go to the Home screen and open the Tools Menu
    • Expected: The Panel Icons are not displayed when the Menu is open in the Home screen
  • Open Tools Menu and tap on the Top Sites icon
    • Expected: The Top Sites panel should open
  • Open Tools Menu and tap on the Bookmarks icon
    • Expected: The Bookmarks panel should open
  • Open Tools Menu and tap on the History icon
    • Expected: The History panel should open
  • Open Tools Menu and tap on the Reading List icon
    • Expected: The Reading List panel should open
  • Go to tabs tray, open the Menu and check the available options
    • Expected: 'Find in page' and 'Request desktop sites' options should not be available if the menu was open from tabs tray
  • Visit a page, open the Menu and tap on 'Find in Page'
    • Expected: The Find In Page bar should open and the user is able to search for terms
  • Visit a page, open the Menu and tap on 'Request Desktop Site'
    • Expected: The desktop version of the site should be displayed
    • Expected: In the menu, the option will change to 'Request Mobile Site'
  • Visit a page, open the Menu and tap on 'Bookmark' star
    • Expected: The 'Bookmark' star should turn blue and the page should be added to the Bookmarks panel
  • Visit a bookmark, open the Tools Menu and tap on 'Bookmark' star
    • Expected: The 'Bookmark' star should turn grey and the page should be removed to the Bookmarks panel
  • In browser view, open the Tools Menu and tap on the 'New Tab' button
    • Expected: A new normal tab should open
  • In browser view, open the Menu and tap on the 'New Private Tab' button
    • Expected[iOS9.x]: A new private tab should open
    • Expected[iOS8.x]: 'New Private Tab' button is not available in Menu
  • In browser view, open the Tools Menu and tap on the 'Settings' button
    • Expected: The settings screen should open
  • In tabs tray, open the Tools Menu and tap one by one on 'New Tab', 'New Private Tab' and 'Settings'
    • Expected[iOS9.x]: The expected action is performed in each case
    • Expected[iOS8.x]:'New Private Tab' button is not available in the Menu. The rest of the buttons are working as expected
  • In tabs tray, open the Tools Menu and tap one by one on each Panel icon
    • Expected: The expected home panel is open in each case
  • Open a few tabs, go to tabs tray, open the Tools Menu and tap on 'Close All Tabs'
    • Expected: All tabs should close
  • In tabs tray, tap on the private browsing icon from the bottom toolbar
    • Expected[iOS9.x]: The browser switches to private mode
    • Expected[iOS8.x]: 'New Private Tab' button is not available in toolbar
  • While in private browsing, go to tabs tray and tap on the 'New Tab (+)' button from the bottom toolbar
    • Expected: A new private tab is open
  • While in normal browsing, go to tabs tray and tap on the 'New Tab (+)' button from the bottom toolbar
    • Expected: A new normal tab is open

Testing details

Date: May 9th, 2016

  • Build: latest master
  • Device: iPhone 6 Plus
  • Display: 5.5"
  • iOS: 9.3.1
    • All test cases executed:[YES]
      • New issues:
        • bug 1271337 - Clicking on the Reading List menu item opens a blank page
      • Verified issues:
        • bug 1266700 - Menu Items View Desktop Site and View Mobile Site titles should be made consistent with existing functionality
      • Re-opened issues:
        • none

Date: May 11th, 2016

  • Build: latest master
  • Device: iPhone SE
  • Display: 4"
  • iOS: 9.3.1
    • All test cases executed:[YES]
      • New issues:
        • none
      • Verified issues:
        • none
      • Re-opened issues:
        • none

Date: May 13th, 2016

  • Build: latest master
  • Device: iPhone 4S
  • Display: 3.5"
  • iOS: 8.4
    • All test cases executed:[YES]
      • New issues:
        • bug 1272602 - The menu is cut off on phones when VKB is open
      • Verified issues:
        • none
      • Re-opened issues:
        • none

Date: May 18th, 2016

  • Build: master There's
  • Device: iPad Air 2
  • Display: 9.7"
  • iOS: 9.3.1
    • All test cases executed:[YES]
      • New issues:
        • bug 1273813 - Menu not dismissed when switching orientation from landscape to portrait on iOS 8.x
      • Verified issues:
        • none
      • Re-opened issues:
        • none

Date: May 23th, 2016

  • Build: master There's
  • Device: iPad Pro
  • Display: 12.9"
  • iOS: 9.3.2
    • All test cases executed:[YES]
      • New issues:
        • bug 1274245 - The toolbar is barely visible when changing device orientation in private browsing
      • Verified issues:
        • bug 1270456 - Tools Menu not dismissed when switching orientation on iPhones
        • bug 1263178 - Implement Home Panel Menu Actions
      • Re-opened issues:
        • none

Tracking bugs

  • Exposing Tools to the user [META]
Full Query
ID Priority Summary Status Resolution Assigned to
1254561 -- Create menu configuration files for easy configuration of the new menu RESOLVED FIXED Emily Toop (:fluffyemily)
1254563 -- Create feature flag for new menu RESOLVED FIXED Emily Toop (:fluffyemily)
1254567 -- Create View for displaying menu items RESOLVED FIXED Emily Toop (:fluffyemily)
1254568 -- Create menu view controller for displaying the new menu RESOLVED FIXED Emily Toop (:fluffyemily)
1254574 -- Create an Action for Open New Tab RESOLVED FIXED Emily Toop (:fluffyemily)
1254575 -- Create an Action for Open New Private Tab RESOLVED FIXED Emily Toop (:fluffyemily)
1254576 -- Create an Action for Open Settings RESOLVED FIXED Emily Toop (:fluffyemily)
1254577 -- Create Actions for Add Bookmark and Remove Bookmark RESOLVED FIXED Emily Toop (:fluffyemily)
1254586 -- Create Action for Find In Page RESOLVED FIXED Emily Toop (:fluffyemily)
1254587 -- Create Actions for Request Desktop/Mobile Site RESOLVED FIXED Emily Toop (:fluffyemily)
1254599 -- Create AppState concept that contains the current state of the app and can be passed into Menu & toolbars RESOLVED FIXED Emily Toop (:fluffyemily)
1260124 -- [meta] Toolbar Design Changes RESOLVED FIXED Stephan Leroux [:sleroux]
1263178 -- Implement Home Panel Menu Actions VERIFIED FIXED Emily Toop (:fluffyemily)
1264638 -- Make App State more generic and less tied to browser implementation RESOLVED INVALID
1264640 -- Separate Protocols from specific implementations for Menu Code RESOLVED FIXED Emily Toop (:fluffyemily)
1264911 -- Menu Actions need to be both generic and immutable RESOLVED INVALID
1266332 -- Update menu strings to use new identifier instead of the string as identifier RESOLVED FIXED Emily Toop (:fluffyemily)
1266350 -- When selecting home panel from Menu, panel should open in current privacy mode VERIFIED FIXED Emily Toop (:fluffyemily)
1266691 -- Make menu have the same rounded corners as the menu toolbar when there are no toolbar items to display VERIFIED FIXED Emily Toop (:fluffyemily)
1266699 -- Menu items titles (and height) should expand to fit > 3 lines. VERIFIED FIXED Emily Toop (:fluffyemily)
1266700 -- Menu Items View Desktop Site and View Mobile Site titles should be made consistent with existing functionality VERIFIED FIXED Emily Toop (:fluffyemily)
1267651 -- Incorrect display of menu container in Tabs Tray RESOLVED INVALID
1270456 -- Tools Menu not dismissed when switching orientation on iPhones VERIFIED FIXED Emily Toop (:fluffyemily)
1271337 -- Clicking on the Reading List menu item opens a blank page VERIFIED FIXED Emily Toop (:fluffyemily)
1272602 -- The menu is cut off on phones when VKB is open VERIFIED FIXED Emily Toop (:fluffyemily)
1273224 -- Menu arrow doesn't match menu color in private browsing VERIFIED FIXED Emily Toop (:fluffyemily)
1273813 -- Menu not dismissed when switching orientation from landscape to portrait on iOS 8.x RESOLVED FIXED Emily Toop (:fluffyemily)
1274245 -- The toolbar is barely visible when changing device orientation in private browsing VERIFIED DUPLICATE Emily Toop (:fluffyemily)
1285491 -- Incorrect menu version displayed in browsing mode after closing an about:home tab VERIFIED FIXED Nathanael Alcock
1293668 -- The menu is not correctly positioned on iPads when using split screen feature RESOLVED FIXED Nathanael Alcock

30 Total; 0 Open (0%); 19 Resolved (63.33%); 11 Verified (36.67%);