QA/Fennec/iOS/pbmode

Private Browsing Test Plan

Feature Reference

• Meta Bug: bug 1196227
• Overal Status:
  • Aurora:
  • Beta:
• Owner:(Catalin Suciu, irc: csuciu)

Requirements

• Private Browsing will be supported for iOS9 devices and above.
• Provide message for users riunning on iOS8 and below that they need to upgrade to iOS9 in order to use Private browsing
• Enable users to initiate Private Browsing tabs
• Ensure the following data is not saved:
  • Visited pages (URLs)
  • Form data (including usernames and passwords)
  • Search entries
  • Cookies
  • Temporary Internet files (cached files)
• Ensure it is intuitive and simple to initiate a private browsing tab (session)
• Allow both private and non-private tabs to exist in the same browser session (per-tab Private Browsing and not per-window Private Browsing)

User Stories

• As a user, I want to be informed that in order to get Private Browsing, I need to upgrade to iOS9
• As a user, I want to initiate a Private Browsing tab on the household iPad so I can search for that perfect diamond ring without my partner clueing in on what I'm up to.
• As a user, I don't want to have to open up a new browser session just to use Private Browsing if I've already got a non-private browsing session going.
• As a user, I don't want my Top Sites, search history or form data saved when Private Browsing so I don't populate my Firefox data with stuff I don't want in there.
• As a user, I want to have a setting that allows the private tabs to be cleared when going back to normal tabs.

Acceptance Criteria

• Per-tab private browsing
• Easy to initiate a private browsing tab and navigate between both non-private and private tabs in an intuitive way
• No saved browsing history from Private Browsing tabs

Testing details

• Tracking Private Browsing bugs:
  • (pbmode) Private Browsing [META]

Date:2015-09-24

• Exploratory testing
  • Device:iPad Air (iOS 9), iPhone 6 (iOS 9.0.1)
  • Builds:Aurora 1.1 (1102)
    • Tests:
      • Open a new page in pbmode
        • The page is not added to the History/TopSites lists
      • Open a page in pbmode and bookmark it
        • The page is added to the Bookmarks list
      • Remove a bookmark while in pbmode
        • The bookmark is removed from the bookmarks list
      • Open a page in pbmode and go to recent apps
        • The content of the page and the url bar are hidden
      • While having a page open in pbmode, open the tab tray, then go to recent apps
        • The thumbnail of the private tab is hidden - Fail

Date:2015-09-28

• Exploratory testing
  • Device: iPad Air (iOS 9.0), iPhone 6 (iOS 9.0.1), iPod Touch (iOS 9.0)
  • Builds:Beta 1.1 (1103)
    • Tests:
      • Open Pop-ups in pbmode Fail
      • Sync while having private tabs open
        • Private tabs are not synced
      • Visited links in pbmode (private vs normal)
        • Links visited in pbmode are showing as unvisited in normal browsing
• Verified bugs:
  • bug 1198407 - Ignore app snapshot when background the app while displaying a private tab

• New bug:
  • bug 1209015 - Pop-ups are open in normal browsing instead of pbmode

Date:2015-10-02

• Exploratory testing
  • Device: iPhone 6 (iOS 9.0.1)
  • Builds: 1.1 (1104)
    • Tests:
      • Open a new tab in private browsing and load a page
        • the page is not displayed in History in private or normal browsing
      • Bookmark page in private browsing
        • the bookmark page is displayed in the bookmarks tab in both normal and private browsing
      • Login in to a page in private browsing
        • the password doorhanger is not displayed
      • Go to private browsing, load a page and long tap on a link from that page.
      • Choose to open it in a new private tab
        • the page is correctly displayed in a new tab
        • sometimes text selection is triggered on a link on long tap
      • From settings choose to "Close private tabs" when leaving private browsing
      • Open some tabs in PB.
      • Go to normal browsing and then return to private browsing.
        • Tabs are closed. The tab tray is displayed empty.
      • In private browsing load a page. Tap on a link from that page
        • The page is opened in normal browsing
      • Go to PB and open some tabs. Close Firefox from recent apps and reopen it.
        • Firefox grey logo is displayed for a few seconds and after that about:home
        • Private Browsing session is restored even if "Close private tab when leaving PB" is enabled
      • Open a page in PB, open the tab tray, then go to recent apps
        • The thumbnail of the private tab is hidden (black)

Date:2015-10-08

• Exploratory testing
  • Devices: iPhone 6 Plus (iOS 9.0.1), iPad Air (9.0.2)
  • Builds: 1.1 (1105)
    • Open links in new private tabs via context menu
      • Visit www.bbc.com in private browsing, long tap on a link and "Open in New Private Tab"
        • The article is open in a new private tab PASS
      • Visit www.bbc.com in normal browsing, long tap on a link and "Open in New Private Tab"
        • The article is open in a new private tab PASS
    • Close Private Tabs When Leaving Private Browsing
      • While "Close Private tabs..." setting is enabled, open a few tabs in private mode, then go to normal browsing
        • The private tabs are closed when exiting private mode PASS
      • While "Close Private tabs..." setting is enabled, open a few tabs in private mode, then force close Firefox from app switcher
        • The private tabs are closed when quitting Firefox - FAILED Bug 1211348
      • While "Close Private tabs..." setting is disabled, open a few tabs in private mode then go to normal browsing
        • The private tabs are not closed when switching to normal browsing PASS
    • Links/Pop-ups open in new private tabs
      • Visit www.news.google.com in private browsing and tap on a link of an article
        • The article is open in a new private tab PASS
      • Visit http://popuptest.com/popuptest1.html
        • The pop-ups are open in new private tabs PASS
    • Tab counter increment/decrement
      • While in private browsing, visit a page that contains links, long tap on a link and "Open in New Private Tab"
        • The link opens in a new tab and the tab counter is correctly incremented PASS
      • While having multiple tabs open in private mode, close a tab
        • Tab counter is correctly decremented PASS
    • Sync while having private tabs open
      • Private tabs are not synced PASS

Bugzilla

• (pbmode) Private Browsing [META]

Full Query

ID	Priority	Summary	Status	Assigned to
1198407	--	Ignore app snapshot when background the app while displaying a private tab	VERIFIED	Stephan Leroux [:sleroux]
1201504	--	Open into a private browsing tab from a button on the tab tray	VERIFIED	Stephan Leroux [:sleroux]
1201505	--	Add visual cues and modifications to the browsing UI to indicate that we're in Private mode	VERIFIED	Stephan Leroux [:sleroux]
1201509	--	[meta] WKWebView instance for private browsing should not save any sensitive data	RESOLVED	Stephan Leroux [:sleroux]
1201515	--	Avoid storing local visits into History while browsing in a private tab	VERIFIED	Stephan Leroux [:sleroux]
1202816	--	Message users on iOS8 (and below) to upgrade to iOS9 for Private Browsing feature	RESOLVED	alainez
1203639	--	Tab restoration should respect private tabs	RESOLVED	Emily Toop (:fluffyemily)
1203640	--	Hide private browsing tabs when in the app switcher when the user was previously on the tab tray	VERIFIED	Stephan Leroux [:sleroux]
1204492	--	Add strings/l10n translations for pbmode	RESOLVED	Stephan Leroux [:sleroux]
1205307	--	Add settings options allowing PB Mode tabs to be cleared when existing PB Mode	VERIFIED	Stephan Leroux [:sleroux]
1205692	--	Open in new tab context menu should open private tab when triggered from a private tab	VERIFIED	James Hugman [:jhugman] [@jhugman]
1205699	--	View Later in a Private Tab	RESOLVED
1208518	--	Private browsing: explanatory text is truncated in localized builds	RESOLVED	Emily Toop (:fluffyemily)
1209015	--	Pop-ups are open in normal browsing instead of pbmode	RESOLVED	Stephan Leroux [:sleroux]
1210059	--	Add a 'Learn More' link to the private browsing empty view that links to a SUMO article	RESOLVED	Stephan Leroux [:sleroux]
1210776	--	Hide 'Close Private Tabs' settings option for iOS 8 users	RESOLVED	Stephan Leroux [:sleroux]
1210788	--	Explain role of reading list in Private Browsing	RESOLVED
1210794	--	Private Mode Reader View UI needs "dark" asset set	RESOLVED	Stephan Leroux [:sleroux]
1210798	--	Restored private tabs do not use private, non-persistent configuration	RESOLVED	Stephan Leroux [:sleroux]
1211348	P1	Don't restore private tabs after killing the app if "Close Private tabs when leaving private browsing" is enabled	VERIFIED	Justin D'Arcangelo [:justindarc]
1211925	--	Dont cache reading list items when viewing them in private mode	RESOLVED	Stephan Leroux [:sleroux]
1212383	--	Regular tab increment reanimates on new background private tab	RESOLVED	Emily Toop (:fluffyemily)
1216801	--	Search suggestions should not be enabled in private browsing	VERIFIED	Brian Nicholson (:bnicholson)
1218233	--	Logins aren't available in private browsing mode	NEW

24 Total; 1 Open (4.17%); 14 Resolved (58.33%); 9 Verified (37.5%);

Moztrap

• Private Browsing