Releases/Firefox 4b1/Test Plan:Feature Area Testing

Fx 4b1 Test Plan

Firefox 4 Beta 1 BFTs

In addition to running all the Mozmill BFT automated tests, we'll run BFTs corresponding to areas of high priority using the following BFT test run in Litmus as a guide.

• Download builds: ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/
• Use Litmus testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=180

Where there are no related Litmus testcases it is up to the feature owners to test their areas.

Focus Area	Tester	Status
Theme work on Windows	juanb	Completed (Overall OK for beta. A few issues found. Look for [4b1] in quicksearch)
Theme work on Mac	marcia	Several blocker bugs on file, as work is still underway, including bug 562733
Toolbar Customization	Ayan	Completed. Ran BFTs.Nothing major.
Firefox Menu	aravindm	Firefox Menu flickers when trying to open a New Window. Filed one bug	Build 2 : Firefox flicker still happening.
Tab Strip	aravindm	Tabbed browsing covers the test cases of Tab strip
Tabbed Browsing	aravindm	Dragging a tab onto Desktop / dropping onto itself, sometimes does not open the page, just shows a blank page.	Build 2 : Able to reproduce. No major issues found
Bookmarking	aravindm	Recent Tags item in Bookmarks menu does not show "Empty" dialog when a tag is deleted. Filed one bug.	Build 2 : No major issues found.
Search	gmontagu	4. Add an OpenSearch search engine: Does not display search results, just: "Search term was 'radio'" in the current tab (I typed "radio"). 5. Autodiscovery of OpenSearch search engines: No glowing, same result as the previous test. All the other tests worked as expected.	Build 2: 3. Check multiple search suggestion providers: No suggestions for Google,for Yahoo nor for any other search engine. 4. Add an OpenSearch search engine: Does not display search results, just: "Search term was 'radio'" in the current tab (I typed "radio"). 5. Autodiscovery of OpenSearch search engines: No glowing, same result as the previous test. All the other tests worked as expected.
Session Restore	ashughes	Win7: PASS WinXP: PASS Mac: PASS Ubuntu: PASS
Undo close window/tab	ashughes	Win7: bug 577160 - Undo Close not discoverable in the new UI WinXP: PASS Mac: PASS Ubuntu: PASS
Form and password manager	juanb	It has good automated tests, and a shallow pass showed no obvious problems.
Firefox Sync	tracy/tchung	Sync 1.4b2 is an extension that should work with fx4b1. Final integration will land post b1.
Feedback	tracy/aakash	Testing Completed: Crasher bug 576332 found on windows. Apparently it's a Fx bug not TP
Profile migration 3.6->4.0->3.6	juanb	Completed. Ran a shallow pass on Win XP, Win 7, Mac and Linux, using common customizations, bookmarks, feeds, master passwd, extensions, tabs, windows and window sizes. In Windows it is noticeable that the bookmarks toolbar is gone in 4.0, but none of the information is lost. Needs a deeper look, but no major issues found on this pass.
Add-ons Manager	hskupin (needs testing on Windows and Linux)	Completed on Mac only.
OOPP	marcia	Completed testing on Mac. Visited various video sites and performed full screen testing, as well as explored the player controls. See wiki for one crash that happened while watching High Def videos. More testing coming on Windows and Linux.
WebM (googspreadsheet for crowdsoursing)	juanb	Completed (Overall OK. Filed an issue duped to a tab tear off problem. Look for [4b1] in quicksearch)
Fullscreen	juanb	Completed (Overall OK. Several issues filed. Look for [4b1] in quicksearch. All deal with Windows in fullscreen mode and theme)
d2d	marcia	Not enabled by default in B1, also somewhat broken due to theme landing. More focus on this feature in B2.
Personas (Lightweight Themes)	gmontagu	"Wearing", undoing, removing and enabling works as expected. While hovering from one to the other before a Persona fully shows sometimes a transparency occurs and the tabs turn gray and the horizontal space to the right of the Firefox button turns black.	Build 2: works as expected, less transparency issues but still happening.
Notifications (Geo-location)	ashughes	Win7: PASS WinXP: PASS Mac: PASS Ubuntu: PASS
Antivirus and firewall interactions
Tab Matches in Awesomebar (aka Switch to Tab)	ashughes	Win7: PASS WinXP: PASS Mac: PASS Ubuntu: PASS
Heads Up Display	juanb	Shallow pass across platforms. Focused on UI. No major issues found. Filed one bug (look for [4b1] in quicksearch). Needs functionality owner (Tomcat?).
Inspect	juanb	Shallow pass across platforms. Focused on UI. No major issues found. Needs functionality owner (Tomcat?).

Windows XP(aravindm)

• Notes:
  • Theme work on Windows: Make a not of the issues you found in this platform while testing the area you chose
  • Firefox Menu:
    • bug 575541 - "Go Button" is visible when cursor is not in the Location Bar
    • bug 575958 - Firefox flickers when opening a new window
    • bug 575963 - Recent Tags item in Bookmarks menu does not show "Empty" dialog when a tag is deleted
  • Geolocation Notification: No problems found
  • Session Store/Undo Close: No problems found
  • Switch to Tab: No problems found

Windows 7

• Notes:
  • Theme work on Windows: Make a not of the issues you found in this platform while testing the area you chose
  • Firefox Menu:
  • Geolocation Notification: No problems found
  • Session Store/Undo Close: Problems with Undo Close
    • Cannot undo tab/window closure from history menu (no option exists)
    • Tests marked as broken, but is this a bug? How will users restore specific tabs/windows? If the feature still exists, it is not discoverable.
      • Restore all tabs
      • Restore all windows
      • Undo Tab Closure from History menu
      • Undo close window
    • See bug 577160 - Undo Close not discoverable in the new UI
  • Switch to Tab: No problems found
  • ...

Windows Vista (lower priority)

• Notes:
  • Theme work on Windows: Make a not of the issues you found in this platform while testing the area you chose
  • Firefox Menu:
  • bug 574676
    • Page Info Buttons are static when performing MouseOver() or MouseClick() event. Logged enhancement for win7(32-b)

Mac 10.5

• Notes:
  • Theme work on Mac: Make a not of the issues you found in this platform while testing the area you chose
  • Firefox Menu:
    • Share Location Icon appears blurry. (in addition to retrieving Geolocation - known issue)

Mac 10.6 (marcia)

• Notes:
  • Theme work on Mac: Make a not of the issues you found in this platform while testing the area you chose
  • Firefox Menu:
  • Feedback
    • If you install the most recent version of Test Pilot from AMO, it overwrites the Feedback button. I confirmed with Jono that this is expected until they change the AMO version.
  • Geolocation Notification: No problems found
  • Session Store/Undo Close: No problems found
  • Switch to Tab: No problems found

Linux (aravindm)

• Notes:
  • Theme work on Windows: Make a not of the issues you found in this platform while testing the area you chose
  • Firefox Menu:
    • Firefox hangs in .ogv player full screen mode
    • Dragging a tab onto Desktop / dropping onto itself, sometimes does not open the page, just shows a blank page.
  • Geolocation Notification: No problems found
  • Session Store/Undo Close: No problems found
  • Switch to Tab: No problems found