Releases/Firefox 4b1/Test Plan:Feature Area Testing

Fx 4b1 Test Plan

Firefox 4 Beta 1 BFTs

In addition to running all the Mozmill BFT automated tests, we'll run BFTs corresponding to areas of high priority using the following BFT test run in Litmus as a guide.

• Download builds: http://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b1-candidates/
• Use Litmus testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=180

Where there are no related Litmus testcases it is up to the feature owners to test their areas.

Focus Area	Tester	Status
Theme work on Windows	juanb	Completed (Overall OK for beta. A few issues found. Look for [4b1] in quicksearch)
Theme work on Mac	marcia	Several blocker bugs, including bug 562733
Toolbar Customization	Ayan
Firefox Menu	aravindm	Firefox Menu flickers when trying to open a New Window. Filed one bug	Build 2 : Firefox flicker still happening.
Tab Strip	aravindm	Tabbed browsing covers the test cases of Tab strip
Tabbed Browsing	aravindm	Dragging a tab onto Desktop / dropping onto itself, sometimes does not open the page, just shows a blank page.	Build 2 : Able to reproduce. No major issues found
Bookmarking	aravindm	Recent Tags item in Bookmarks menu does not show "Empty" dialog when a tag is deleted. Filed one bug.	Build 2 : No major issues found.
Search	gmontagu	4. Add an OpenSearch search engine: Does not display search results, just: "Search term was 'radio'" in the current tab (I typed "radio"). 5. Autodiscovery of OpenSearch search engines: No glowing, same result as the previous test. All the other tests worked as expected.
Session Restore	ashughes	Need to run BFTs across all platforms
Undo close window/tab	ashughes	Win7: No discoverable option to undo close specific tab/window
Form and password manager	juanb	It has good automated tests, and a shallow pass showed no obvious problems.
Firefox Sync	tracy/tchung	Sync 1.4b2 is an extension that should work with fx4b1. Final integration will land post b1.
Feedback	tracy/aakash
Profile migration 3.6->4.0->3.6	juanb
Add-ons Manager	hskupin (needs testing on Windows and Linux)	Completed on Mac only.
OOPP	marcia
WebM (googspreadsheet for crowdsoursing)	juanb	Completed (Overall OK. Filed an issue duped to a tab tear off problem. Look for [4b1] in quicksearch)
Fullscreen	juanb	Completed (Overall OK. Several issues filed. Look for [4b1] in quicksearch. All deal with Windows in fullscreen mode and theme)
d2d	marcia	Not enabled by default in B1, also somewhat broken due to theme landing
Personas (Lightweight Themes)	gmontagu	"Wearing", undoing, removing and enabling works as expected. While hovering from one to the other before a Persona fully shows sometimes a transparency occurs and the tabs turn gray and the horizontal space to the right of the Firefox button turns black.	Build 2: works as expected, less transparency issues but still happening.
Notifications (Geo-location)	ashughes	Need to run new Geolocation BFTs (4 tests) across all platforms. Open dependency bugs being pushed to B2, does not block B1 readiness.
Antivirus and firewall interactions
Tab Matches in Awesomebar (aka Switch to Tab)	ashughes	Need to run BFTs across all platforms; Open bugs do not block B1, block Final.
Heads Up Display	juanb	Shallow pass across platforms. Focused on UI. No major issues found. Filed one bug (look for [4b1] in quicksearch). Needs functionality owner (Tomcat?).
Inspect	juanb	Shallow pass across platforms. Focused on UI. No major issues found. Needs functionality owner (Tomcat?).

Windows XP(aravindm)

• Notes:
  • Theme work on Windows: Make a not of the issues you found in this platform while testing the area you chose
  • Firefox Menu:
    • bug 575541 - "Go Button" is visible when cursor is not in the Location Bar
    • bug 575958 - Firefox flickers when opening a new window
    • bug 575963 - Recent Tags item in Bookmarks menu does not show "Empty" dialog when a tag is deleted

Windows 7

• Notes:
  • Theme work on Windows: Make a not of the issues you found in this platform while testing the area you chose
  • Firefox Menu:
  • Geolocation Notification: No problems found
  • Session Store: Problems with Undo Close
    • Cannot undo tab/window closure from history menu (no option exists)
    • Tests marked as broken, but is this a bug? How will users restore specific tabs/windows? If the feature still exists, it is not discoverable.
  • Switch to Tab: No problems found
  • ...

Windows Vista (lower priority)

• Notes:
  • Theme work on Windows: Make a not of the issues you found in this platform while testing the area you chose
  • Firefox Menu:
  • bug 574676
    • Page Info Buttons are static when performing MouseOver() or MouseClick() event. Logged enhancement for win7(32-b)

Mac 10.5

• Notes:
  • Theme work on Windows: Make a not of the issues you found in this platform while testing the area you chose
  • Firefox Menu:
    • Share Location Icon appears blurry. (in addition to retrieving Geolocation - known issue)

Mac 10.6 (marcia)

• Notes:
  • Theme work on Mac: Make a not of the issues you found in this platform while testing the area you chose
  • Firefox Menu:
  • Feedback
    • If you install the most recent version of Test Pilot from AMO, it overwrites the Feedback button. I confirmed with Jono that this is expected until they change the AMO version.

Linux (aravindm)

• Notes:
  • Theme work on Windows: Make a not of the issues you found in this platform while testing the area you chose
  • Firefox Menu:
    • Firefox hangs in .ogv player full screen mode
    • Dragging a tab onto Desktop / dropping onto itself, sometimes does not open the page, just shows a blank page.