Releases/Firefox 4b1/Test Plan:Feature Area Testing

From MozillaWiki
Jump to: navigation, search

Fx 4b1 Test Plan

Firefox 4 Beta 1 BFTs

In addition to running all the Mozmill BFT automated tests, we'll run BFTs corresponding to areas of high priority using the following BFT test run in Litmus as a guide.

Where there are no related Litmus testcases it is up to the feature owners to test their areas.

Focus Area Tester Status
Theme work on Windows juanb Completed (Overall OK for beta. A few issues found. Look for [4b1] in quicksearch)
Theme work on Mac marcia Several blocker bugs on file, as work is still underway, including bug 562733
Toolbar Customization Ayan Completed. Ran BFTs.Nothing major.
Firefox Menu aravindm Firefox Menu flickers when trying to open a New Window. Filed one bug Build 2 : Firefox flicker still happening.
Tab Strip aravindm Tabbed browsing covers the test cases of Tab strip
Tabbed Browsing aravindm Dragging a tab onto Desktop / dropping onto itself, sometimes does not open the page, just shows a blank page. Build 2 : Able to reproduce. No major issues found
Bookmarking aravindm Recent Tags item in Bookmarks menu does not show "Empty" dialog when a tag is deleted. Filed one bug. Build 2 : No major issues found.
Search gmontagu 4. Add an OpenSearch search engine: Does not display search results, just: "Search term was 'radio'" in the current tab (I typed "radio").

5. Autodiscovery of OpenSearch search engines: No glowing, same result as the previous test. All the other tests worked as expected.

Build 2: 3. Check multiple search suggestion providers: No suggestions for Google,for Yahoo nor for any other search engine.

4. Add an OpenSearch search engine: Does not display search results, just: "Search term was 'radio'" in the current tab (I typed "radio"). 5. Autodiscovery of OpenSearch search engines: No glowing, same result as the previous test. All the other tests worked as expected.

Session Restore ashughes
  • Win7: PASS
  • WinXP: PASS
  • Mac: PASS
  • Ubuntu: PASS
Undo close window/tab ashughes
  • Win7: bug 577160 - Undo Close not discoverable in the new UI
  • WinXP: PASS
  • Mac: PASS
  • Ubuntu: PASS
Form and password manager juanb It has good automated tests, and a shallow pass showed no obvious problems.
Firefox Sync tracy/tchung Sync 1.4b2 is an extension that should work with fx4b1. Final integration will land post b1.
Feedback tracy/aakash Testing Completed: Crasher bug 576332 found on windows. Apparently it's a Fx bug not TP
Profile migration 3.6->4.0->3.6 juanb Completed. Ran a shallow pass on Win XP, Win 7, Mac and Linux, using common customizations, bookmarks, feeds, master passwd, extensions, tabs, windows and window sizes. In Windows it is noticeable that the bookmarks toolbar is gone in 4.0, but none of the information is lost. Needs a deeper look, but no major issues found on this pass.
Add-ons Manager hskupin (needs testing on Windows and Linux) Completed on Mac only.
OOPP marcia Completed testing on Mac. Visited various video sites and performed full screen testing, as well as explored the player controls. See wiki for one crash that happened while watching High Def videos. More testing coming on Windows and Linux.
WebM (googspreadsheet for crowdsoursing) juanb Completed (Overall OK. Filed an issue duped to a tab tear off problem. Look for [4b1] in quicksearch)
Fullscreen juanb Completed (Overall OK. Several issues filed. Look for [4b1] in quicksearch. All deal with Windows in fullscreen mode and theme)
d2d marcia Not enabled by default in B1, also somewhat broken due to theme landing. More focus on this feature in B2.
Personas (Lightweight Themes) gmontagu "Wearing", undoing, removing and enabling works as expected. While hovering from one to the other before a Persona fully shows sometimes a transparency occurs and the tabs turn gray and the horizontal space to the right of the Firefox button turns black. Build 2: works as expected, less transparency issues but still happening.
Notifications (Geo-location) ashughes
  • Win7: PASS
  • WinXP: PASS
  • Mac: PASS
  • Ubuntu: PASS
Antivirus and firewall interactions
Tab Matches in Awesomebar (aka Switch to Tab) ashughes
  • Win7: PASS
  • WinXP: PASS
  • Mac: PASS
  • Ubuntu: PASS
Heads Up Display juanb Shallow pass across platforms. Focused on UI. No major issues found. Filed one bug (look for [4b1] in quicksearch). Needs functionality owner (Tomcat?).
Inspect juanb Shallow pass across platforms. Focused on UI. No major issues found. Needs functionality owner (Tomcat?).

Windows XP(aravindm)

  • Notes:
    • Theme work on Windows: Make a not of the issues you found in this platform while testing the area you chose
    • Firefox Menu:
      • bug 575541 - "Go Button" is visible when cursor is not in the Location Bar
      • bug 575958 - Firefox flickers when opening a new window
      • bug 575963 - Recent Tags item in Bookmarks menu does not show "Empty" dialog when a tag is deleted
    • Geolocation Notification: No problems found
    • Session Store/Undo Close: No problems found
    • Switch to Tab: No problems found

Windows 7

  • Notes:
    • Theme work on Windows: Make a not of the issues you found in this platform while testing the area you chose
    • Firefox Menu:
    • Geolocation Notification: No problems found
    • Session Store/Undo Close: Problems with Undo Close
    • Switch to Tab: No problems found
    • ...

Windows Vista (lower priority)

  • Notes:
    • Theme work on Windows: Make a not of the issues you found in this platform while testing the area you chose
    • Firefox Menu:
    • bug 574676
      • Page Info Buttons are static when performing MouseOver() or MouseClick() event. Logged enhancement for win7(32-b)

Mac 10.5

  • Notes:
    • Theme work on Mac: Make a not of the issues you found in this platform while testing the area you chose
    • Firefox Menu:
      • Share Location Icon appears blurry. (in addition to retrieving Geolocation - known issue)

Mac 10.6 (marcia)

  • Notes:
    • Theme work on Mac: Make a not of the issues you found in this platform while testing the area you chose
    • Firefox Menu:
    • Feedback
      • If you install the most recent version of Test Pilot from AMO, it overwrites the Feedback button. I confirmed with Jono that this is expected until they change the AMO version.
    • Geolocation Notification: No problems found
    • Session Store/Undo Close: No problems found
    • Switch to Tab: No problems found

Linux (aravindm)

  • Notes:
    • Theme work on Windows: Make a not of the issues you found in this platform while testing the area you chose
    • Firefox Menu:
      • Firefox hangs in .ogv player full screen mode
      • Dragging a tab onto Desktop / dropping onto itself, sometimes does not open the page, just shows a blank page.
    • Geolocation Notification: No problems found
    • Session Store/Undo Close: No problems found
    • Switch to Tab: No problems found