Releases/Firefox 4b9/Test Plan:Feature Area Testing

From MozillaWiki
Jump to: navigation, search

Fx 4b9 Test Plan

Firefox 4 Beta 9 BFTs

In addition to running all the Mozmill BFT automated tests, we'll run BFTs corresponding to areas of high priority using the following BFT test run in Litmus as a guide.

Where there are no related Litmus testcases it is up to the feature owners to test their areas.

Focus Area Tester Status (detailed results at the bottom)
Sync Andreea WinXP: Complete
Win7: Complete
Mac OS 10.6: Complete
Linux: Complete
Panorama
(Private Browsing/Fullscreen interactions)
vlad, george, Andreea WinXP: in progress/complete or Not Run
Win7: in progress
Mac OS 10.6: Complete
Linux: Complete
Places
(History and Bookmarks)
Andreea WinXP: Not run
Win7: Complete
Mac OS 10.6: Complete
Linux: Complete
Tabbed Browsing George WinXP: Not run
Win7: Complete
Mac OS 10.6: Not run
Linux: Complete
App Tabs Teodosia, George WinXP: Complete
Win7: Complete
Mac OS 10.6: Complete
Linux: Complete
Session Store Teodosia WinXP: ...
Win7: Complete
Mac OS 10.6: Complete
Linux: Complete
Web Console vlad WinXP: complete
Win7: complete
Mac OS 10.6: Not run
Linux: complete
WebGL vlad WinXP: complete
Win7: complete
Mac OS 10.6: Not run
Linux: Not run
Plugins
(Flash/Silverlght/Quicktime)
Smartware WinXP: Complete
Win7: Complete
Mac OS 10.5: Complete
Linux: Complete
Tabs on Top
(Lightweight Themes interactions in Win7)
Smartware WinXP: Complete
Win7: Complete
Mac OS 10.6: ...
Linux: ...
Doorhanger Notificaions Alex WinXP: Complete
Win7: Complete
Mac OS 10.6: Not Run
Linux: Complete
Identity (security tests that test Larry, the identity button) George, Alex WinXP: Not run
Win7:Complete
Mac OS 10.6: Not run
Linux: Complete

Results Notes

Example Focus Area

  • WinXP: Issues can be noted here, such as bugs filed in the area using this platform. Make notes of issues that you encountered but didn't lead to a bug being filed. If you file a bug please add [4b9] in the Whiteboard field.
  • Mac OS 10.6: Issue...
  • Linux 10.4: Issue...

Sync (Andreea)

  • Win (7): PASS in Litmus with known issues
  • Win XP :  PASS in Litmus with known issues
  • Mac (10.6) : PASS in Litmus with known issues
  • Linux (Ubuntu): PASS in Litmus with known issues

Panorama (and PB/Fullscreen interactions)

  • Win (version): bug 624692, bug 624727
  • Mac (10.6) : PASS in Litmus with known issues
  • Linux (version): Pass
  • Updated bugs:
    • bug 624102 - Other tabs in tab group hidden after exiting private browsing
    • bug 594644 - Return from Private Browsing Mode, Panorama forgets tab groups, until Panorama is manually re-launched

Places (History-Bookmarks)(Andreea)

  • New issues:
    • bug 625077 - Tags are not properly updated in Library
    • bug 625083 - The position of the Library is not saved
    • bug 625317 - Folder icons missing on Bookmarks menu
  • Win (7):
    • bug 624389 - Abnormal behavior when opening a bookmark in a new window from sidebar and them from toolbar.
    • bug 624676 - Browser doesn't add Javascript: url to the history.
  • Mac (10.6) :
    • bug 625340 - Error Console shows error messages when deleting a tag from sidebar or Library
  • Linux (Ubuntu):
    • bug 625025 - The content of the folder flickers when trying to drag and drop it on Bookmarks toolbar.
    • bug 625063 - Error while drag and drop bookmarks or history entry on desktop
  • Found issues:
    • bug 484790 - Copying elements via Ctrl+D&D in trees duplicates the selected entry instead of the clicked one

Tabbed Browsing (George)

  • New issues:
    • bug 624374 - Rendering issue in resized window having side-bar opened
  • Updated issues:
    • bug 528289 - Minimized windows from session restore have partially drawn taskbar thumbnails/previews
    • bug 428843 - Unchecking "warn on close multiple tabs" also disables the Quit dialog (no longer offers to save tabs when quitting)
    • bug 485105 - improve tab-to-window experience
    • bug 465608 - pressing esc while dragging a tab should cancel the drag / detach operation (on windows)
  • Win (7):
    • bug 624357 - Dragging tab over "Open new tab" button does not duplicate tab
    • bug 624363 - Reloading all tabs does not show progress in List all tabs pop-up
  • Win XP: Not run
  • Mac (10.5.8) : Not run
  • Linux (Ubuntu): Complete

App Tabs (teodosia)

  • New issues:
    • bug 623603 - Multiple App Tabs go outside the tab group in Panorama
    • bug 623878 - Rearranging App Tabs in tab bar is not reflected in Panorama
    • bug 623907 - Undo Close Tab reopens the tab in a new tab group
  • Win (7): PASS in Litmus
  • Win XP :  PASS in Litmus
  • Mac (10.6.5) : PASS in Litmus
  • Linux (Ubuntu): PASS in Litmus
  • Results from App Tabs spreadsheet

Session Store (teodosia, alex, george)

  • Win (7):
    • bug 624661 - Session restore does not retain form input data
    • bug 624667 - Session restore after a crash doesn't remember scrollbar position
  • Mac (10.6.5) :
    • bug 624752 - Session restore should open a blank page if no browser window was opened at close on Mac
    • bug 625049 - Restore Session to Panorama view after crash
  • Linux (Ubuntu):
  • Found issues:
    • bug 345135 - Session restore shouldn't throw away form data even if there's no form on the page to restore the data into
    • bug 575861 - blank tabs without history should not be restored

Web Console (vlad)

  • Win (7): PASS in Litmus
  • Win XP: PASS in Litmus
  • Mac (10.6) :
  • Linux (Ubuntu): PASS in Litmus

Webgl (vlad)

  • Win (7): PASS with known issues
  • Win XP: PASS with known issues
  • Mac (10.5.8) :
  • Linux (Ubuntu):

Results from spreadsheet

Plugins (Flash/Silverlight/Quicktime)

  • Win (7): Pass
  • Win (xp): Pass
  • Mac (10.5): Pass
  • Linux (10.10): Pass
    • New issues :
      • bug 624975 - Silverlight videos website loads 2 plugin containers
      • bug 625024 - Quicktime controls are visible even after killing the plugin container from windows task manager
      • bug 625034 - Unable to mute audio of quicktime video
      • bug 625036 - Unable to use back and forward controls for quicktime player
      • bug 625037 - Blank video player appears when firefox is minimized and maximized again
    • Repeat Bugs :
      • bug 614487 - Youtube videos looks weird after going in and out of full screen mode (F11)
      • bug 614965 - Context menu doesn't pop on right click with Quicktime video
      • bug 609003 - Quicktime videos don't play
      • Updated the results in Litmus and Plugins Matrix

Tabs on Top (Theming interactions in Win7)

  • Win (version): Issues...
  • Mac (version): Issues...
  • Linux (version): Issues...

Doorhandle Notifications (Alex)

  • New issues:
    • bug 624386 - Add-on downloading notification does not work properly after a canceled add-on is installed
    • bug 624391 - rendering issues when exiting Full Screen mode after a Firefox restart
  • Win (7): PASS in spreadsheet
  • Win XP :  PASS in spreadsheet
  • Mac (10.6.5) :
  • Linux (Ubuntu): PASS in spreadsheet

Results from spreadsheet

Identity - security (George, Alex)

  • Win xp: Not run
  • Win (7):Pass in Litmus
  • Mac (10.6.5): Not run
  • Linux (Ubuntu): Pass in Litmus

Etc...