Releases/Firefox 4b5/Test Plan:Feature Area Testing

From MozillaWiki
Jump to: navigation, search

Fx 4b5 Test Plan

Firefox 4 Beta 5 BFTs

In addition to running all the Mozmill BFT automated tests, we'll run BFTs corresponding to areas of high priority using the following BFT test run in Litmus as a guide.

Where there are no related Litmus testcases it is up to the feature owners to test their areas.

Focus Area Tester Status (detailed results at the bottom)
D2D (on by default) marcia, Tomcat WinXP: in progress/complete or Not Run
Win7: Completed
Mac OS 10.6: Completed
Linux: ...
Theme/Toolbar aravindm WinXP: Completed
Win7: Completed
Mac OS 10.5:Completed
Linux: Completed
Panorama (usability and keyboard shortcuts, interactions with private browsing, fullscreen, ...) Tracy, gmontagu WinXP: Complete
Win7: Complete
Mac OS 10.6: Complete
Linux: Complete
OOPP (keyboard input events) marcia, juanb WinXP: in progress/complete or Not Run
Win7: ...
Mac OS 10.6: Completed
Linux: ...
Tabbed Browsing aravindm, gmontagu, Waverly WinXP: Completed
Win7: Completed
Mac OS 10.5: Completed
Linux: Completed
App Tabs aravindm, gmontagu WinXP: Completed
Win7: Completed
Mac OS 10.5: Completed
Linux: Completed
Add-ons Manager Waverly WinXP: Complete
Win7: Complete
Mac OS 10.6: Complete
Linux: Complete
Web Console Tomcat WinXP: complete
Win7: complete
Mac OS 10.6: complete
Linux: complete
Aero Peek (Win7 Only) Waverly Win7: Complete
Menu (keyboard) Shortcuts marcia WinXP: in progress/complete or Not Run
Win7: ...
Mac OS 10.6: ...
Linux: ...
Firefox Sync Tracy WinXP: Completed
Win7: Completed
Mac OS 10.5: Completed
Linux: not run
Ogg/WebM (video indexing/buffer) Waverly WinXP: Complete
Win7: Complete
Mac OS 10.6: Complete
Linux: Complete
Layout marcia WinXP: Complete
Win7: Complete
Mac OS 10.6: Complete
Linux: Complete
Pop-ups Waverly WinXP: Complete
Win7: Complete
Mac OS 10.6: Complete
Linux: Complete
Notifications ashughes WinXP: Complete
Win7: Complete
Mac OS 10.6: Complete
Linux: Complete
Bookmarks/Library/History Waverly WinXP: Complete
Win7: Complete
Mac OS 10.6: Complete
Linux: Complete
Switch to Tab/Awesome Bar ashughes WinXP: Complete
Win7: Complete
Mac OS 10.6: Complete
Linux: Complete
Fullscreen Cameron, Waverly WinXP: Complete
Win7: Complete
Mac OS 10.6: ...
Linux: ...
Feedback (Test Pilot) aravindm WinXP: Completed
Win7: Completed
Mac OS 10.5: Completed
Linux: Completed
Printing marcia WinXP: in progress/complete or Not Run
Win7: ...
Mac OS 10.6: Completed
Linux: ...
Demos/Web Functionality Testing (Audio API) aravind WinXP: in progress/complete or Not Run
Win7: ...
Mac OS 10.6: ...
Linux: ...
Session Restore Waverly WinXP: Complete
Win7: Complete
Mac OS 10.6: Complete
Linux: Complete

Results Notes

Example Focus Area

  • WinXP: Issues can be noted here, such as bugs filed in the area using this platform. Make notes of issues that you encountered but didn't lead to a bug being filed. If you file a bug please add [4b5] in the Whiteboard field.
  • Mac OS 10.6: Issue...
  • Linux 10.4: Issue...

D2D

  • Win Vista
    • x64 had issues with Grafxbot extension. machine is running one version behind the recommended spec
  • Win 7:
    • Installed Grafxbot extension and completed a successful run - Machine is running DX9
  • Win 7:
    • Installed Grafxbot extension and completed a successful run - Machine is running DX10
  • Win XP
  • Mac 10.6
  • Linux (version): Issues...

Panorama (usability and keyboard shortcuts, interactions with private browsing, fullscreen, ...)

  • Win Vista: Issues ...
  • Win 7:
    • No new issues
  • Win XP: Issues...
  • Mac 10.6: Issues...
  • Linux (version): Issues...

Theme / Toolbar

  • bug 592638 - Lightweight Themes are not sorted alphabetically.
  • Able to reproduce the above bug in all the platforms.

Tabbed Browsing

  • Win 7 : No new issues found
  • Win XP : No new issues found
  • Mac (10.5): No new issues found
  • Linux (RHEL 5.3): No new issues found

Panorama

  • Win 7:
    • No new issues
  • Mac (version): Issues...
  • Linux (version): Issues...

OOPP

Bookmarks/Library/History

  • Win 7: bug 592650 list of bookmarks is flickering when using forward and back button
  • no problems found on other tested platforms

Ogg/WebM (video indexing/buffer)

  • bug 584638 .ogv video is choppy and flickering in full screen mode - reproduces all the time on Win XP SP3 and sometimes on Win 7

App Tabs

  • Windows XP : Drag and Drop of App Tab within the tab strip/ onto itself / onto the desktop turns into a normal one. Alternating the positing of App Tabs is not possible, as App tabs are creating on the beginning of the tab strip and drag and drop of App tab turns into normal one.
  • Windows 7 : Drag and Drop of App Tab within the tab strip/ onto itself / onto the desktop turns into a normal one. Alternating the positing of App Tabs is not possible, as App tabs are creating on the beginning of the tab strip and drag and drop of App tab turns into normal one.
  • Mac OS 10.5 : Drag and Drop of App Tab within the tab strip/ onto itself / onto the desktop turns into a normal one. Alternating the positing of App Tabs is not possible, as App tabs are creating on the beginning of the tab strip and drag and drop of App tab turns into normal one.
  • Linux :

Session Restore

  • No new problems found
  • Failed TC's are due to:
    • bug 579868 Restoring A Normal Closed Tab that was once a App Tab causes it to turn back into a App tab when restored
    • bug 587874 Undo Close Tab should only open tabs from the current group

Fullscreen

  • Win 7 : No new problems found. Failed TC's are due to:
    • bug 584638 .ogv video is choppy and flickering in full screen mode
    • bug 587140 Tab groups can push other groups across screen boundaries, making them invisible or causing groups to overlap

Feedback

  • No new problems found

Pop-ups

  • No new problems found

Add-ons Manager

  • Win 7 : No new problems found. Failed TC's are due to:
    • bug 584638 .ogv video is choppy and flickering in full screen mode
    • bug 573699 [Add-ons Manager]No notification bar displayed in Add-ons manager > Plugins when installed plugins are outdated
    • bug 592213 Java content not displayed properly after resizing the window and scrolling it
  • Mac OS 10.6
    • bug 547403 Java Embedding Plugin (JEP) won't run in the latest Firefox nightlies (3.7alpha2)
    • bug 573699 [Add-ons Manager]No notification bar displayed in Add-ons manager > Plugins when installed plugins are outdated

Panorama (usability and keyboard shortcuts)

  • keyboard shortcuts interactions with exclusive flash content sites, embedded flash sites ,Ogg/ Theora Media sites, Fullscreen, Tab )
  • Win 7 & Win XP & Linux
    • bug 594015 Shortcuts blocked by sites with exclusive flash content

Web Console

  • Note bug 583218 - "Web console" in menu isn't checked when it is open

Etc...