Releases/Firefox 4b4/Test Plan:Feature Area Testing

From MozillaWiki
Jump to navigation Jump to search

Fx 4b4 Test Plan

Firefox 4 Beta 4 BFTs

In addition to running all the Mozmill BFT automated tests, we'll run BFTs corresponding to areas of high priority using the following BFT test run in Litmus as a guide.

Where there are no related Litmus testcases it is up to the feature owners to test their areas.

Some Notes

A big chunk of the functionality below can be grouped into tabbed browsing. Some of the items below like "Undo Window/Tab Close" are not features, but they are things which I wanted to call out individually, which should be checked in tabbed browser, but as a combination when using Tab Candy (Tab Sets) which was one of the major features that landed.

Focus Area Tester Status (detailed results at the bottom)
Firefox Sync Tracy WinXP: in progress/complete or Not Run
Win7: ...
Mac OS 10.6: ...
Linux: ...
Tab Candy (Tab Sets) Tracy WinXP: in progress/complete or Not Run
Win7: Completed
Mac OS 10.6: ...
Linux: ...
App Tabs marcia WinXP: in progress/complete or Not Run
Win7: gmontagu
Mac OS 10.6: ...
Linux: ...
Session Store (in relation to tabbed browsing) ashughes WinXP: in progress/complete or Not Run
Win7: ...
Mac OS 10.6: ...
Linux: ...
Undo Window/Tab Close ashughes WinXP: in progress/complete or Not Run
Win7: ...
Mac OS 10.6: ...
Linux: ...
Interaction with Feedback add-on (install, upgrade) tester WinXP: in progress/complete or Not Run
Win7: ...
Mac OS 10.6: ...
Linux: ...
Tab Previews in Win7 gmontagu Win7: Completed
Tab Drag and Drop and Tear Off aravindm WinXP: Completed
Win7: ...
Mac OS 10.6: ...
Linux: Completed
Switch to Tab ashughes WinXP: in progress/complete or Not Run
Win7: Completed
Mac OS 10.6: ...
Linux: ...
Tabbed Browser (in general) ahoza WinXP: Completed
Win7: Completed
Mac OS 10.6: Completed
Linux: Completed
Places (Bookmarks and History) vlad WinXP: Completed
Win7: Completed
Mac OS 10.6: Completed
Linux: Completed
Toolbar and Theme aravindm WinXP: Completed
Win7: in progress/complete
Mac OS 10.6: in progress/complete
Linux: Completed
Add-ons Manager tester WinXP: in progress/complete or Not Run
Win7: ...
Mac OS 10.6: ...
Linux: ...
Fullscreen (interactions with Tab Candy) ahoza WinXP: Completed
Win7: Completed
Mac OS 10.6: Completed
Linux: Completed
OOPP (crash reporting on Mac, key events) marcia WinXP: in progress/complete or Not Run
Win7: ...
Mac OS 10.6: in progress
Linux: ...
Web Console/Inspect Tomcat WinXP: in progress/complete or Not Run
Win7: ...
Mac OS 10.6: ...
Linux: ...
OOPP tester WinXP: in progress/complete or Not Run
Win7: ...
Mac OS 10.6: ...
Linux: ...
Layers marcia WinXP: in progress/complete or Not Run
Win7: ...
Mac OS 10.6: ...
Linux: ...
Open Video (ogg and WebM) vlad WinXP: Completed
Win7: Completed
Mac OS 10.6: Completed
Linux: Completed
Private Browsing (with Tab Candy) tester WinXP: in progress/complete or Not Run
Win7: ...
Mac OS 10.6: ...
Linux: ...

Results Notes

Example Focus Area

  • WinXP: Issues can be noted here, such as bugs filed in the area using this platform. Make notes of issues that you encountered but didn't lead to a bug being filed. If you file a bug please add [4b4] in the Whiteboard field.
  • Mac OS 10.6: Issue...
  • Linux 10.4: Issue...

Mac OOPP

  • Mac 10.6 (OOPP crash reporting now available in this build for 10.1 Versions of Flash and the new Java Plugin only)
    • Note that only one crash report will be generated since the hang part isn't hooked up yet.
    • Several bugs filed, including: bug 588241 and bug 588445
    • Noticed some lagginess when switching tabs, but so far have not been able to consistently reproduce.
  • 10.5 plugins run in process so this testing does not apply specifically to that OS

Layers

  • Most of the bugs will be surfaced from crash data.
    • bug 588591 found by sifting through early crash data

Firefox Sync

  • Win (version): Issues...
  • Mac (version): Issues...
  • Linux (version): Issues...

Tab Candy

  • Win XP: Issues...
  • Win 7: No issues found
  • Mac (version): Issues...
  • Linux (version): Issues...

Toolbar and Theme

  • Win XP: Personas does not sort alphabetically after installing 30 themes even by clicking name. Need to close and open the addons manager tab to get sorted alphabetically. Able to see 31 themes in the Themes Tab. Clicking on remove themes does not remove themes. Need to close and open the Addons manager for the themes tab to get refreshed.
  • Win 7:
  • Mac (version): Issues...
  • Linux (RHEL 5.3): Clicking on remove themes does not remove themes. Need to close and open the Addons manager for the themes tab to get refreshed.

Tab Drag and Drop and Tear Off

  • Win XP: No issues seen.
  • Win 7:
  • Mac (version): Issues...
  • Linux (version): No issues seen.

Tabbed Browser (in general)

  • Win XP: No new problems found
  • Win 7: No issues found
  • Mac 10.6: No new problems found
  • Linux (Ubuntu 10.04): No new problems found

Fullscreen (interactions with Tab Candy)

  • Win XP: No new problems found
  • Win 7: No new problems found
  • Mac 10.6: added an issue in .xls file
  • Linux (Ubuntu 10.04): No new problems found

Places (Bookmarks & History)

  • Win XP: No new problems found
  • Win 7(32): No new problems found
  • Mac 10.6: No new problems found
  • Linux (Ubuntu 10.04): No new problems found

Tab Previews in Win 7

  • Win 7(32): Zoom on a page doesn't reflect on the thumbnail. No Recent section on Jump Lists. Maybe this is due to my Spanish Windows 7 version because my Spanish version IE8 shows just the same. Frequent section shows "Frequent" in English but Tasks is in Spanish: "Tareas". This may be due to the same.

Switch to Tab

  • Win 7(32): No issues found

Open video (ogg & WebM)

  • Win XP: No new problems found
  • Win 7(32): No new problems found
  • Mac 10.6: No new problems found
  • Linux (Ubuntu 10.04): No new problems found