Releases/Firefox 4b4/Test Plan:Feature Area Testing

Fx 4b4 Test Plan

Firefox 4 Beta 4 BFTs

In addition to running all the Mozmill BFT automated tests, we'll run BFTs corresponding to areas of high priority using the following BFT test run in Litmus as a guide.

• Download builds: ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b4-candidates/
• Use Litmus testrun: https://litmus.mozilla.org/run_tests.cgi?test_run_id=199

Where there are no related Litmus testcases it is up to the feature owners to test their areas.

Some Notes

A big chunk of the functionality below can be grouped into tabbed browsing. Some of the items below like "Undo Window/Tab Close" are not features, but they are things which I wanted to call out individually, which should be checked in tabbed browser, but as a combination when using Tab Candy (Tab Sets) which was one of the major features that landed.

Focus Area	Tester	Status (detailed results at the bottom)
Firefox Sync	Tracy	WinXP: Completed Win7: Completed Mac OS 10.6: Completed Linux: ...
Tab Candy (Tab Sets)	Tracy	WinXP: Completed Win7: Completed Mac OS 10.6: Completed Linux: ...
App Tabs	marcia	WinXP: Completed Win7: Completed Mac OS 10.6: Completed Linux: ...
Session Store (in relation to tabbed browsing) Test cases for testers without a Litmus account	ashughes	WinXP: COMPLETE Win7: COMPLETE Mac OS 10.6: COMPLETE Linux: COMPLETE
Undo Window/Tab Close	ashughes	WinXP: COMPLETE Win7: COMPLETE Mac OS 10.6: COMPLETE Linux: COMPLETE
Interaction with Feedback add-on (install, upgrade)	aravindm	WinXP: Completed Win7: Completed Mac OS 10.5: Completed Linux: Completed
Tab Previews in Win7	gmontagu	Win7: Completed
Tab Drag and Drop and Tear Off	aravindm	WinXP: Completed Win7: Completed Mac OS 10.5: Completed Linux: Completed
Switch to Tab	ashughes	WinXP: COMPLETE Win7: COMPLETE Mac OS 10.6: COMPLETE Linux: COMPLETE
Tabbed Browser (in general)	ahoza	WinXP: Completed Win7: Completed Mac OS 10.6: Completed Linux: Completed
Places (Bookmarks and History)	vlad	WinXP: Completed Win7: Completed Mac OS 10.6: Completed Linux: Completed
Toolbar and Theme	aravindm	WinXP: Completed Win7: Completed Mac OS 10.5: Completed Linux: Completed
Add-ons Manager	vlad	WinXP: Completed Win7: Completed Mac OS 10.6: Completed Linux: Completed
Fullscreen (interactions with Tab Candy)	ahoza	WinXP: Completed Win7: Completed Mac OS 10.6: Completed Linux: Completed
OOPP (crash reporting on Mac, key events)	marcia	Mac OS 10.6: Completed
Web Console/Inspect	Tomcat	WinXP: Completed Win7: Completed Mac OS 10.6: Completed Linux: Completed
OOPP	marcia	WinXP: Completed Win7: Completed Linux: ...
Layers	marcia	Cannot be easily tested. Will review crash results to surface issues.
Open Video (ogg and WebM)	vlad	WinXP: Completed Win7: Completed Mac OS 10.6: Completed Linux: Completed
Private Browsing (with Tab Candy)	ahoza	WinXP: Completed Win7: Completed Mac OS 10.6: Completed Linux: Completed

Results Notes

Example Focus Area

• WinXP: Issues can be noted here, such as bugs filed in the area using this platform. Make notes of issues that you encountered but didn't lead to a bug being filed. If you file a bug please add [4b4] in the Whiteboard field.
• Mac OS 10.6: Issue...
• Linux 10.4: Issue...

Mac OOPP

• Mac 10.6 (OOPP crash reporting now available in this build for 10.1 Versions of Flash and the new Java Plugin only)
  • Note that only one crash report will be generated since the hang part isn't hooked up yet.
  • Several bugs filed, including: bug 588241 and bug 588445
  • Noticed some lagginess when switching tabs, but so far have not been able to consistently reproduce.
• 10.5 plugins run in process so this testing does not apply specifically to that OS

Layers

• Most of the bugs will be surfaced from crash data.
  • bug 588591 found by sifting through early crash data
• bug 564991 is the bug about implementation of layers, that's where regression are being tracked.

Firefox Sync

• Win (Win 7, XP): no blocking issues found
• Mac (10.6): no blocking issues found
• Linux (version): Issues...

Tab Candy

• Win (Win 7, XP): no blocking issues found
• Mac (10.6): no blocking issues found
• Linux (version): Issues...

Toolbar and Theme

• Win XP: Personas does not sort alphabetically after installing 30 themes even by clicking name. Need to close and open the addons manager tab to get sorted alphabetically. Able to see 31 themes in the Themes Tab. Clicking on remove themes does not remove themes. Need to close and open the Addons manager for the themes tab to get refreshed.
• Win 7:Clicking on remove themes does not remove themes. Need to close and open the Addons manager for the themes tab to get refreshed.
• Mac (10.5.2): Clicking on remove themes does not remove themes. Need to close and open the Addons manager for the themes tab to get refreshed.
• Linux (RHEL 5.3): Clicking on remove themes does not remove themes. Need to close and open the Addons manager for the themes tab to get refreshed.

Tab Drag and Drop and Tear Off

• Win XP: No issues seen.
• Win 7: No issues seen.
• Mac (10.5.2): No issues seen.
• Linux (RHEL 5.3): No issues seen.

Tabbed Browser (in general)

• Win XP: No new problems found
• Win 7: No issues found
• Mac 10.6: No new problems found
• Linux (Ubuntu 10.04): No new problems found

Fullscreen (interactions with Tab Candy)

• Win XP: No new problems found
• Win 7: No new problems found
• Mac 10.6: added an issue in .xls file
• Linux (Ubuntu 10.04): No new problems found

Places (Bookmarks & History)

• Win XP: No new problems found
• Win 7(32): No new problems found
• Mac 10.6: No new problems found
• Linux (Ubuntu 10.04): No new problems found

Tab Previews in Win 7

• Win 7(32): Zoom on a page doesn't reflect on the thumbnail.
  • No Recent section on Jump Lists. Maybe this is due to my Spanish Windows 7 version because my Spanish version IE8 shows just the same. Frequent section shows "Frequent" in English but Tasks is in Spanish: "Tareas". This may be due to the same.

Open video (ogg & WebM)

• Win XP: No new problems found
• Win 7(32): No new problems found
• Mac 10.6: No new problems found
• Linux (Ubuntu 10.04): No new problems found

Interaction with Feedback add-on (install, upgrade)

• Win XP:
• Win 7:
• Mac 10.5: ...
• Linux (RHEL 5.3): ...

Private Browsing (with Tab Candy)

• bug 588727 One tab group should be present while in private browsing

App Tabs

• Win XP:
• Win 7: Drag and Drop: the App Tab turns into a normal one. The bug has already been filed.
  • Create a combination of App Tabs and regular tabs and alternate their position, if possible, then cycle through them using the keyboard: Alternate position is not possible because the App Tabs turns into normal ones. The bug has already been filed.
• Mac: ...
• Linux: ...

Session Restore

• Windows XP: No issues found
• Windows 7: No issues found
• Mac OSX 10.6: No issues found
• Ubuntu 9.10: No issues found
• Mac 64-bit: No issues found
• Linux 64-bit: No issues found
• Interactions:
  • Tab Candy: No major issues found. Need developer feedback for specifics.
  • App Tabs: No major issues found. Need developer feedback for specifics.
• Bugs Filed:
  • bug 589324 - Switch-to-Tab after Session Restore does not respect Tab Candy grouping

Switch To Tab

• Windows XP: No issues found
• Windows 7: No issues found
• Mac OSX 10.6: No issues found
• Ubuntu 9.10: No issues found
• Mac 64-bit: No issues found
• Linux 64-bit: No issues found
• Interactions:
  • Tab Candy: No major issues found. Need developer feedback for specifics.
  • App Tabs: No major issues found. Need developer feedback for specifics.