Releases/Firefox 4b8/Test Plan:Feature Area Testing: Difference between revisions
< Releases
Jump to navigation
Jump to search
Andreea.pod (talk | contribs) |
|||
| (38 intermediate revisions by 5 users not shown) | |||
| Line 34: | Line 34: | ||
|add-ons manager (FFT) | |add-ons manager (FFT) | ||
| Waverley (Vlad), Henrik | | Waverley (Vlad), Henrik | ||
|WinXP: '' | |WinXP: '''Complete''' <br> Win7: '''Complete''' <br> Mac OS 10.6: '''Complete''' <br> Linux: '''Complete''' | ||
|- | |- | ||
|toolbar customization (FFT) | |toolbar customization (FFT) | ||
| Line 41: | Line 41: | ||
|- | |- | ||
|app tabs (FFT or spreadsheet) | |app tabs (FFT or spreadsheet) | ||
|marcia, Waverley | |marcia, Waverley(spreadsheet) | ||
|WinXP: '' | |WinXP: '''Complete''' <br> Win7: '''Complete''' <br> Mac OS 10.6: '''Complete''' <br> Linux: '''Complete''' | ||
|- | |- | ||
|panorama (tab groups FFT) | |panorama (tab groups FFT) | ||
|Tracy, Waverley | |Tracy, Waverley | ||
|WinXP: '' | |WinXP: '''Complete''' <br> Win7: '''Complete''' <br> Mac OS 10.6: '''Complete''' <br> Linux: '''Complete''' | ||
|- | |- | ||
|[https://litmus.mozilla.org/run_tests.cgi?test_run_id=244 session store (FFT)] | |[https://litmus.mozilla.org/run_tests.cgi?test_run_id=244 session store (FFT)] | ||
| Line 62: | Line 62: | ||
|Sync (not ready until 12/01) | |Sync (not ready until 12/01) | ||
|Tracy, Waverley | |Tracy, Waverley | ||
|WinXP: ''in progress | |WinXP: '''in progress''' <br> Win7: '''Complete''' <br> Mac OS 10.6: '''Complete''' <br> Linux: '''in progress''' | ||
|- | |- | ||
|tab-modal prompts (no tests) | |tab-modal prompts (no tests) | ||
| Line 70: | Line 70: | ||
|hover over text (bug 572713) | |hover over text (bug 572713) | ||
|Waverley | |Waverley | ||
|WinXP: '' | |WinXP: '''Complete''' <br> Win7: '''Complete''' <br> Mac OS 10.6: '''Complete''' <br> Linux: '''Complete''' | ||
|- | |- | ||
|RTL (app tabs, panorama) | |RTL (app tabs, panorama) | ||
| Line 82: | Line 82: | ||
|[https://litmus.mozilla.org/run_tests.cgi?test_run_id=124 switch to tab (FFT)] | |[https://litmus.mozilla.org/run_tests.cgi?test_run_id=124 switch to tab (FFT)] | ||
|ashughes, Srinivas | |ashughes, Srinivas | ||
|WinXP: '''Complete(Srinivas)''' <br> Win7: '''Complete(Srinivas)''' <br> Mac OS 10. | |WinXP: '''Complete(Srinivas)''' <br> Win7: '''Complete(Srinivas)''' <br> Mac OS 10.6: ... <br> Linux: ... | ||
|- | |- | ||
|crash-reporter (using crashme extension on Mac 10.5) | |crash-reporter (using crashme extension on Mac 10.5) | ||
| Line 94: | Line 94: | ||
|QuickTime/Flash/Silverlight plugin detection/controls/playback/performance/ | |QuickTime/Flash/Silverlight plugin detection/controls/playback/performance/ | ||
|Waverley/Smartware | |Waverley/Smartware | ||
|WinXP: '''Complete''' <br> Win7: '''Complete''' <br> Mac OS 10.6: | |WinXP: '''Complete''' <br> Win7: '''Complete''' <br> Mac OS 10.6: '''Complete''' <br> Linux: '''Complete''' | ||
|- | |- | ||
|focus events | |focus events | ||
|Waverley | |Waverley | ||
|WinXP: '' | |WinXP: '''Complete''' <br> Win7: '''Complete''' <br> Mac OS 10.6: '''Complete''' <br> Linux: '''Complete''' | ||
|- | |- | ||
|webgl | |webgl | ||
| Line 131: | Line 131: | ||
== copy paste search == | == copy paste search == | ||
* Win ( | *Win (7): No issues seen | ||
* Mac (version): | *Win (xp): No issues seen | ||
* Linux (version): | *Mac (version): No issues seen | ||
*Linux (version): No issues seen | |||
== themes and lightweight themes (aravindm) == | == themes and lightweight themes (aravindm) == | ||
| Line 142: | Line 143: | ||
*Linux (version): No issues seen | *Linux (version): No issues seen | ||
== | == Toolbar Customization == | ||
* Win (version): New Bug Filed [https://bugzilla.mozilla.org/show_bug.cgi?id=615826 615826] | * Win (version): New Bug Filed [https://bugzilla.mozilla.org/show_bug.cgi?id=615826 615826] | ||
* Mac (version): | * Mac (version): Repeated Bug [https://bugzilla.mozilla.org/show_bug.cgi?id=615826 615826] | ||
* Linux (version): | * Linux (version): Repeated Bug [https://bugzilla.mozilla.org/show_bug.cgi?id=615826 615826] | ||
== | == Location Bar == | ||
*Win (7): No issues seen | |||
*Win (xp): No issues seen | |||
*Mac (version): No issues seen | |||
*Linux (version): No issues seen | |||
== Session Store (aravindm) == | |||
* Win (7): New Bug - {{bug|616080}} | * Win (7): New Bug - {{bug|616080}} | ||
* Win (xp): New Bug - {{bug|616080}} | * Win (xp): New Bug - {{bug|616080}} | ||
| Line 153: | Line 160: | ||
* Linux (Ubuntu): New Bug - {{bug|616080}} | * Linux (Ubuntu): New Bug - {{bug|616080}} | ||
== | == Sync (spreadsheet - Waverley) == | ||
* Win (7): New Bug - {{bug|616179}} | |||
* Win (xp): No new issues found | |||
* Mac (10.5.8): New Bug - {{bug|616488}} | |||
* Linux (Ubuntu): No new issues found | |||
* [https://spreadsheets.google.com/ccc?key=0AocUyLHteCtSdHNyLUVpUWpHdDlvWklwYmVaa2JMVXc&authkey=CJHPjucM&hl=en&pli=1#gid=1 Results] | |||
== QuickTime/Flash/Silverlight plugin detection/controls/playback/performance/ (aravindm, Waverley) == | |||
* Win (7): New Bug filed - {{bug|614487}}, Repeat bugs - {{bug|599556}}, {{bug|560146}}, {{bug|606161}} | * Win (7): New Bug filed - {{bug|614487}}, Repeat bugs - {{bug|599556}}, {{bug|560146}}, {{bug|606161}} | ||
* Win (xp): Repeat bugs - {{bug|599556}}, {{bug|560146}}, {{bug|606161}} | * Win (xp): Repeat bugs - {{bug|599556}}, {{bug|560146}}, {{bug|606161}} | ||
| Line 159: | Line 174: | ||
* Linux (Ubuntu): ... | * Linux (Ubuntu): ... | ||
== | == Theme (Fx button on Linux) (aravindm) == | ||
* Linux (Ubuntu): Fx button does not work in panorama view. | * Linux (Ubuntu): Fx button does not work in panorama view. | ||
== App Tabs (spreadsheet - Waverley) == | |||
* Win (7): {{bug|616943}}, {{bug|616967}} | |||
* Win (xp): {{bug|616943}}, {{bug|616967}} | |||
* Mac (10.6): {{bug|616943}}, {{bug|616967}} | |||
* Linux (Ubuntu 10.04): {{bug|616943}}, {{bug|616967}} | |||
* Issues: Many key combinations (key shortcuts) are inactive and can fail | |||
the app tabs vs. keyboard events interaction tests | |||
* [https://spreadsheets.google.com/ccc?key=0AmIl7oXCZpT6dG51a2hybkdKWUlURk1FZHVhZUFabHc&hl=en#gid=10 Results:] | |||
== Web Console (Waverley) == | |||
* win (7): no new blocking issues found | |||
* win (xp): no new blocking issues found | |||
* mac (10.6): no new blocking issues found | |||
* linux (Ubuntu 10.04): no new blocking issues found | |||
* [https://bugzilla.mozilla.org/buglist.cgi?field0-0-0=reporter&type0-0-1=equals&field0-0-1=reporter&value0-0-2=teodosia.pop%40softvision.ro&query_format=advanced&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&field0-0-2=reporter&value0-0-1=andreea.pod%40softvision.ro&type0-0-0=equals&value0-0-0=vlad.maniac%40softvision.ro&component=Developer%20Tools&type0-0-2=equals&product=Firefox bug query] | |||
* [https://spreadsheets.google.com/ccc?key=0AlsgObMBZ381dEpfNzFYM3BhVHdTMHJRM0tzMTdPZ3c&hl=en#gid=1 Results:] | |||
== Crash Reporter (Waverley) == | |||
* win (7): no new issues found | |||
* win (xp): no new issues found | |||
* mac (10.6): no new issues found | |||
* linux (Ubuntu 10.04): no new issues found | |||
* Results: in Litmus | |||
== Hover over text (Waverley) == | |||
* win (7): no new issues found | |||
* win (xp): no new issues found | |||
* mac (10.6): no new issues found | |||
* linux (Ubuntu 10.04): no new issues found | |||
* [https://spreadsheets.google.com/ccc?key=0AlsgObMBZ381dEpRTWdjMzkzR29QTDN2SXZEdTFJaEE&hl=en#gid=0 Results:] | |||
== Add-ons manager (Waverley) == | |||
* win (7): no new issues found | |||
* win (xp): no new issues found | |||
* mac (10.6): no new issues found | |||
* linux (Ubuntu 10.04): no new issues found | |||
* [https://spreadsheets.google.com/ccc?key=0AlsgObMBZ381dFVJRjZqQTFDSXZPV3lqd2JOUjEyckE&hl=en#gid=3 Results:] | |||
== Focus events (Waverley) == | |||
* win (7): {{bug|78414}} repeats | |||
* win (xp): {{bug|78414}} repeats | |||
* mac (10.6): no new issues found | |||
* linux (Ubuntu 10.04): {{bug|78414}} repeats | |||
* [https://spreadsheets.google.com/ccc?key=0AtXcW-WeHLLxdDJOZzFUNHVkSHhCYTFzYXVTNzctUVE&hl=en#gid=0 Results:] | |||
== Panorama (Waverley) == | |||
* win (7) : {{bug|617313}}, {{bug|617315}} | |||
* Results: in Litmus | |||
== Private Browsing (Waverley) == | |||
* win (7): no new issues found | |||
* win (xp): no new issues found | |||
* mac (10.6): no new issues found | |||
* linux (Ubuntu 10.04): no new issues found | |||
* Results: in Litmus | |||
== Places (Bookmarks/History) (Waverley) == | |||
* win (7): no new issues found | |||
* win (xp): no new issues found | |||
* mac (10.6): no new issues found | |||
* linux (Ubuntu 10.04): no new issues found | |||
* Results: in Litmus | |||
== Printing (Waverley) == | |||
* win (7): no new issues found | |||
* win (xp): no new issues found | |||
* mac (10.6): no new issues found | |||
* linux (Ubuntu 10.04): no new issues found | |||
* Results: in Litmus | |||
== RTL (App tabs, Panorama) (Waverley) == | |||
* win (7): no new issues found | |||
* win (xp): no new issues found | |||
* mac (10.6): no new issues found | |||
* linux (Ubuntu 10.04): no new issues found | |||
* Results: in Litmus | |||
== Panorama (Waverley) == | |||
* win (7): {{bug|618828}} | |||
* win (xp): {{bug|618828}} | |||
* mac (10.6): {{bug|618816}} | |||
* linux (Ubuntu 10.04): {{bug|618816}} | |||
* Results: in Litmus | |||
Latest revision as of 09:28, 14 December 2010
Firefox 4 Beta 8 Feature Area Testing
In addition to running all the Mozmill BFT automated tests, we'll run FFTs corresponding to areas of high priority using the catch-all FFT test run in Litmus as a guide, including exploratory testing.
- Download builds: ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/4.0b8-candidates/
- Use the nightlies if the build candidates are not available
Where there are no related Litmus or spreadsheet testcases it is up to the feature owners to test their areas.
| Focus Area | Tester | Status (detailed results at the bottom) |
|---|---|---|
| Cookies | Aravind | WinXP: Complete Win7:Complete Mac OS 10.5.8: Complete Linux: Complete |
| copy paste search | Srinivas | WinXP: Complete Win7: Complete Mac OS 10.5.8: Complete Linux: Complete |
| themes/lightweight themes | Aravind | WinXP: Complete Win7: Complete Mac OS 10.5.8: ... Linux: Complete |
| theme (Fx button on Linux ) | Aravind | WinXP: in progress/complete or Not Run Win7: ... Mac OS 10.6: ... Linux: Complete |
| add-ons manager (FFT) | Waverley (Vlad), Henrik | WinXP: Complete Win7: Complete Mac OS 10.6: Complete Linux: Complete |
| toolbar customization (FFT) | Srinivas | WinXP: Complete Win7: Complete Mac OS 10.5.8: Complete Linux: Complete |
| app tabs (FFT or spreadsheet) | marcia, Waverley(spreadsheet) | WinXP: Complete Win7: Complete Mac OS 10.6: Complete Linux: Complete |
| panorama (tab groups FFT) | Tracy, Waverley | WinXP: Complete Win7: Complete Mac OS 10.6: Complete Linux: Complete |
| session store (FFT) | Aravind | WinXP: Complete Win7: Complete Mac OS 10.5.8: Complete Linux: Complete |
| private browsing (FFT) | Waverley | WinXP: Complete Win7: Complete Mac OS 10.6: Complete Linux: Complete |
| places (bookmarks/history) (FFT) | Waverley | WinXP: Complete Win7: Complete Mac OS 10.6: Complete Linux: Complete |
| Sync (not ready until 12/01) | Tracy, Waverley | WinXP: in progress Win7: Complete Mac OS 10.6: Complete Linux: in progress |
| tab-modal prompts (no tests) | juanb | WinXP: in progress/complete or Not Run Win7: ... Mac OS 10.6: ... Linux: ... |
| hover over text (bug 572713) | Waverley | WinXP: Complete Win7: Complete Mac OS 10.6: Complete Linux: Complete |
| RTL (app tabs, panorama) | Waverley | WinXP: Complete Win7: Complete Mac OS 10.6: Complete Linux: Complete |
| location bar | Srinivas | WinXP: Complete Win7: Complete Mac OS 10.5.8: Complete Linux: Complete |
| switch to tab (FFT) | ashughes, Srinivas | WinXP: Complete(Srinivas) Win7: Complete(Srinivas) Mac OS 10.6: ... Linux: ... |
| crash-reporter (using crashme extension on Mac 10.5) | Waverley | WinXP: Complete Win7: Complete Mac OS 10.6: Complete Linux: Complete |
| Web Console | Waverley | WinXP: Complete Win7: Complete Mac OS 10.6: Complete Linux: Complete |
| QuickTime/Flash/Silverlight plugin detection/controls/playback/performance/ | Waverley/Smartware | WinXP: Complete Win7: Complete Mac OS 10.6: Complete Linux: Complete |
| focus events | Waverley | WinXP: Complete Win7: Complete Mac OS 10.6: Complete Linux: Complete |
| webgl | juanb | WinXP: in progress/complete or Not Run Win7: ... Mac OS 10.6: ... Linux: ... |
| printing (maps) | Waverley | WinXP: Complete Win7: Complete Mac OS 10.6: Complete Linux: Complete |
| text edit/copy/paste in text fields | Aravind | WinXP: Complete Win7: Complete Mac OS 10.5.8: Complete Linux: Complete |
| drag & drop tabs | juanb | WinXP: in progress/complete or Not Run Win7: ... Mac OS 10.6: ... Linux: ... |
Results Notes
Example Focus Area
- WinXP: Issues can be noted here, such as bugs filed in the area using this platform. Make notes of issues that you encountered but didn't lead to a bug being filed. If you file a bug please add [4b8] in the Whiteboard field.
- Mac OS 10.6: Issue...
- Linux 10.4: Issue...
Cookies (aravindm)
- Win (7): bug 513820 repeats
- Win XP : bug 513820 repeats
- Mac (10.5.8) : bug 513820 repeats
- Linux (Ubuntu): bug 513820 repeats
copy paste search
- Win (7): No issues seen
- Win (xp): No issues seen
- Mac (version): No issues seen
- Linux (version): No issues seen
themes and lightweight themes (aravindm)
- Win (7): No issues seen
- Win (xp): No issues seen
- Mac (version): No issues seen
- Linux (version): No issues seen
Toolbar Customization
- Win (version): New Bug Filed 615826
- Mac (version): Repeated Bug 615826
- Linux (version): Repeated Bug 615826
Location Bar
- Win (7): No issues seen
- Win (xp): No issues seen
- Mac (version): No issues seen
- Linux (version): No issues seen
Session Store (aravindm)
- Win (7): New Bug - bug 616080
- Win (xp): New Bug - bug 616080
- Mac (10.5.8): New Bug - bug 616080
- Linux (Ubuntu): New Bug - bug 616080
Sync (spreadsheet - Waverley)
- Win (7): New Bug - bug 616179
- Win (xp): No new issues found
- Mac (10.5.8): New Bug - bug 616488
- Linux (Ubuntu): No new issues found
QuickTime/Flash/Silverlight plugin detection/controls/playback/performance/ (aravindm, Waverley)
- Win (7): New Bug filed - bug 614487, Repeat bugs - bug 599556, bug 560146, bug 606161
- Win (xp): Repeat bugs - bug 599556, bug 560146, bug 606161
- Mac (10.5.8): ...
- Linux (Ubuntu): ...
Theme (Fx button on Linux) (aravindm)
- Linux (Ubuntu): Fx button does not work in panorama view.
App Tabs (spreadsheet - Waverley)
- Win (7): bug 616943, bug 616967
- Win (xp): bug 616943, bug 616967
- Mac (10.6): bug 616943, bug 616967
- Linux (Ubuntu 10.04): bug 616943, bug 616967
- Issues: Many key combinations (key shortcuts) are inactive and can fail
the app tabs vs. keyboard events interaction tests
Web Console (Waverley)
- win (7): no new blocking issues found
- win (xp): no new blocking issues found
- mac (10.6): no new blocking issues found
- linux (Ubuntu 10.04): no new blocking issues found
Crash Reporter (Waverley)
- win (7): no new issues found
- win (xp): no new issues found
- mac (10.6): no new issues found
- linux (Ubuntu 10.04): no new issues found
- Results: in Litmus
Hover over text (Waverley)
- win (7): no new issues found
- win (xp): no new issues found
- mac (10.6): no new issues found
- linux (Ubuntu 10.04): no new issues found
Add-ons manager (Waverley)
- win (7): no new issues found
- win (xp): no new issues found
- mac (10.6): no new issues found
- linux (Ubuntu 10.04): no new issues found
Focus events (Waverley)
- win (7): bug 78414 repeats
- win (xp): bug 78414 repeats
- mac (10.6): no new issues found
- linux (Ubuntu 10.04): bug 78414 repeats
Panorama (Waverley)
- win (7) : bug 617313, bug 617315
- Results: in Litmus
Private Browsing (Waverley)
- win (7): no new issues found
- win (xp): no new issues found
- mac (10.6): no new issues found
- linux (Ubuntu 10.04): no new issues found
- Results: in Litmus
Places (Bookmarks/History) (Waverley)
- win (7): no new issues found
- win (xp): no new issues found
- mac (10.6): no new issues found
- linux (Ubuntu 10.04): no new issues found
- Results: in Litmus
Printing (Waverley)
- win (7): no new issues found
- win (xp): no new issues found
- mac (10.6): no new issues found
- linux (Ubuntu 10.04): no new issues found
- Results: in Litmus
RTL (App tabs, Panorama) (Waverley)
- win (7): no new issues found
- win (xp): no new issues found
- mac (10.6): no new issues found
- linux (Ubuntu 10.04): no new issues found
- Results: in Litmus
Panorama (Waverley)
- win (7): bug 618828
- win (xp): bug 618828
- mac (10.6): bug 618816
- linux (Ubuntu 10.04): bug 618816
- Results: in Litmus