Releases/Firefox 4b8/Test Plan:Feature Area Testing: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(25 intermediate revisions by 4 users not shown)
Line 46: Line 46:
|panorama (tab groups FFT)
|panorama (tab groups FFT)
|Tracy, Waverley
|Tracy, Waverley
|WinXP: ''in progress/complete or Not Run'' <br> Win7: ... <br> Mac OS 10.6: ... <br> Linux: ...
|WinXP: '''Complete''' <br> Win7: '''Complete''' <br> Mac OS 10.6: '''Complete''' <br> Linux: '''Complete'''
|-
|-
|[https://litmus.mozilla.org/run_tests.cgi?test_run_id=244 session store (FFT)]
|[https://litmus.mozilla.org/run_tests.cgi?test_run_id=244 session store (FFT)]
Line 62: Line 62:
|Sync (not ready until 12/01)
|Sync (not ready until 12/01)
|Tracy, Waverley
|Tracy, Waverley
|WinXP: ''in progress/complete or Not Run'' <br> Win7: ... <br> Mac OS 10.6: ... <br> Linux: ...
|WinXP: '''in progress''' <br> Win7: '''Complete''' <br> Mac OS 10.6: '''Complete''' <br> Linux: '''in progress'''
|-
|-
|tab-modal prompts (no tests)
|tab-modal prompts (no tests)
Line 82: Line 82:
|[https://litmus.mozilla.org/run_tests.cgi?test_run_id=124 switch to tab (FFT)]
|[https://litmus.mozilla.org/run_tests.cgi?test_run_id=124 switch to tab (FFT)]
|ashughes, Srinivas
|ashughes, Srinivas
|WinXP: '''Complete(Srinivas)''' <br> Win7: '''Complete(Srinivas)''' <br> Mac OS 10.5.8: '''Complete(Srinivas)''' <br> Linux: ...
|WinXP: '''Complete(Srinivas)''' <br> Win7: '''Complete(Srinivas)''' <br> Mac OS 10.6: ... <br> Linux: ...
|-
|-
|crash-reporter (using crashme extension on Mac 10.5)
|crash-reporter (using crashme extension on Mac 10.5)
Line 98: Line 98:
|focus events
|focus events
|Waverley
|Waverley
|WinXP: ''in progress/complete or Not Run'' <br> Win7: ... <br> Mac OS 10.6: ... <br> Linux: ...
|WinXP: '''Complete''' <br> Win7: '''Complete''' <br> Mac OS 10.6: '''Complete''' <br> Linux: '''Complete'''
|-
|-
|webgl
|webgl
Line 159: Line 159:
* Mac (10.5.8): New Bug - {{bug|616080}}
* Mac (10.5.8): New Bug - {{bug|616080}}
* Linux (Ubuntu): New Bug - {{bug|616080}}
* Linux (Ubuntu): New Bug - {{bug|616080}}
== Sync (spreadsheet - Waverley) ==
* Win (7): New Bug - {{bug|616179}}
* Win (xp): No new issues found
* Mac (10.5.8): New Bug - {{bug|616488}}
* Linux (Ubuntu): No new issues found
* [https://spreadsheets.google.com/ccc?key=0AocUyLHteCtSdHNyLUVpUWpHdDlvWklwYmVaa2JMVXc&authkey=CJHPjucM&hl=en&pli=1#gid=1 Results]


== QuickTime/Flash/Silverlight plugin detection/controls/playback/performance/ (aravindm, Waverley) ==
== QuickTime/Flash/Silverlight plugin detection/controls/playback/performance/ (aravindm, Waverley) ==
Line 168: Line 176:
== Theme (Fx button on Linux) (aravindm) ==
== Theme (Fx button on Linux) (aravindm) ==
* Linux (Ubuntu): Fx button does not work in panorama view.
* Linux (Ubuntu): Fx button does not work in panorama view.
== App Tabs (spreadsheet - Waverley) ==
* Win (7): {{bug|616943}}, {{bug|616967}}
* Win (xp): {{bug|616943}}, {{bug|616967}}
* Mac (10.6): {{bug|616943}}, {{bug|616967}}
* Linux (Ubuntu 10.04): {{bug|616943}}, {{bug|616967}}
* Issues:  Many key combinations (key shortcuts) are inactive and can fail
the app tabs vs. keyboard events interaction tests
* [https://spreadsheets.google.com/ccc?key=0AmIl7oXCZpT6dG51a2hybkdKWUlURk1FZHVhZUFabHc&hl=en#gid=10 Results:]
== Web Console (Waverley) ==
* win (7): no new blocking issues found
* win (xp): no new blocking issues found
* mac (10.6): no new blocking issues found
* linux (Ubuntu 10.04): no new blocking issues found
* [https://bugzilla.mozilla.org/buglist.cgi?field0-0-0=reporter&type0-0-1=equals&field0-0-1=reporter&value0-0-2=teodosia.pop%40softvision.ro&query_format=advanced&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&field0-0-2=reporter&value0-0-1=andreea.pod%40softvision.ro&type0-0-0=equals&value0-0-0=vlad.maniac%40softvision.ro&component=Developer%20Tools&type0-0-2=equals&product=Firefox bug query]
* [https://spreadsheets.google.com/ccc?key=0AlsgObMBZ381dEpfNzFYM3BhVHdTMHJRM0tzMTdPZ3c&hl=en#gid=1 Results:]
== Crash Reporter (Waverley) ==
* win (7): no new issues found
* win (xp): no new issues found
* mac (10.6): no new issues found
* linux (Ubuntu 10.04): no new issues found
* Results: in Litmus
== Hover over text (Waverley) ==
* win (7): no new issues found
* win (xp): no new issues found
* mac (10.6): no new issues found
* linux (Ubuntu 10.04): no new issues found
* [https://spreadsheets.google.com/ccc?key=0AlsgObMBZ381dEpRTWdjMzkzR29QTDN2SXZEdTFJaEE&hl=en#gid=0 Results:]
== Add-ons manager (Waverley) ==
* win (7): no new issues found
* win (xp): no new issues found
* mac (10.6): no new issues found
* linux (Ubuntu 10.04): no new issues found
* [https://spreadsheets.google.com/ccc?key=0AlsgObMBZ381dFVJRjZqQTFDSXZPV3lqd2JOUjEyckE&hl=en#gid=3 Results:]
== Focus events (Waverley) ==
* win (7): {{bug|78414}} repeats
* win (xp): {{bug|78414}} repeats
* mac (10.6): no new issues found
* linux (Ubuntu 10.04): {{bug|78414}} repeats
* [https://spreadsheets.google.com/ccc?key=0AtXcW-WeHLLxdDJOZzFUNHVkSHhCYTFzYXVTNzctUVE&hl=en#gid=0 Results:]
== Panorama (Waverley) ==
* win (7) : {{bug|617313}}, {{bug|617315}}
* Results: in Litmus
== Private Browsing (Waverley) ==
* win (7): no new issues found
* win (xp): no new issues found
* mac (10.6): no new issues found
* linux (Ubuntu 10.04): no new issues found
* Results: in Litmus
== Places (Bookmarks/History) (Waverley) ==
* win (7): no new issues found
* win (xp): no new issues found
* mac (10.6): no new issues found
* linux (Ubuntu 10.04): no new issues found
* Results: in Litmus
== Printing (Waverley) ==
* win (7): no new issues found
* win (xp): no new issues found
* mac (10.6): no new issues found
* linux (Ubuntu 10.04): no new issues found
* Results: in Litmus
== RTL (App tabs, Panorama) (Waverley) ==
* win (7): no new issues found
* win (xp): no new issues found
* mac (10.6): no new issues found
* linux (Ubuntu 10.04): no new issues found
* Results: in Litmus
== Panorama (Waverley) ==
* win (7): {{bug|618828}}
* win (xp): {{bug|618828}} 
* mac (10.6): {{bug|618816}}
* linux (Ubuntu 10.04): {{bug|618816}}
* Results: in Litmus

Latest revision as of 09:28, 14 December 2010

Fx 4b8 Test Plan

Firefox 4 Beta 8 Feature Area Testing

In addition to running all the Mozmill BFT automated tests, we'll run FFTs corresponding to areas of high priority using the catch-all FFT test run in Litmus as a guide, including exploratory testing.

Where there are no related Litmus or spreadsheet testcases it is up to the feature owners to test their areas.

Focus Area Tester Status (detailed results at the bottom)
Cookies Aravind WinXP: Complete
Win7:Complete
Mac OS 10.5.8: Complete
Linux: Complete
copy paste search Srinivas WinXP: Complete
Win7: Complete
Mac OS 10.5.8: Complete
Linux: Complete
themes/lightweight themes Aravind WinXP: Complete
Win7: Complete
Mac OS 10.5.8: ...
Linux: Complete
theme (Fx button on Linux ) Aravind WinXP: in progress/complete or Not Run
Win7: ...
Mac OS 10.6: ...
Linux: Complete
add-ons manager (FFT) Waverley (Vlad), Henrik WinXP: Complete
Win7: Complete
Mac OS 10.6: Complete
Linux: Complete
toolbar customization (FFT) Srinivas WinXP: Complete
Win7: Complete
Mac OS 10.5.8: Complete
Linux: Complete
app tabs (FFT or spreadsheet) marcia, Waverley(spreadsheet) WinXP: Complete
Win7: Complete
Mac OS 10.6: Complete
Linux: Complete
panorama (tab groups FFT) Tracy, Waverley WinXP: Complete
Win7: Complete
Mac OS 10.6: Complete
Linux: Complete
session store (FFT) Aravind WinXP: Complete
Win7: Complete
Mac OS 10.5.8: Complete
Linux: Complete
private browsing (FFT) Waverley WinXP: Complete
Win7: Complete
Mac OS 10.6: Complete
Linux: Complete
places (bookmarks/history) (FFT) Waverley WinXP: Complete
Win7: Complete
Mac OS 10.6: Complete
Linux: Complete
Sync (not ready until 12/01) Tracy, Waverley WinXP: in progress
Win7: Complete
Mac OS 10.6: Complete
Linux: in progress
tab-modal prompts (no tests) juanb WinXP: in progress/complete or Not Run
Win7: ...
Mac OS 10.6: ...
Linux: ...
hover over text (bug 572713) Waverley WinXP: Complete
Win7: Complete
Mac OS 10.6: Complete
Linux: Complete
RTL (app tabs, panorama) Waverley WinXP: Complete
Win7: Complete
Mac OS 10.6: Complete
Linux: Complete
location bar Srinivas WinXP: Complete
Win7: Complete
Mac OS 10.5.8: Complete
Linux: Complete
switch to tab (FFT) ashughes, Srinivas WinXP: Complete(Srinivas)
Win7: Complete(Srinivas)
Mac OS 10.6: ...
Linux: ...
crash-reporter (using crashme extension on Mac 10.5) Waverley WinXP: Complete
Win7: Complete
Mac OS 10.6: Complete
Linux: Complete
Web Console Waverley WinXP: Complete
Win7: Complete
Mac OS 10.6: Complete
Linux: Complete
QuickTime/Flash/Silverlight plugin detection/controls/playback/performance/ Waverley/Smartware WinXP: Complete
Win7: Complete
Mac OS 10.6: Complete
Linux: Complete
focus events Waverley WinXP: Complete
Win7: Complete
Mac OS 10.6: Complete
Linux: Complete
webgl juanb WinXP: in progress/complete or Not Run
Win7: ...
Mac OS 10.6: ...
Linux: ...
printing (maps) Waverley WinXP: Complete
Win7: Complete
Mac OS 10.6: Complete
Linux: Complete
text edit/copy/paste in text fields Aravind WinXP: Complete
Win7: Complete
Mac OS 10.5.8: Complete
Linux: Complete
drag & drop tabs juanb WinXP: in progress/complete or Not Run
Win7: ...
Mac OS 10.6: ...
Linux: ...

Results Notes

Example Focus Area

  • WinXP: Issues can be noted here, such as bugs filed in the area using this platform. Make notes of issues that you encountered but didn't lead to a bug being filed. If you file a bug please add [4b8] in the Whiteboard field.
  • Mac OS 10.6: Issue...
  • Linux 10.4: Issue...

Cookies (aravindm)

copy paste search

  • Win (7): No issues seen
  • Win (xp): No issues seen
  • Mac (version): No issues seen
  • Linux (version): No issues seen

themes and lightweight themes (aravindm)

  • Win (7): No issues seen
  • Win (xp): No issues seen
  • Mac (version): No issues seen
  • Linux (version): No issues seen

Toolbar Customization

  • Win (version): New Bug Filed 615826
  • Mac (version): Repeated Bug 615826
  • Linux (version): Repeated Bug 615826

Location Bar

  • Win (7): No issues seen
  • Win (xp): No issues seen
  • Mac (version): No issues seen
  • Linux (version): No issues seen

Session Store (aravindm)

Sync (spreadsheet - Waverley)

  • Win (7): New Bug - bug 616179
  • Win (xp): No new issues found
  • Mac (10.5.8): New Bug - bug 616488
  • Linux (Ubuntu): No new issues found

QuickTime/Flash/Silverlight plugin detection/controls/playback/performance/ (aravindm, Waverley)

Theme (Fx button on Linux) (aravindm)

  • Linux (Ubuntu): Fx button does not work in panorama view.

App Tabs (spreadsheet - Waverley)

  • Issues: Many key combinations (key shortcuts) are inactive and can fail

the app tabs vs. keyboard events interaction tests

Web Console (Waverley)

  • win (7): no new blocking issues found
  • win (xp): no new blocking issues found
  • mac (10.6): no new blocking issues found
  • linux (Ubuntu 10.04): no new blocking issues found


Crash Reporter (Waverley)

  • win (7): no new issues found
  • win (xp): no new issues found
  • mac (10.6): no new issues found
  • linux (Ubuntu 10.04): no new issues found
  • Results: in Litmus

Hover over text (Waverley)

  • win (7): no new issues found
  • win (xp): no new issues found
  • mac (10.6): no new issues found
  • linux (Ubuntu 10.04): no new issues found

Add-ons manager (Waverley)

  • win (7): no new issues found
  • win (xp): no new issues found
  • mac (10.6): no new issues found
  • linux (Ubuntu 10.04): no new issues found

Focus events (Waverley)

Panorama (Waverley)

Private Browsing (Waverley)

  • win (7): no new issues found
  • win (xp): no new issues found
  • mac (10.6): no new issues found
  • linux (Ubuntu 10.04): no new issues found
  • Results: in Litmus

Places (Bookmarks/History) (Waverley)

  • win (7): no new issues found
  • win (xp): no new issues found
  • mac (10.6): no new issues found
  • linux (Ubuntu 10.04): no new issues found
  • Results: in Litmus

Printing (Waverley)

  • win (7): no new issues found
  • win (xp): no new issues found
  • mac (10.6): no new issues found
  • linux (Ubuntu 10.04): no new issues found
  • Results: in Litmus

RTL (App tabs, Panorama) (Waverley)

  • win (7): no new issues found
  • win (xp): no new issues found
  • mac (10.6): no new issues found
  • linux (Ubuntu 10.04): no new issues found
  • Results: in Litmus

Panorama (Waverley)

  • Results: in Litmus
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_4b8/Test_Plan:Feature_Area_Testing&oldid=273420"