QA/Firefox3.5/TestPlan: Difference between revisions

 
(81 intermediate revisions by 9 users not shown)
Line 1: Line 1:
<small>[[Firefox3.1|&laquo; Firefox3.1]]</small>
<small>[[Firefox3.5|&laquo; Firefox3.5]]</small>


== <FONT COLOR=RED>'''Top Critical issues for QA'''</FONT> ==
== <FONT COLOR=RED>'''Top Critical issues for QA'''</FONT> ==
Line 8: Line 8:
* Major bugs blocking your feature that should be addressed?
* Major bugs blocking your feature that should be addressed?
* Major bugs blocking overall regression of the trunk that should be fixed before shipping?
* Major bugs blocking overall regression of the trunk that should be fixed before shipping?
=== Blocking Next Milestone and Beyond ===


== Overview ==
== Overview ==
Line 20: Line 22:
* Milestone testing
* Milestone testing


[[Firefox3.1|Firefox 3.1 Central]]
[[Firefox3.5|Firefox 3.5 Central]]


== Requirements and Scheduling ==  
== Requirements and Scheduling ==  
* [[Firefox3.1/Features|Fx3.1 Firefox Product Requirements]]
* [[Firefox3.5/Features|Fx3.5 Firefox Product Requirements]]
** [[Firefox3.1/StatusMeetings/2008-07-15#Firefox_3.1| '''A more update list of features''']]
** [[Firefox3.1/StatusMeetings/2008-07-15#Firefox_3.1| '''A more update list of features''']]
* [[Firefox3.1/Schedule|Fx3.1 Schedule]]
* [[Firefox3.5/Schedule|Fx3.5 Schedule]]
* [[Testplan/TestPlanReview|Test Plan Review Schedule]]
* [[Testplan/TestPlanReview|Test Plan Review Schedule]]


== Test Results ==  
== Test Results ==  


* [[QA/Firefox3.5/TestPlan/Live| Live Results]]
* [[QA/Firefox3.5/TestPlan/RC3|RC3 Results]]
* [[QA/Firefox3.5/TestPlan/RC2|RC2 Results]]
* [[QA/Firefox3.5/TestPlan/RC1|RC1 Results]]
* [[QA/Firefox3.5/TestPlan/BetaPreview|Beta Preview Results]]
* [[QA/Firefox3.5/TestPlan/Beta4|Beta 4 Results]]
* [[QA/Firefox3.1/TestPlan/Beta3|Beta 3 Results]]
* [[QA/Firefox3.1/TestPlan/Beta2|Beta 2 Results]]
* [[QA/Firefox3.1/TestPlan/Beta1|Beta 1 Results]]
* [[QA/Firefox3.1/TestPlan/Beta1|Beta 1 Results]]
* [[QA/Firefox3.1/TestPlan/Alpha2|Alpha 2 Results]]
* [[QA/Firefox3.1/TestPlan/Alpha2|Alpha 2 Results]]
Line 139: Line 149:
* SVG in CSS is mostly covered by two bugs: {{bug|448831}} and {{bug|450340}}
* SVG in CSS is mostly covered by two bugs: {{bug|448831}} and {{bug|450340}}
* <strike>{{bug|276431}} - external SVG not loaded from img tag </strike>
* <strike>{{bug|276431}} - external SVG not loaded from img tag </strike>
* <strike>SVG Image Decoding '''CUT'''</strike>
* '''CUT''' <strike>SVG Image Decoding </strike>
|-
|-
|WHATWG <canvas> text API
|WHATWG <canvas> text API
Line 154: Line 164:
* browser zoom {{bug|442133}}
* browser zoom {{bug|442133}}
* bidi resolution {{bug|402276}}
* bidi resolution {{bug|402276}}
* '''AT RISK''' font baselines {{bug|438702}}
* '''CUT''' <strike> font baselines {{bug|438702}}</strike>
|-
|-
|Border Image  
|Border Image  
Line 265: Line 275:
* [http://ed.agadak.net/2008/07/firefox-31-restricts-matches-keywords Mardak's blog post]
* [http://ed.agadak.net/2008/07/firefox-31-restricts-matches-keywords Mardak's blog post]
|-
|-
|Ctrl-Tab
|Clear Private Data Enhancements
|[[QA/Firefox3.1/Ctrl-Tab_Test_Plan|Ctrl Tab Test Plan]]
|[[QA/Firefox3.1/CPD_TestPlan|Test Plan]]
|marcia
|Marcia (related to PB)
|Johnathan Nightingale
|S
|Ff
|
* [http://people.mozilla.com/~faaborg/files/shiretoko/privacy_i2.png Flowchart]
* {{Bug|453440}} - Extend "Clear Private Data" dialog with time period option
* {{Bug|463607}} - Interaction of Clear Recent History dialog and the private browsing mode
|-
|<del>Ctrl-Tab</del>
|<del>[[QA/Firefox3.1/Ctrl-Tab_Test_Plan|Ctrl Tab Test Plan]]</del>
|<del>marcia</del>
|Dao
|Dao
|S
|S
|Ff
|Ff
|
|
* UPDATE - feature cut for 1.9.1
* [http://jboriss.wordpress.com/2008/07/16/control-tab-a-new-feature-for-firefox/ Boriss's blog post]
* [http://jboriss.wordpress.com/2008/07/16/control-tab-a-new-feature-for-firefox/ Boriss's blog post]
* {{Bug|395980}} - Ctrl-Tab bug and dependencies
* {{Bug|395980}} - Ctrl-Tab bug and dependencies
* Beta 2: {{Bug|436304}} -  Implement "All Tabs" panel with previews
* Beta 2: {{Bug|436304}} -  Implement "All Tabs" panel with previews
|-
|-
|Exiting the Browser Experience
|Session Restore 
|[https://wiki.mozilla.org/QA/Firefox3.1/Session_Restore_Test_Plan Session Restore Test Plan]
|marcia
|Dietrich
|S
|Ff
|
* [https://bugzilla.mozilla.org/attachment.cgi?id=336774 UI Mockups]
* {{Bug|339445}} - Session store should save/restore sessionStorage data (from DOMStorage)
* {{Bug|448976}} - turn the Session Restore prompt into an error page (and dependent bugs)
* [http://tinyurl.com/59zlpf Relevant bugs fixed in the timeframe]
* [http://mxr.mozilla.org/mozilla-central/source/browser/components/sessionstore/test/browser/ Unit Tests]
|-
|<del>Exiting the Browser Experience</del>
|?
|?
|Tomcat
|Tomcat
Line 283: Line 318:
|Ff
|Ff
|?
|?
* Need owner
* <del>Need owner </del>
|-
|-
|Search Text Widget
|Search Text Widget
Line 295: Line 330:
** [https://bugzilla.mozilla.org/showdependencytree.cgi?id=388811&hide_resolved=1 Dependency bugs] blocked
** [https://bugzilla.mozilla.org/showdependencytree.cgi?id=388811&hide_resolved=1 Dependency bugs] blocked
* {{Bug|406095}} – add emptyText property to textbox
* {{Bug|406095}} – add emptyText property to textbox
|-
|-  
|SMIL
|<del>SMIL</del>
|[[QA/Firefox3.1/SMIL_Testplan|SMIL testplan]]
|<del>[[QA/Firefox3.1/SMIL_Testplan|SMIL testplan]]</del>
|Martijn
|<del>Martijn</del>
|dholbert
|<del>dholbert</del>
|S
|S
|Pf
|Pf
Line 346: Line 381:
|Ff
|Ff
|
|
* Beta1: {{Bug|445181}} – Firefox upgrades don't check for remote extension compatability
* Beta2: {{Bug|324121}} – Extensions with available updates for the next version of the app should not be listed in app update extension will be disabled warning
* Beta2: {{Bug|324121}} – Extensions with available updates for the next version of the app should not be listed in app update extension will be disabled warning
* waiting for rob on review, needs testing  
** Resolved Fixed, needs testing
* Beta 2: {{Bug|455906}} -  Support severities for blocklist entries
** Resolved Fixed, Need to finish hard block testing
* {{Bug|421470}} – Software update does not download/update even it is set to automatic
* {{Bug|421470}} – Software update does not download/update even it is set to automatic
** No fix in site
* Beta 2: {{Bug|407875}} -  Unprivileged users are not notified of security updates
* Beta 2: {{Bug|407875}} -  Unprivileged users are not notified of security updates
** Flagged for beta 2, but no patch in sight yet.
* {{Bug|434155}} – Help -> Check for Updates does not verify add-on compatibility
* {{Bug|434155}} – Help -> Check for Updates does not verify add-on compatibility
** Resolved Fixed, needs testing
* {{Bug|434465}} – Software update's background add-on update check ignores updated compatibility
* {{Bug|434465}} – Software update's background add-on update check ignores updated compatibility
* '''CUT:''' <del> {{Bug|392180}} – Provide force variable to use in the updateURL </del>  
** Fixed by {{Bug|324121}}.  Test that bug, and this bug is good.
* '''CUT''' <strike> {{Bug|392180}} – Provide force variable to use in the updateURL </strike>  
* Beta2: Plugin blocklist  - {{bug|391714}}, {{bug|449027}}, {{bug|391728}}
* Beta2: Plugin blocklist  - {{bug|391714}}, {{bug|449027}}, {{bug|391728}}
|-
|-
|Memory Leaks
|Memory Leaks
|[http://wiki.mozilla.org/QA:Home_Page:Firefox_3.0_TestPlan:Leaks Memory Leaks Test Plan]
|[http://wiki.mozilla.org/QA:Home_Page:Firefox_3.0_TestPlan:Leaks:3.1manualtest Memory Leaks Test Plan]
|Tomcat
|Tomcat
|Tomcat
|Tomcat
Line 373: Line 413:
|
|
* Spec: http://www.whatwg.org/specs/web-apps/current-work/multipage/offline.html
* Spec: http://www.whatwg.org/specs/web-apps/current-work/multipage/offline.html
* {{Bug|422526}} - implement localStorage
* '''CUT for 3.1''' <strike> {{Bug|422526}} - implement localStorage </strike>
* {{bug|442806}} - Use separate, versioned caches for offline apps (and dependencies)
* {{bug|442806}} - Use separate, versioned caches for offline apps (and dependencies)
* {{bug|442813}} - Implement fallback entries (and dependencies)
* {{bug|442813}} - Implement fallback entries (and dependencies)
Line 403: Line 443:
* add on & related bugs: {{bug|448674}}, {{bug|448603}}
* add on & related bugs: {{bug|448674}}, {{bug|448603}}
* {{Bug|448909}} -  Need more controls WHATWG Video tag (video front end work)
* {{Bug|448909}} -  Need more controls WHATWG Video tag (video front end work)
* [http://jboriss.wordpress.com/2008/09/19/html-5-video-tag-pirate-edition/ Video Scrubber Blog]
** {{Bug|462113}} -  Implement progress bar / scrubber for video controls
* {{Bug|470596}} -  css border breaks video controls
|-
|-
|JavaScript 1.8.1
|JavaScript 1.8.1
Line 415: Line 458:
* Currently testing 1.9.1 mozilla-central and 1.9.1 tracemonkey branches.
* Currently testing 1.9.1 mozilla-central and 1.9.1 tracemonkey branches.
* [http://tinyurl.com/6bjn7b JavaScript Tests Needed]
* [http://tinyurl.com/6bjn7b JavaScript Tests Needed]
*
* '''At Risk''' {{Bug|445178}} - ES 3.1 Decimal Support
|-
|-
|CSS Transitions
|<del>CSS Transitions</del>
|?
|<del>?</del>
|mw22 and/or ctalbert
|<del>mw22 and/or ctalbert</del>
|Zwol, Jonathon Jongsma
|<del>Zwol, Jonathon Jongsma</del>
|
|
|Pf
|Pf
|  
|  
* '''Update''' - postponed out of 3.1?
*'''CUT''' <strike> {{bug|435441}} - main bug <strike>
*{{bug|435441}} - main bug
*[http://webkit.org/specs/CSSVisualEffects/CSSTransitions.html The spec]  
*[http://webkit.org/specs/CSSVisualEffects/CSSTransitions.html The spec]  
|}
|}
Line 441: Line 483:
|class="header"|FF or Platform?
|class="header"|FF or Platform?
|class="header"|Description
|class="header"|Description
|-
|<strike>Windows TSF integration</strike>
|<strike>?</strike>
|<strike>??, Gary Kwong (only IME QA)</strike>
|<strike>roc, Masayuki, jim chen</strike>
|<strike>S</strike>
|<strike>Pf</strike>
|
* '''Update - Feature is pushed to post 1.9.1'''
<strike>
* {{Bug|88831}}
* [http://msdn.microsoft.com/en-us/library/ms629032%28VS.85%29.aspx TSF Spec]
* [https://wiki.mozilla.org/Firefox3.1/TSF_Security_Review Security Review]</strike>
|-
|Linkified View Source
|[https://wiki.mozilla.org/QA/Firefox3.1/ViewSource_Testplan here]
|Curtis Bartley
|Curtis Bartley
|S
|Ff
|
* [http://blog.johnath.com/2008/11/11/new-in-firefox-31-linkified-view-source/ Blog post]
* Beta 2: {{Bug|17612}} - view-source link-browsing
* {{Bug|455888}} - Make View Source not suck (view source meta bug)
* {{Bug|455948}} -  The view source window should have a toolbar with toggle-line-wrap and goto-line buttons
* {{Bug|455945}} -  View Source should "linkify" links in the source -- i.e. show them as clickable hyperlinks
* {{Bug|246620}} - Add line numbers to View Source for Firefox
* {{Bug|464314}} - view-source link-browsing doesn't decode entities
* {{Bug|79518}} - tracking view source UI
|-
|-
|Improved CMS performance  
|Improved CMS performance  
Line 460: Line 531:
|
|
* {{Bug|418454}} - Add support for Aero Glass effects to Widget layer
* {{Bug|418454}} - Add support for Aero Glass effects to Widget layer
* {{Bug|367993}} -  Make Firefox have the Translucent theme like IE7 
* Need unit tests.  Landed
* Need unit tests.  Landed
|}
|}
=== Operating System test plans ===
*[https://wiki.mozilla.org/QA/Firefox3.5/Snow_Leopard_Test_Plan Snow Leopard test plan]


=== Regression Areas ===
=== Regression Areas ===
Line 475: Line 550:
* L10N Testing (may coincide with Feature area)
* L10N Testing (may coincide with Feature area)
* Distribution Testing (may coincide with Feature area)
* Distribution Testing (may coincide with Feature area)
== Tiger Team Testing ==
Daily smoketests are ran against nightly trunk builds.  Please see marcia for more information.


Link to [http://wiki.mozilla.org/MozillaQualityAssurance:Home_Page:Firefox_3.0_TestPlan:Fx3_QA_Daily_Smoketest Schedule and Assignments]
Link to [http://wiki.mozilla.org/MozillaQualityAssurance:Home_Page:Firefox_3.0_TestPlan:Fx3_QA_Daily_Smoketest Schedule and Assignments]
Line 490: Line 562:


== Banking and Financial Sites ==
== Banking and Financial Sites ==
For these types of sites, we’re asking community members and MoCo QA to [[QA/Firefox3/TestPlan/Banking|state which banks and financial institutions they're willing to test]]. Please add your name to the list.
For these types of sites, we’re asking community members and MoCo QA to [[QA#Website_Testing|state which banks and financial institutions they're willing to test]]. Please add your name to the list.


== L10n Testing with Third Parties ==
== L10n Testing with Third Parties ==
Line 504: Line 576:
* [http://crash-stats.mozilla.com/?do_query=1&product=Firefox&branch=1.9&query_search=signature&query_type=contains&query=&date=&range_value=1&range_unit=weeks Breakpad Crash Reporter]
* [http://crash-stats.mozilla.com/?do_query=1&product=Firefox&branch=1.9&query_search=signature&query_type=contains&query=&date=&range_value=1&range_unit=weeks Breakpad Crash Reporter]
* [http://forums.mozillazine.org/ Mozillazine Forums]  
* [http://forums.mozillazine.org/ Mozillazine Forums]  
== QA / Support Team Issues ==
Add any common issues you are finding during your nightly /release testing that you feel would be good for Mozilla support to be aware of.
* See [https://wiki.mozilla.org/QA/Topcrashes#Current_topcrashes_being_tracked_3.1b1 Topcrashers in beta 1]
* Private Browsing has landed, but bugs are being found as we speak 
* Ctrl-Tab preview pane has landed, but bugs are being found as we speak 


== Additional References ==  
== Additional References ==  
This section is left to add any additional references relevant to the Firefox 3.1 project
This section is left to add any additional references relevant to the Firefox 3.1 project
[[Category:Shiretoko|TestPlan]]
canmove, Confirmed users
7,108

edits