Extension Manager/QA: Difference between revisions

 
(33 intermediate revisions by 4 users not shown)
Line 1: Line 1:
=Add-ons Manager Test Plan=
=Add-ons Manager Test Plan=
This page contains information for version-wide testing activities of the [https://wiki.mozilla.org/Extension_Manager/ Add-ons Manager]. You will also find links to test plans of specific Firefox releases.
This page contains information for version-wide testing activities of the [https://wiki.mozilla.org/Extension_Manager Add-ons Manager]. You will also find links to test plans of specific Firefox releases.


== Feature Tracking ==
== Feature Tracking ==
Listed features on this page have been extracted from the [[Firefox/Flight_Tracking|Flight Tracking]] page.  
Listed features on this page have been extracted from the [[Firefox/Flight_Tracking|Flight Tracking]] page.  


===Firefox 8===
<table class="querytable sortable">
{{BannerNightly|date=Aug 16, 2011}}
<tr>
{| class="fullwidth-table sortable" style="width: 800px;"
<td class="header" style="width: 25%;">Feature</td>
| style="font-weight: bold; background: #DDD;" | Feature
<td class="header" style="width: 10%;">Release</td>
| style="font-weight: bold; background: #DDD;" | Status  
<td class="header" style="width: 10%;">Dev Status</td>
| style="font-weight: bold; background: #DDD;" | ETA
<td class="header" style="width: 5%;">Health</td>
| style="font-weight: bold; background: #DDD;" | Owner
<td class="header" style="width: 10%;">A11y Status</td>
| style="font-weight: bold; background: #DDD;" | Sign-off
<td class="header" style="width: 10%;">L10n Status</td>
|-
<td class="header" style="width: 10%;">QA Status</td>
{{#lst:Extension_Manager:Projects:Third_Party_Add-on_Warnings|status}}
<td class="header" style="width: 15%;">QA Lead</td>
| TBD
</tr>
|-
{{#ask: [[Category:Feature Page]] [[Feature roadmap::Add-ons||Plugin Interactions]]
{{#lst:Extension_Manager:Projects:Confirm_on_Upgrade|status}}
[[Feature version::Firefox14||Firefox13||Firefox12||Firefox 11||Firefox 10]]
| TBD
| ?#
|-
| ?Feature name#
{{#lst:Firefox/Features/Expose_Add-on_Performance|status}}
| ?Feature version#
| TBD
| ?Feature stage#
|}
| ?Feature health#
 
| ?Feature accessibility status#
===Firefox 7===
| ?Feature localization status #
{{BannerAurora|date=Aug 16, 2011}}
| ?Feature qa status#
{| class="fullwidth-table sortable" style="width: 800px;"
| ?Feature qa lead#
| style="font-weight: bold; background: #DDD;" | Feature  
| mainlabel=-
| style="font-weight: bold; background: #DDD;" | Status
| sort=Feature version
| style="font-weight: bold; background: #DDD;" | ETA
| order=descending
| style="font-weight: bold; background: #DDD;" | Owner
| format=template
| style="font-weight: bold; background: #DDD;" | Sign-off
| template=QATrackingTable
|-
}}
{{#lst:Extension_Manager:Projects:Embedded_Add-on_Preferences|status}}
</table>
| Done
|}


===Firefox 6===
===Older Releases===
{{BannerBeta|date=Aug 16, 2011}}
New features added to previous versions of Firefox can be found in the [[Extension_Manager/QA/Archive|archive]].
{| class="fullwidth-table sortable" style="width: 800px;"
| style="font-weight: bold; background: #DDD;" | Feature
| style="font-weight: bold; background: #DDD;" | Status
| style="font-weight: bold; background: #DDD;" | ETA
| style="font-weight: bold; background: #DDD;" | Owner
| style="font-weight: bold; background: #DDD;" | Sign-off
|-
{{#lst:Features/Firefox/PlugincheckLinkInAOM|status}}
| Done
|}
 
===Firefox 5===
{| class="fullwidth-table sortable" style="width: 800px;"
| style="font-weight: bold; background: #DDD;" | Feature
| style="font-weight: bold; background: #DDD;" | Status
| style="font-weight: bold; background: #DDD;" | ETA
| style="font-weight: bold; background: #DDD;" | Owner
| style="font-weight: bold; background: #DDD;" | Sign-off
|-
| No listed new features
|
|
|
|
|}


== Bug Queries ==
== Bug Queries ==
Line 79: Line 52:
| [https://bugzilla.mozilla.org/buglist.cgi?status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=closeme&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&component=Add-ons%20Manager&product=Toolkit closeme]
| [https://bugzilla.mozilla.org/buglist.cgi?status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=closeme&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&component=Add-ons%20Manager&product=Toolkit closeme]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=DUPLICATE&query_format=advanced&bug_status=RESOLVED&component=Add-ons%20Manager&product=Toolkit duplicate]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=DUPLICATE&query_format=advanced&bug_status=RESOLVED&component=Add-ons%20Manager&product=Toolkit duplicate]
|-
| Firefox 14
| [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&component=Add-ons%20Manager&product=Toolkit&version=14%20Branch open]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&query_format=advanced&bug_status=RESOLVED&component=Add-ons%20Manager&product=Toolkit&target_milestone=mozilla14 fixed]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&query_format=advanced&bug_status=VERIFIED&component=Add-ons%20Manager&product=Toolkit&target_milestone=mozilla14 verified]
| [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&field0-0-0=flagtypes.name&type0-0-0=equals&value0-0-0=in-litmus%3F&component=Add-ons%20Manager&resolution=FIXED&target_milestone=mozilla14 in-limus?]
| [https://bugzilla.mozilla.org/buglist.cgi?keywords=qawanted%2C%20&keywords_type=allwords&query_format=advanced&component=Add-ons%20Manager&product=Toolkit&version=14%20Branch qawanted]
| [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&bug_status=UNCONFIRMED&component=Add-ons%20Manager&product=Toolkit&version=14%20Branch unconf]
| [https://bugzilla.mozilla.org/buglist.cgi?status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=closeme&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&component=Add-ons%20Manager&product=Toolkit&version=14&20Branch closeme]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=DUPLICATE&query_format=advanced&bug_status=RESOLVED&component=Add-ons%20Manager&product=Toolkit&version=14%20Branch duplicate]
|-
| Firefox 13
| [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&component=Add-ons%20Manager&product=Toolkit&version=13%20Branch open]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&query_format=advanced&bug_status=RESOLVED&component=Add-ons%20Manager&product=Toolkit&target_milestone=mozilla13 fixed]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&query_format=advanced&bug_status=VERIFIED&component=Add-ons%20Manager&product=Toolkit&target_milestone=mozilla13 verified]
| [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&field0-0-0=flagtypes.name&type0-0-0=equals&value0-0-0=in-litmus%3F&component=Add-ons%20Manager&resolution=FIXED&target_milestone=mozilla13 in-limus?]
| [https://bugzilla.mozilla.org/buglist.cgi?keywords=qawanted%2C%20&keywords_type=allwords&query_format=advanced&component=Add-ons%20Manager&product=Toolkit&version=13%20Branch qawanted]
| [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&bug_status=UNCONFIRMED&component=Add-ons%20Manager&product=Toolkit&version=13%20Branch unconf]
| [https://bugzilla.mozilla.org/buglist.cgi?status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=closeme&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&component=Add-ons%20Manager&product=Toolkit&version=13&20Branch closeme]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=DUPLICATE&query_format=advanced&bug_status=RESOLVED&component=Add-ons%20Manager&product=Toolkit&version=13%20Branch duplicate]
|-
| Firefox 12
| [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&component=Add-ons%20Manager&product=Toolkit&version=12%20Branch open]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&query_format=advanced&bug_status=RESOLVED&component=Add-ons%20Manager&product=Toolkit&target_milestone=mozilla12 fixed]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&query_format=advanced&bug_status=VERIFIED&component=Add-ons%20Manager&product=Toolkit&target_milestone=mozilla12 verified]
| [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&field0-0-0=flagtypes.name&type0-0-0=equals&value0-0-0=in-litmus%3F&component=Add-ons%20Manager&resolution=FIXED&target_milestone=mozilla12 in-limus?]
| [https://bugzilla.mozilla.org/buglist.cgi?keywords=qawanted%2C%20&keywords_type=allwords&query_format=advanced&component=Add-ons%20Manager&product=Toolkit&version=12%20Branch qawanted]
| [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&bug_status=UNCONFIRMED&component=Add-ons%20Manager&product=Toolkit&version=12%20Branch unconf]
| [https://bugzilla.mozilla.org/buglist.cgi?status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=closeme&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&component=Add-ons%20Manager&product=Toolkit&version=12&20Branch closeme]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=DUPLICATE&query_format=advanced&bug_status=RESOLVED&component=Add-ons%20Manager&product=Toolkit&version=12%20Branch duplicate]
|-
| Firefox 11
| [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&component=Add-ons%20Manager&product=Toolkit&version=11%20Branch open]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&query_format=advanced&bug_status=RESOLVED&component=Add-ons%20Manager&product=Toolkit&target_milestone=mozilla11 fixed]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&query_format=advanced&bug_status=VERIFIED&component=Add-ons%20Manager&product=Toolkit&target_milestone=mozilla11 verified]
| [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&field0-0-0=flagtypes.name&type0-0-0=equals&value0-0-0=in-litmus%3F&component=Add-ons%20Manager&resolution=FIXED&target_milestone=mozilla11 in-limus?]
| [https://bugzilla.mozilla.org/buglist.cgi?keywords=qawanted%2C%20&keywords_type=allwords&query_format=advanced&component=Add-ons%20Manager&product=Toolkit&version=11%20Branch qawanted]
| [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&bug_status=UNCONFIRMED&component=Add-ons%20Manager&product=Toolkit&version=11%20Branch unconf]
| [https://bugzilla.mozilla.org/buglist.cgi?status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=closeme&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&component=Add-ons%20Manager&product=Toolkit&version=11&20Branch closeme]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=DUPLICATE&query_format=advanced&bug_status=RESOLVED&component=Add-ons%20Manager&product=Toolkit&version=11%20Branch duplicate]
|-
| Firefox 10
| [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&component=Add-ons%20Manager&product=Toolkit&version=10%20Branch open]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&query_format=advanced&bug_status=RESOLVED&component=Add-ons%20Manager&product=Toolkit&target_milestone=mozilla10 fixed]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&query_format=advanced&bug_status=VERIFIED&component=Add-ons%20Manager&product=Toolkit&target_milestone=mozilla10 verified]
| [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&field0-0-0=flagtypes.name&type0-0-0=equals&value0-0-0=in-litmus%3F&component=Add-ons%20Manager&resolution=FIXED&target_milestone=mozilla10 in-limus?]
| [https://bugzilla.mozilla.org/buglist.cgi?keywords=qawanted%2C%20&keywords_type=allwords&query_format=advanced&component=Add-ons%20Manager&product=Toolkit&version=10%20Branch qawanted]
| [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&bug_status=UNCONFIRMED&component=Add-ons%20Manager&product=Toolkit&version=10%20Branch unconf]
| [https://bugzilla.mozilla.org/buglist.cgi?status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=closeme&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&component=Add-ons%20Manager&product=Toolkit&version=10&20Branch closeme]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=DUPLICATE&query_format=advanced&bug_status=RESOLVED&component=Add-ons%20Manager&product=Toolkit&version=10%20Branch duplicate]
|-
| Firefox 9
| [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&component=Add-ons%20Manager&product=Toolkit&version=9%20Branch open]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&query_format=advanced&bug_status=RESOLVED&component=Add-ons%20Manager&product=Toolkit&target_milestone=mozilla9 fixed]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&query_format=advanced&bug_status=VERIFIED&component=Add-ons%20Manager&product=Toolkit&target_milestone=mozilla9 verified]
| [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&field0-0-0=flagtypes.name&type0-0-0=equals&value0-0-0=in-litmus%3F&component=Add-ons%20Manager&resolution=FIXED&target_milestone=mozilla9 in-limus?]
| [https://bugzilla.mozilla.org/buglist.cgi?keywords=qawanted%2C%20&keywords_type=allwords&query_format=advanced&component=Add-ons%20Manager&product=Toolkit&version=9%20Branch qawanted]
| [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&bug_status=UNCONFIRMED&component=Add-ons%20Manager&product=Toolkit&version=9Branch unconf]
| [https://bugzilla.mozilla.org/buglist.cgi?status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=closeme&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&component=Add-ons%20Manager&product=Toolkit&version=9%20Branch closeme]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=DUPLICATE&query_format=advanced&bug_status=RESOLVED&component=Add-ons%20Manager&product=Toolkit&version=9%20Branch duplicate]
|-
|-
| Firefox 8
| Firefox 8
| [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&component=Add-ons%20Manager&product=Toolkit&version=Trunk open]
| [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&component=Add-ons%20Manager&product=Toolkit&version=8%20Branch open]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&query_format=advanced&bug_status=RESOLVED&component=Add-ons%20Manager&product=Toolkit&target_milestone=mozilla8 fixed]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&query_format=advanced&bug_status=RESOLVED&component=Add-ons%20Manager&product=Toolkit&target_milestone=mozilla8 fixed]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&query_format=advanced&bug_status=VERIFIED&component=Add-ons%20Manager&product=Toolkit&target_milestone=mozilla8 verified]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&query_format=advanced&bug_status=VERIFIED&component=Add-ons%20Manager&product=Toolkit&target_milestone=mozilla8 verified]
| [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&field0-0-0=flagtypes.name&type0-0-0=equals&value0-0-0=in-litmus%3F&component=Add-ons%20Manager&resolution=FIXED&target_milestone=mozilla8 in-limus?]
| [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&field0-0-0=flagtypes.name&type0-0-0=equals&value0-0-0=in-litmus%3F&component=Add-ons%20Manager&resolution=FIXED&target_milestone=mozilla8 in-limus?]
| [https://bugzilla.mozilla.org/buglist.cgi?keywords=qawanted%2C%20&keywords_type=allwords&query_format=advanced&component=Add-ons%20Manager&product=Toolkit&version=Trunk qawanted]
| [https://bugzilla.mozilla.org/buglist.cgi?keywords=qawanted%2C%20&keywords_type=allwords&query_format=advanced&component=Add-ons%20Manager&product=Toolkit&version=8%20Branch qawanted]
| [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&bug_status=UNCONFIRMED&component=Add-ons%20Manager&product=Toolkit&version=Trunk unconf]
| [https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&bug_status=UNCONFIRMED&component=Add-ons%20Manager&product=Toolkit&version=8%20Branch unconf]
| [https://bugzilla.mozilla.org/buglist.cgi?status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=closeme&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&component=Add-ons%20Manager&product=Toolkit&version=Trunk closeme]
| [https://bugzilla.mozilla.org/buglist.cgi?status_whiteboard_type=allwordssubstr&query_format=advanced&status_whiteboard=closeme&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&component=Add-ons%20Manager&product=Toolkit&version=8%20Branch closeme]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=DUPLICATE&query_format=advanced&bug_status=RESOLVED&component=Add-ons%20Manager&product=Toolkit&version=Trunk duplicate]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=DUPLICATE&query_format=advanced&bug_status=RESOLVED&component=Add-ons%20Manager&product=Toolkit&version=8%20Branch duplicate]
|-
|-
| Firefox 7
| Firefox 7
Line 120: Line 153:
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=DUPLICATE&query_format=advanced&bug_status=RESOLVED&component=Add-ons%20Manager&product=Toolkit&version=5%20Branch duplicate]
| [https://bugzilla.mozilla.org/buglist.cgi?resolution=DUPLICATE&query_format=advanced&bug_status=RESOLVED&component=Add-ons%20Manager&product=Toolkit&version=5%20Branch duplicate]
|}
|}
* A list of the tracked bugs can be found in this [http://bit.ly/oyRXLy spreadsheet]


== Manual Tests (Litmus) ==
== Manual Tests (Litmus) ==
Line 143: Line 177:


=== Mozmill Tests ===
=== Mozmill Tests ===
Our mozmill tests for the Extension Manager are found under hg
; [http://hg.mozilla.org/qa/mozmill-tests/file/d17ed98def90/tests/functional/testAddons functional/testAddons]
; [http://hg.mozilla.org/qa/mozmill-tests/file/d17ed98def90/tests/functional/restartTests functional/restartTests]


== Events ==
== Events ==
Line 152: Line 190:
* 2011/05/14: [http://groups.google.com/group/mozilla.dev.platform/browse_thread/thread/7a5a21afbc9843dc# Making disabling add-ons installation actually do something useful]
* 2011/05/14: [http://groups.google.com/group/mozilla.dev.platform/browse_thread/thread/7a5a21afbc9843dc# Making disabling add-ons installation actually do something useful]
* 2011/04/19: [http://blog.mozilla.com/addons/2011/04/19/add-on-compatibility-rapid-releases/ Add-on Compatibility & Rapid Releases]
* 2011/04/19: [http://blog.mozilla.com/addons/2011/04/19/add-on-compatibility-rapid-releases/ Add-on Compatibility & Rapid Releases]
* 2011/08/11: [http://blog.mozilla.com/addons/2011/08/11/strengthening-user-control-of-add-ons/ Strengthening User Control of Add-ons]
750

edits