TestEngineering/UI/AMO/AddonCompatibleByDefault

From MozillaWiki
Jump to navigation Jump to search

Compatible by default

The vast majority of add-ons work from one version of Firefox to the next without the need for developer maintenance, but under the current system, compatibility information must be updated in order for Firefox to enable the add-on for use. For add-ons hosted on AMO, this is done automatically. However, 75% of add-ons in use are not hosted on AMO, and are therefore a major compatibility obstacle for our users. All of the compatibility effort put into each release is simply because Firefox still assumes add-ons will be incompatible between versions, when they usually aren't.

We should change Firefox's assumption to be that add-ons are compatible, with a few exceptions. Binary add-ons are never compatible between releases and are also the highest risk of negative side effects. Firefox should automatically enable low-risk (non-binary) add-ons in new versions of Firefox, and check AMO for additional compatibility information.

When users upgrade to a new version of Firefox, only the add-ons that are actually incompatible should be disabled, and the rest are assumed to be compatible. Because Nightly, Aurora, and Beta users will test out the add-ons for weeks before stable users, we should be able to identify and blacklist incompatible add-ons before stable users would be affected by a truly incompatible add-on.


Status

Feature Status Lead engineer QA Lead Status
Add-ons Default To Compatible In Progress Rob Hudson Krupa Raj In Progress

Tracking bug

bug 694658

Testing Matrix

browsers: Firefox 3.6-10 platforms: WinXP, Windows 7, Windows Vista, MAC OS X, Linux

Settings

In your about:config settings, hange the following setting in your about:config
extensions.update.url to

Settings for Firefox:

https://addons.allizom.org/update/VersionCheck.php?reqVersion=%REQ_VERSION%&id=%ITEM_ID%&version=%ITEM_VERSION%&maxAppVersion=%ITEM_MAXAPPVERSION%&status=%ITEM_STATUS%&appID=%APP_ID%&appVersion=%APP_VERSION%&appOS=%APP_OS%&appABI=%APP_ABI%&locale=%APP_LOCALE%&currentAppVersion=%CURRENT_APP_VERSION%&updateType=%UPDATE_TYPE%

Settings for Fennec:

https://versioncheck.addons.mozilla.org/update/VersionCheck.php?reqVersion=%REQ_VERSION%&id=%ITEM_ID%&version=%ITEM_VERSION%&maxAppVersion=%ITEM_MAXAPPVERSION%&status=%ITEM_STATUS%&appID=%APP_ID%&appVersion=%APP_VERSION%&appOS=%APP_OS%&appABI=%APP_ABI%&locale=%APP_LOCALE%&currentAppVersion=%CURRENT_APP_VERSION%&updateType=%UPDATE_TYPE%



Usecase Scenarios:

Update Check

testcase 1: Check that add-ons are compatible by default while upgrading: Firefox 3.6 to Firefox 10

testcase 2: Check that add-ons are compatible by default while upgrading: Firefox 4.0.1 to Firefox 10

testcase 3: Check that add-ons are compatible by default while upgrading: Firefox 5 to Firefox 10

testcase 4: Check that add-ons are compatible by default while upgrading: Firefox 6 to Firefox 10

testcase 5: Check that add-ons are compatible by default while upgrading: Firefox 7 to Firefox 10

testcase 6: Check that add-ons are compatible by default while upgrading: Firefox 8 to Firefox 10

testcase 7: Check that compatible by default feature is not applicable to binary add-ons(extension)

testcase 8: Check that compatible by default feature is not applicable to binary add-ons(theme)

testcase 9: Check compatible by default feature for a theme while upgrading to Firefox 10

testcase 10: Check compatible by default feature for a dictionary while upgrading to Firefox 10

testcase 11: Check compatible by default feature for a language tool while upgrading to Firefox 10

testcase 12: Check compatible by default feature doesn't affect version check for search tools while upgrading to Firefox 10

testcase 13: Check compatible by default feature for a multi-package extension while upgrading to Firefox 10

testcase 14: Check compatible by default feature for a lite-review add-on while upgrading to Firefox 10

testcase 15: Check compatible by default feature for an unreviewed add-on while upgrading to Firefox 10

testcase 16: Check that blacklisted add-ons are not updated via the compatible by default feature

testcase 17: Check that add-ons with strict compatibility mode in install.rdf are not updated by default

testcase 18: Check that add-ons with min version > Current Firefox version in install.rdf are not updated by default

testcase 19: Check compatible info for a remote add-on

testcase 20: Check that compatibility info from AMO will override all other information sources (like install.rdf etc)

testcase 21: Check update behavior with "compatMode = strict" on Firefox 10

testcase 22: Check update behavior with "compatMode = normal" on Firefox 10

testcase 23: Check update behavior with "compatMode = ignore" on Firefox 10

testcase 24: Check update behavior with "compatMode parameter missing in Firefox 10

testcase 25: Check update behavior with "compatMode = normal" for an add-on which has opted in to strict compatibility on Firefox 10 (similar to #17)

Discovery Pane

  • Tests to be performed on Firefox 10*


  • Tests to be performed on Firefox versions under 10*

Install Buttons

API Search

AMO Search and Listing Pages

References





Retrieved from "https://wiki.mozilla.org/index.php?title=TestEngineering/UI/AMO/AddonCompatibleByDefault&oldid=380139"