TestEngineering/UI/AMO/AddonBlocklisting

Settings

To test the updates on the staging server we need to tweak the settings at about:config

Change extensions.blocklist.url to https://addons.allizom.org/z/blocklist/3/%APP_ID%/%APP_VERSION%/%PRODUCT%/%BUILD_ID%/%BUILD_TARGET%/%LOCALE%/%CHANNEL%/%OS_VERSION%/%DISTRIBUTION%/%DISTRIBUTION_VERSION%/%PING_COUNT%/%TOTAL_PING_COUNT%/%DAYS_SINCE_LAST_PING%/

Usecase Scenarios:

Extension Blocklisting

testcase 1: Install a blocklisted (hardblock) extension

• Try to install https://addons.allizom.org/en-US/firefox/addon/amazona761/
  
• Check that installation fails with an appropriate warning
  

testcase 2: Verify that installing blocklisted(hardblock) version of an add-on fails

• Try to install 3.3.11 version from https://addons.allizom.org/en-US/firefox/addon/compat-testing-simple-exten/
  
• Check that installation fails with an appropriate warning
  

testcase 3: Verify that only the specified add-on version is blocked(hardblock)

• Try to install 3.4 version(which is not blocklisted) of https://addons.allizom.org/en-US/firefox/addon/compat-testing-simple-exten/
  
• Check that installation is successful.
  

testcase 4: Check that installed add-on is disabled when blocklisted (hardblock)

• Open a new Firefox profile
• Install 3.3.11 version from https://addons.allizom.org/en-US/firefox/addon/compat-testing-simple-exten/
  
• Change your about:config settings to point to preview
• Tools-> Error Console
• Execute Components.classes["@mozilla.org/extensions/blocklist;1"].getService(Components.interfaces.nsITimerCallback).notify(null);
• Check that the installed add-on is disabled with an appropriate warning (may take a few minutes)

testcase 5: Check blocklisting an add-on for specific Firefox version

• Try installing https://addons.allizom.org/en-US/firefox/addon/test-add-on-for-blacklistin/ on Firefox 4.0.1
• Install fails since the add-on is blocked on firefox
• Try to install the same add-on on Firefox 3.6.*
• Installation is successful on 3.6.*

testcase 6: Check that specified Firefox version range is honored for a hardblocked extension

• Check that installation of https://addons.allizom.org/en-US/firefox/addon/hazaaron-khwaishein-aisi/ fails in Firefox 3.0
• Check that installation of https://addons.allizom.org/en-US/firefox/addon/hazaaron-khwaishein-aisi/ fails in Firefox 3.5
• Check that installation of https://addons.allizom.org/en-US/firefox/addon/hazaaron-khwaishein-aisi/ fails in Firefox 3.6.*
• Check that installation of https://addons.allizom.org/en-US/firefox/addon/hazaaron-khwaishein-aisi/ works in Firefox 4.0

testcase 7: Check blocklisting(hardblock) an add-on for specific platform/operating system

• Check that installation of https://addons.allizom.org/en-US/firefox/addon/sunkjkjhqvdvcdh/ fails in Linux
• Check that installation of https://addons.allizom.org/en-US/firefox/addon/sunkjkjhqvdvcdh/ works in Win XP
• Check that installation of https://addons.allizom.org/en-US/firefox/addon/sunkjkjhqvdvcdh/ fails in MAC OSX
• Check that installation of https://addons.allizom.org/en-US/firefox/addon/sunkjkjhqvdvcdh/ fails in Windows Vista

testcase 8: Install a blocklisted (softblock) extension

• Try installing https://addons.allizom.org/en-US/firefox/addon/name-1/
• Check that there is a warning before installation as shown in https://wiki.mozilla.org/Blocklisting#What_users_will_see
• Installation is successful

testcase 9: Install blocklisted (softblock) version of an add-on

testcase 12: Verify that only the specified add-on version is blocked(softblock)

testcase 13: Check that installed add-on is disabled when blocklisted (softblock)

testcase 14: Check blocklisting(softblock) an add-on for specific Firefox version

testcase 15: Check that specified Firefox version range is honored for a softblocked extension

testcase 16: Check blocklisting(softblock) an add-on for specific platform/operating system

testcase 17: Check blocklisting a language pack

testcase 18: Check blocklisting a dictionary

testcase 19: Check blocklisting a theme

Plugin Blocklisting

testcase 1: Install a blocklisted (hardblock) plugin
testcase 2: Verify that using blocklisted(hardblock) version of an plugin fails
testcase 3: Verify that only the specified plug-in version is blocked(hardblock)
testcase 4: Check that installed plugin is disabled when blocklisted (hardblock)
testcase 5: Check blocklisting an plugin for specific Firefox version
testcase 7: Check that specified Firefox version range is honored for a softblocked plug-in
testcase 8: Check blocklisting(hardblock) a plug-in for specific platform/operating system
testcase 9: Install a blocklisted (softblock) plug-in
testcase 10: Verify that installing blocklisted(softblock) version of an add-on fails
testcase 11: Verify that only the specified add-on version is blocked (softblock)
testcase 12: Check that installed plug-in is disabled when blocklisted (softblock)
testcase 13: Check blocklisting(softblock) an plug-in for specific Firefox version
testcase 14: Check that specified Firefox version range is honored for a softlocked plug-in
testcase 15: Check blocklisting(softblock) a plug-in for specific platform/operating system

References

• https://wiki.mozilla.org/Blocklisting
• https://wiki.mozilla.org/Extension_Blocklisting:Code_Design
• https://wiki.mozilla.org/Extension_Blocklisting:Testing
• https://wiki.mozilla.org/Extension_Blocklisting