TestEngineering/UI/AMO/AddonBlocklisting: Difference between revisions
Line 80: | Line 80: | ||
=== Plugin Blocklisting === | === Plugin Blocklisting === | ||
'''testcase 1: Install a blocklisted (hardblock) plugin ''' | '''testcase 1: Install a blocklisted (hardblock) plugin ''' | ||
'''testcase 2: Verify that using blocklisted(hardblock) version of an plugin fails''' | '''testcase 2: Verify that using blocklisted(hardblock) version of an plugin fails''' | ||
'''testcase 3: Verify that only the specified plug-in version is blocked(hardblock) ''' | '''testcase 3: Verify that only the specified plug-in version is blocked(hardblock) ''' | ||
'''testcase 4: Check that installed plugin is disabled when blocklisted (hardblock)''' | '''testcase 4: Check that installed plugin is disabled when blocklisted (hardblock)''' | ||
'''testcase 5: Check blocklisting an plugin for specific Firefox version''' | '''testcase 5: Check blocklisting an plugin for specific Firefox version''' | ||
'''testcase 6: Check that specified Firefox version range is honored for a hardblocked plug-in ''' | '''testcase 6: Check that specified Firefox version range is honored for a hardblocked plug-in ''' | ||
'''testcase 7: Check that specified Firefox version range is honored for a softblocked plug-in ''' | '''testcase 7: Check that specified Firefox version range is honored for a softblocked plug-in ''' | ||
'''testcase 8: Check blocklisting(hardblock) a plug-in for specific platform/operating system''' | '''testcase 8: Check blocklisting(hardblock) a plug-in for specific platform/operating system''' | ||
'''testcase 9: Check blocklisting(hardblock) an plug-in for specific platform/operating system''' | '''testcase 9: Check blocklisting(hardblock) an plug-in for specific platform/operating system''' | ||
'''testcase 10: Install a blocklisted (softblock) plug-in ''' | '''testcase 10: Install a blocklisted (softblock) plug-in ''' | ||
'''testcase 11: Verify that installing blocklisted(softblock) version of an add-on fails''' | '''testcase 11: Verify that installing blocklisted(softblock) version of an add-on fails''' | ||
'''testcase 12: Verify that only the specified add-on version is blocked (softblock) ''' | '''testcase 12: Verify that only the specified add-on version is blocked (softblock) ''' | ||
'''testcase 13: Check that installed plug-in is disabled when blocklisted (softblock)''' | '''testcase 13: Check that installed plug-in is disabled when blocklisted (softblock)''' | ||
'''testcase 14: Check blocklisting(softblock) an plug-in for specific Firefox version''' | '''testcase 14: Check blocklisting(softblock) an plug-in for specific Firefox version''' | ||
'''testcase 15: Check that specified Firefox version range is honored for a softlocked plug-in ''' | '''testcase 15: Check that specified Firefox version range is honored for a softlocked plug-in ''' | ||
'''testcase 16: Check that specified Firefox version range is honored for a softblocked plug-in ''' | '''testcase 16: Check that specified Firefox version range is honored for a softblocked plug-in ''' | ||
'''testcase 17: Check blocklisting(softblock) a plug-in for specific platform/operating system''' | |||
'''testcase 17: Check blocklisting(softblock) a plug-in for specific platform/operating system''' | |||
=== Graphics Blocklisting === | === Graphics Blocklisting === |
Revision as of 22:36, 27 May 2011
Blocklisting
Settings
To test the updates on the staging server we need to tweak the settings at about:config
Change extensions.blocklist.url to https://addons.allizom.org/z/blocklist/3/%APP_ID%/%APP_VERSION%/%PRODUCT%/%BUILD_ID%/%BUILD_TARGET%/%LOCALE%/%CHANNEL%/%OS_VERSION%/%DISTRIBUTION%/%DISTRIBUTION_VERSION%/%PING_COUNT%/%TOTAL_PING_COUNT%/%DAYS_SINCE_LAST_PING%/
Usecase Scenarios:
Extension Blocklisting
testcase 1: Install a blocklisted (hardblock) extension
- Try to install https://addons.allizom.org/en-US/firefox/addon/amazona761/
- Check that installation fails with an appropriate warning
testcase 2: Verify that installing blocklisted(hardblock) version of an add-on fails
- Try to install 3.3.11 version from https://addons.allizom.org/en-US/firefox/addon/compat-testing-simple-exten/
- Check that installation fails with an appropriate warning
testcase 3: Verify that only the specified add-on version is blocked(hardblock)
- Try to install 3.4 version(which is not blocklisted) of https://addons.allizom.org/en-US/firefox/addon/compat-testing-simple-exten/
- Check that installation is successful.
testcase 4: Check that installed add-on is disabled when blocklisted (hardblock)
- Open a new Firefox profile
- Install 3.3.11 version from https://addons.allizom.org/en-US/firefox/addon/compat-testing-simple-exten/
- Change your about:config settings to point to preview
- Tools-> Error Console
- Execute Components.classes["@mozilla.org/extensions/blocklist;1"].getService(Components.interfaces.nsITimerCallback).notify(null);
- Check that the installed add-on is disabled with an appropriate warning (may take a few minutes)
testcase 5: Check blocklisting an add-on for specific Firefox version
- Try installing https://addons.allizom.org/en-US/firefox/addon/test-add-on-for-blacklistin/ on Firefox 4.0.1
- Install fails since the add-on is blocked on firefox
- Try to install the same add-on on Firefox 3.6.*
- Installation is successful on 3.6.*
testcase 6: Check that specified Firefox version range is honored for a hardblocked extension
- Check that installation of https://addons.allizom.org/en-US/firefox/addon/hazaaron-khwaishein-aisi/ fails in Firefox 3.0
- Check that installation of https://addons.allizom.org/en-US/firefox/addon/hazaaron-khwaishein-aisi/ fails in Firefox 3.5
- Check that installation of https://addons.allizom.org/en-US/firefox/addon/hazaaron-khwaishein-aisi/ fails in Firefox 3.6.*
- Check that installation of https://addons.allizom.org/en-US/firefox/addon/hazaaron-khwaishein-aisi/ works in Firefox 4.0
testcase 7: Check blocklisting(hardblock) an add-on for specific platform/operating system
- Check that installation of https://addons.allizom.org/en-US/firefox/addon/sunkjkjhqvdvcdh/ fails in Linux
- Check that installation of https://addons.allizom.org/en-US/firefox/addon/sunkjkjhqvdvcdh/ works in Win XP
- Check that installation of https://addons.allizom.org/en-US/firefox/addon/sunkjkjhqvdvcdh/ fails in MAC OSX
- Check that installation of https://addons.allizom.org/en-US/firefox/addon/sunkjkjhqvdvcdh/ fails in Windows Vista
testcase 8: Install a blocklisted (softblock) extension
- Try installing https://addons.allizom.org/en-US/firefox/addon/name-1/
- Check that there is a warning before installation as shown in https://wiki.mozilla.org/Blocklisting#What_users_will_see
- Installation is successful
testcase 9: Install blocklisted (softblock) version of an add-on
testcase 12: Verify that only the specified add-on version is blocked(softblock)
testcase 13: Check that installed add-on is disabled when blocklisted (softblock)
testcase 14: Check blocklisting(softblock) an add-on for specific Firefox version
testcase 15: Check that specified Firefox version range is honored for a softblocked extension
testcase 16: Check blocklisting(softblock) an add-on for specific platform/operating system
testcase 17: Check blocklisting a language pack
testcase 18: Check blocklisting a dictionary
testcase 19: Check blocklisting a theme
Plugin Blocklisting
testcase 1: Install a blocklisted (hardblock) plugin testcase 2: Verify that using blocklisted(hardblock) version of an plugin fails testcase 3: Verify that only the specified plug-in version is blocked(hardblock) testcase 4: Check that installed plugin is disabled when blocklisted (hardblock) testcase 5: Check blocklisting an plugin for specific Firefox version testcase 6: Check that specified Firefox version range is honored for a hardblocked plug-in testcase 7: Check that specified Firefox version range is honored for a softblocked plug-in testcase 8: Check blocklisting(hardblock) a plug-in for specific platform/operating system testcase 9: Check blocklisting(hardblock) an plug-in for specific platform/operating system testcase 10: Install a blocklisted (softblock) plug-in testcase 11: Verify that installing blocklisted(softblock) version of an add-on fails testcase 12: Verify that only the specified add-on version is blocked (softblock) testcase 13: Check that installed plug-in is disabled when blocklisted (softblock) testcase 14: Check blocklisting(softblock) an plug-in for specific Firefox version testcase 15: Check that specified Firefox version range is honored for a softlocked plug-in testcase 16: Check that specified Firefox version range is honored for a softblocked plug-in testcase 17: Check blocklisting(softblock) a plug-in for specific platform/operating system
Graphics Blocklisting