TestEngineering/UI/AMO/AddonBlocklisting: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(Created page with "=== Blocklisting === <br> <br> === Settings<br> === To test the updates on the staging server we need to tweak the settings at about:config Change extensions.blocklist.u...")
 
 
(19 intermediate revisions by 2 users not shown)
Line 10: Line 10:


Change extensions.blocklist.url to https://addons.allizom.org/z/blocklist/3/%APP_ID%/%APP_VERSION%/%PRODUCT%/%BUILD_ID%/%BUILD_TARGET%/%LOCALE%/%CHANNEL%/%OS_VERSION%/%DISTRIBUTION%/%DISTRIBUTION_VERSION%/%PING_COUNT%/%TOTAL_PING_COUNT%/%DAYS_SINCE_LAST_PING%/
Change extensions.blocklist.url to https://addons.allizom.org/z/blocklist/3/%APP_ID%/%APP_VERSION%/%PRODUCT%/%BUILD_ID%/%BUILD_TARGET%/%LOCALE%/%CHANNEL%/%OS_VERSION%/%DISTRIBUTION%/%DISTRIBUTION_VERSION%/%PING_COUNT%/%TOTAL_PING_COUNT%/%DAYS_SINCE_LAST_PING%/


== Usecase Scenarios:  ==
== Usecase Scenarios:  ==
Line 17: Line 15:
=== Extension Blocklisting ===
=== Extension Blocklisting ===


'''testcase 1: Install a blocklisted (hardblock) extension '''  
'''testcase 1: Install a blocklisted (hardblock) extension ''' <br>
 
*  Try to install https://addons.allizom.org/en-US/firefox/addon/amazona761/<br>
 
*  Check that installation fails with an appropriate warning<br>
 
<br>
'''testcase 2: Verify that installing blocklisted(hardblock) version of an add-on fails'''
'''testcase 2: Verify that installing blocklisted(hardblock) version of an add-on fails'''
 
*  Try to install 3.3.11 version from  https://addons.allizom.org/en-US/firefox/addon/compat-testing-simple-exten/<br>
 
*  Check that installation fails with an appropriate warning<br>
 
<br>
'''testcase 3: Verify that only the specified add-on version is blocked(hardblock) '''  
'''testcase 3: Verify that only the specified add-on version is blocked(hardblock) '''  
 
* Try to install 3.4 version(which is not blocklisted) of https://addons.allizom.org/en-US/firefox/addon/compat-testing-simple-exten/<br>
 
* Check that installation is successful.<br>
'''testcase 4: Check that installed add-on is disabled when blocklisted (hardblock)'''
<br>
'''testcase 4: Check that installed add-on is disabled when blocklisted (hardblock)'''  
* Open a new Firefox profile
* Install 3.3.11 version from https://addons.allizom.org/en-US/firefox/addon/compat-testing-simple-exten/<br>
* Change your about:config settings to point to preview
* Tools-> Error Console
* Execute Components.classes["@mozilla.org/extensions/blocklist;1"].getService(Components.interfaces.nsITimerCallback).notify(null);
* Check that the installed add-on is disabled with an appropriate warning (may take a few minutes)


'''testcase 5: Check blocklisting an add-on for specific Firefox version'''
'''testcase 5: Check blocklisting an add-on for specific Firefox version'''
* Try installing https://addons.allizom.org/en-US/firefox/addon/test-add-on-for-blacklistin/ on Firefox 4.0.1
* Install fails since the add-on is blocked on firefox
* Try to install the same add-on on Firefox 3.6.*
* Installation is successful on 3.6.*


'''testcase 5: Check that specified Firefox version range is honored for a hardblocked extension'''
'''testcase 6: Check that specified Firefox version range is honored for a hardblocked extension'''
 
* Check that installation of https://addons.allizom.org/en-US/firefox/addon/hazaaron-khwaishein-aisi/ fails in Firefox 3.0
'''testcase 5: Check that specified Firefox version range is honored for a hardblocked extension'''
* Check that installation of https://addons.allizom.org/en-US/firefox/addon/hazaaron-khwaishein-aisi/ fails in Firefox 3.5
* Check that installation of https://addons.allizom.org/en-US/firefox/addon/hazaaron-khwaishein-aisi/ fails in Firefox 3.6.*
* Check that installation of https://addons.allizom.org/en-US/firefox/addon/hazaaron-khwaishein-aisi/ works in Firefox 4.0


'''testcase 7: Check blocklisting(hardblock) an add-on for specific platform/operating system'''
* Check that installation of https://addons.allizom.org/en-US/firefox/addon/sunkjkjhqvdvcdh/ fails in Linux
* Check that installation of https://addons.allizom.org/en-US/firefox/addon/sunkjkjhqvdvcdh/ works in Win XP
* Check that installation of https://addons.allizom.org/en-US/firefox/addon/sunkjkjhqvdvcdh/ fails in MAC OSX
* Check that installation of https://addons.allizom.org/en-US/firefox/addon/sunkjkjhqvdvcdh/ fails in Windows Vista


'''testcase 6: Check blocklisting an add-on for specific platform/operating system'''  
'''testcase 8: Install a blocklisted (softblock) extension '''  
* Try installing https://addons.allizom.org/en-US/firefox/addon/name-1/
* Check that there is a warning before installation as shown in https://wiki.mozilla.org/Blocklisting#What_users_will_see
* Installation is successful


'''testcase 9: Install blocklisted (softblock) version of an add-on '''


'''testcase 6: Check blocklisting an add-on for specific platform/operating system'''  
'''testcase 12: Verify that only the specified add-on version is blocked(softblock) '''  


*Pick an add-on with an unreviewed latest version.
'''testcase 13: Check that installed add-on is disabled when blocklisted (softblock)'''
*Install the previous version of that add-on  
*Tools-&gt; Add-ons --&gt;Click on “Find Updates” in the add-ons manager
*Check that there are no updates


'''testcase 7: Check that there are no updates for unreviewed add-ons'''
'''testcase 14: Check blocklisting(softblock) an add-on for specific Firefox version'''


*Pick an add-on with multiple unreviewed versions
'''testcase 15: Check that specified Firefox version range is honored for a softblocked extension'''
*Install an older version  
*Tools-&gt; Add-ons --&gt;Click on “Find Updates”
*No updates


'''testcase 8: Check that no updates are offered if the newer version is incompatible with user's browser version/platform'''
'''testcase 16: Check blocklisting(softblock) an add-on for specific platform/operating system'''  


*Pick an add-on with an incompatible latest version
'''testcase 17: Check blocklisting a language pack'''
*Install an older version and restart
*Tools-&gt; Add-ons --&gt;Click on “Find Updates”
*No updates are offered


'''testcase 9: Check for platform compatibility'''
'''testcase 18: Check blocklisting a dictionary'''


*Pick an add-on which has version (b-n) compatible with the test platform and version b not supported on your platform/OS
'''testcase 19: Check blocklisting a theme'''
*Install version (b-n) and restart
*Tools-&gt; Add-ons --&gt;Click on “Find Updates”
*No updates are offered


'''testcase 10: admin disabled add-on versions'''
=== Plugin Blocklisting ===
* Install an older version of the test add-on
'''testcase 1: Install a blocklisted (hardblock) plugin '''<br>
* Admin-disable the latest version of that add-on
'''testcase 2: Verify that using blocklisted(hardblock) version of an plugin fails''' <br>
* Check for updates
'''testcase 3: Verify that only the specified plug-in  version is blocked(hardblock) '''<br> 
* Ensure that no updates are offered
'''testcase 4: Check that installed plugin is disabled when blocklisted (hardblock)''' <br>
'''testcase 5: Check blocklisting an plugin for specific Firefox version''' <br>
'''testcase 7: Check that specified Firefox version range is honored for a softblocked plug-in '''<br>
'''testcase 8: Check blocklisting(hardblock) a plug-in for specific platform/operating system''' <br>
'''testcase 9: Install a blocklisted (softblock) plug-in  '''<br>
'''testcase 10: Verify that installing blocklisted(softblock) version of an add-on fails'''<br>
'''testcase 11: Verify that only the specified add-on version is blocked (softblock) '''<br> 
'''testcase 12: Check that installed plug-in  is disabled when blocklisted (softblock)''' <br>
'''testcase 13: Check blocklisting(softblock) an plug-in  for specific Firefox version'''<br>
'''testcase 14: Check that specified Firefox version range is honored for a softlocked plug-in '''<br>
'''testcase 15: Check blocklisting(softblock) a plug-in  for specific platform/operating system'''<br>


'''testcase 11: Downgrading add-on versions'''
=== Graphics Blocklisting ===
* Install the latest version of an add-on
* Admin-disable that version
* Check for updates
* Previous version of the add-on is offered


'''testcase 12: Deleting beta channel'''
* Install the beta version of an add-on
* Ensure that there is a newer public version for that add-on
* Delete all beta versions
* Check for updates
* Ensure that the latest public version of the add-on is offered


'''testcase 13: Check updates for lite reviewed add-on'''
* Install an older version of a lite reviewed add-on
* Check for updates
* Ensure that the latest prelim reviewed add-on is offered in updates


'''testcase 14: Check updates for public add-on'''
=== References ===
* Install an older version of a public add-on
* https://wiki.mozilla.org/Blocklisting
* Check for updates
* https://wiki.mozilla.org/Extension_Blocklisting:Code_Design
* Ensure that the latest public add-on is offered in updates
* https://wiki.mozilla.org/Extension_Blocklisting:Testing
* https://wiki.mozilla.org/Extension_Blocklisting


'''testcase 15: Only public versions are offered as updates'''
* Install an older version of a public add-on
* Grant lite review to the newer version of that add-on
* Check for updates
* Ensure that there are no updates.


'''testcase 16: Updates for a lite+nominated add-on'''
* Install an older version of a lite+nominated add-on
* Grant lite review to the newer version of that add-on
* Check for updates
* Ensure that there are no updates.




<br> <br>
<br> <br>

Latest revision as of 20:18, 26 August 2016

Blocklisting



Settings

To test the updates on the staging server we need to tweak the settings at about:config

Change extensions.blocklist.url to https://addons.allizom.org/z/blocklist/3/%APP_ID%/%APP_VERSION%/%PRODUCT%/%BUILD_ID%/%BUILD_TARGET%/%LOCALE%/%CHANNEL%/%OS_VERSION%/%DISTRIBUTION%/%DISTRIBUTION_VERSION%/%PING_COUNT%/%TOTAL_PING_COUNT%/%DAYS_SINCE_LAST_PING%/

Usecase Scenarios:

Extension Blocklisting

testcase 1: Install a blocklisted (hardblock) extension


testcase 2: Verify that installing blocklisted(hardblock) version of an add-on fails


testcase 3: Verify that only the specified add-on version is blocked(hardblock)


testcase 4: Check that installed add-on is disabled when blocklisted (hardblock)

  • Open a new Firefox profile
  • Install 3.3.11 version from https://addons.allizom.org/en-US/firefox/addon/compat-testing-simple-exten/
  • Change your about:config settings to point to preview
  • Tools-> Error Console
  • Execute Components.classes["@mozilla.org/extensions/blocklist;1"].getService(Components.interfaces.nsITimerCallback).notify(null);
  • Check that the installed add-on is disabled with an appropriate warning (may take a few minutes)

testcase 5: Check blocklisting an add-on for specific Firefox version

testcase 6: Check that specified Firefox version range is honored for a hardblocked extension

testcase 7: Check blocklisting(hardblock) an add-on for specific platform/operating system

testcase 8: Install a blocklisted (softblock) extension

testcase 9: Install blocklisted (softblock) version of an add-on

testcase 12: Verify that only the specified add-on version is blocked(softblock)

testcase 13: Check that installed add-on is disabled when blocklisted (softblock)

testcase 14: Check blocklisting(softblock) an add-on for specific Firefox version

testcase 15: Check that specified Firefox version range is honored for a softblocked extension

testcase 16: Check blocklisting(softblock) an add-on for specific platform/operating system

testcase 17: Check blocklisting a language pack

testcase 18: Check blocklisting a dictionary

testcase 19: Check blocklisting a theme

Plugin Blocklisting

testcase 1: Install a blocklisted (hardblock) plugin
testcase 2: Verify that using blocklisted(hardblock) version of an plugin fails
testcase 3: Verify that only the specified plug-in version is blocked(hardblock)
testcase 4: Check that installed plugin is disabled when blocklisted (hardblock)
testcase 5: Check blocklisting an plugin for specific Firefox version
testcase 7: Check that specified Firefox version range is honored for a softblocked plug-in
testcase 8: Check blocklisting(hardblock) a plug-in for specific platform/operating system
testcase 9: Install a blocklisted (softblock) plug-in
testcase 10: Verify that installing blocklisted(softblock) version of an add-on fails
testcase 11: Verify that only the specified add-on version is blocked (softblock)
testcase 12: Check that installed plug-in is disabled when blocklisted (softblock)
testcase 13: Check blocklisting(softblock) an plug-in for specific Firefox version
testcase 14: Check that specified Firefox version range is honored for a softlocked plug-in
testcase 15: Check blocklisting(softblock) a plug-in for specific platform/operating system

Graphics Blocklisting

References





Retrieved from "https://wiki.mozilla.org/index.php?title=TestEngineering/UI/AMO/AddonBlocklisting&oldid=1145733"