TestEngineering/UI/AMO/Testday/12152010: Difference between revisions
No edit summary |
No edit summary |
||
| Line 23: | Line 23: | ||
*testcase 1: Update add-on versions | *testcase 1: Update add-on versions | ||
** Check that clicking on “Find updates”, lists the latest supported versions for your installed add-ons | ** Check that clicking on “Find updates”, lists the latest supported versions for your installed add-ons | ||
** Ensure that the update is successful | ** Ensure that the update is successful | ||
| Line 30: | Line 29: | ||
*testcase 2: Update Firefox versions (with add-on updates) | *testcase 2: Update Firefox versions (with add-on updates) | ||
** Install an older version of Firefox | ** Install an older version of Firefox | ||
** Install older versions of add-ons which are not supported on the version you are updating to.(pick one extension, theme,dictionary and a language pack | ** Install older versions of add-ons which are not supported on the version you are updating to.(pick one extension, theme,dictionary and a language pack | ||
| Line 75: | Line 73: | ||
*testcase 7: Check that there are no updates for unreviewed add-ons | *testcase 7: Check that there are no updates for unreviewed add-ons | ||
** Pick an add-on with multiple unreviewed versions | ** Pick an add-on with multiple unreviewed versions | ||
** Install an older version | ** Install an older version | ||
| Line 84: | Line 81: | ||
* testcase 8: Check that no updates are offered if the newer version is incompatible with user's browser version/platform | * testcase 8: Check that no updates are offered if the newer version is incompatible with user's browser version/platform | ||
** Pick an add-on with an incompatible latest version | ** Pick an add-on with an incompatible latest version | ||
** Install an older version and restart | ** Install an older version and restart | ||
Revision as of 02:03, 8 December 2010
Hello there, and welcome to the AMO test day! Thanks for volunteering your time and energy to help us improve addons.mozilla.org! Below, you'll find the setup information and some use-cases to help guide you in your testing; feel free, though, to go off on your own and just ad-hoc test!
Staging server: https://addons-next.allizom.org/en-US/firefox/
What are we testing?
update.php is what Firefox asks to see if there are add-on updates available. We have migrated it to python and need to ensure that there are no regressions.
Settings
To test the updates on the staging server we need to tweak the settings.
Settings for Firefox:
To test update on the staging server, change the following setting in your about:config
Settings for Thunderbird:
To test update on the staging server, change the following setting in your about:config
extension.update.url to
https://addons.allizom.org/z/update?reqVersion=%REQ_VERSION%&id=%ITEM_ID%&version=%ITEM_VERSION%&maxAppVersion=%ITEM_MAXAPPVERSION%&status=%ITEM_STATUS%&appID=%APP_ID%&appVersion=%APP_VERSION%&appOS=%APP_OS%&appABI=%APP_ABI%
Settings for Seamonkey:
To test update on the staging server, change the following setting in your about:config
extension.update.url to
https://addons.allizom.org/z/update?reqVersion=%REQ_VERSION%&id=%ITEM_ID%&version=%ITEM_VERSION%&maxAppVersion=%ITEM_MAXAPPVERSION%&status=%ITEM_STATUS%&appID=%APP_ID%&appVersion=%APP_VERSION%&appOS=%APP_OS%&appABI=%APP_ABI%&locale=%APP_LOCALE%¤tAppVersion=%CURRENT_APP_VERSION%
Usecase Scenarios:
- testcase 1: Update add-on versions
- Check that clicking on “Find updates”, lists the latest supported versions for your installed add-ons
- Ensure that the update is successful
- testcase 2: Update Firefox versions (with add-on updates)
- Install an older version of Firefox
- Install older versions of add-ons which are not supported on the version you are updating to.(pick one extension, theme,dictionary and a language pack
- Upgrade Firefox to a newer version
- Check that when Firefox starts, it prompts you to upgrade all your incompatible add-ons
- Ensure that the update is successful
- testcase 3:Update Firefox versions (with no add-on updates)
- Install an older version of Firefox
- Install the latest versions of add-ons(pick one extension, theme,dictionary and a language pack
- Upgrade Firefox to a newer version
- Check that when Firefox starts, there are no fake prompts for updates
- testcase 4:Update prompt while opening a Firefox profile
- Create a profile which has a few older versions of add-ons installed.
- Quit Firefox
- Start the firefox profile
- Check that there are updates for incompatible add-on versions
- testcase 5: Update prompt for beta add-ons
- Select an add-on which has multiple beta versions(say b1-b4)
- Install an older version of a beta add-on(b1
- Click on “Find Updates”
- Check that b4 versions is listed as an update
- Update is successful
- testcase 6:Update prompt for:
+ extensions(.xpi)
+ themes(.xpi and.jar)
+ Dictionaries and Language packs
- testcase 6: Check that updates are only offered when the newer versions of the add-on are public
- Pick an add-on with an unreviewed latest version.
- Install the previous version of that add-on
- Click on “Find Updates” in the add-ons manager
- Check that there are no updates
- testcase 7: Check that there are no updates for unreviewed add-ons
- Pick an add-on with multiple unreviewed versions
- Install an older version
- Click on “Find Updates”
- No updates
- testcase 8: Check that no updates are offered if the newer version is incompatible with user's browser version/platform
- Pick an add-on with an incompatible latest version
- Install an older version and restart
- Click on “Find Updates”
- No updates are offered
- testcase 9: Check for platform compatibility
- Pick an add-on which has version (b-n) compatible with the test platform and version b not supported on your platform/OS
- Install version (b-n) and restart
- Click on “Find Updates”
- No updates are offered