QA/Fennec/X2N Migration

From MozillaWiki
< QA‎ | Fennec
Jump to: navigation, search


X2N Migration Test Plan

Purpose : To verify that upgrading to Native 14 from neither 10.0.4 ESR XUL build nor 13 beta XUL build causes any issues, including but not withstanding localization issues. For more information, please see bug 750841 and bug 750819

  • Note: Rel Eng (Aki) will be helping out and pushing the test builds to Google Play for testing purposes

Current Plan : Concentration on Beta Scenario

Current Status :

Results

Scenarios

Current scenarios

Google Play Update Testing

Before Beta (750819, 747534, and "test scenario 1"):
* RelEng: Verify that a multi-locale XF for tablets can be uploaded alongside many single locale FN builds 
* QA: Determine what build different localizations will receive depending on Firefox/system locale and available builds 
* QA: Verify that FN14 is offered to phone XF13 users, XF14 is offered to tablet XF13 users, and no unexpected issues occur
* QA: Test the update experience for an Android 2.0 XF13 user, now that FN14 no longer supports them

Note: We ran into some issue with posting multiple locales up on Google Play. We will only be testing multi locale XUL fennec to Single locale English Native Fennec for the first test run for phones and multi locale XUL fennec to multi locale XUL fennec for tablets.

Before Release (750841, and "test scenarios 2/3"): <split APK>
* QA: Verify that FN14 is offered to phone XF10 users, XF14 is offered to tablet XF10 users, and no unexpected issues occur
* QA: Determine what build different localizations will receive depending on Firefox/system locale and available builds

Migration Testing (Google Play is unnecessary)

Before Beta (750819, builds available):
* QA: Verify that XF13 to FN14 migrations (APK over APK) have no new perf/functional/crash regressions across multiple devices
Before Release (748096):
* QA: Verify that XF10 to FN14 migrations (APK over APK) have no new perf/functional/crash regressions across multiple devices