QA/Sync/Test Plan/1.6

From MozillaWiki
< QA‎ | Sync‎ | Test Plan
Jump to: navigation, search
1.6 Sync Test Plan

Overview

This release of Sync is on a critical path with Firefox 4, Fennec and Home. Two major areas of concern are simplified crypto and JPAKE. The former requiring a storage version bump. The later making a significant change in account setup and adding additional clients to use that account. We want to ensure both the new and old methods work and interact without disruption.

Builds

Quick Testplan for 1.6 release

  • Sync 1.6 release Extension
    • Please file bugs in Mozilla Services::Sync with whiteboard "[sync1.6]"
    • The Easy Setup UI screen is not in the extension. Please use Fallback setup method.
  • Run Sync Litmus tests on different platforms:
    • Win 7: 3.6.13 + sync 1.6 tchung (PASS)
    • Win 7: 4.0b7 + sync 1.6 tchung (PASS)
    • Fennec: 1.1 + sync 1.6 tchung (PASS)
    • Win XP: 3.5.16 + sync 1.6 tchung (PASS)
    • Linux: 3.6.13 + sync 1.6 juanb (Pass)
    • Mac: 3.6.13 + sync 1.6 juanb (Pass)
    • Mac: 4.0b7 + sync 1.6 juanb (Pass)
      • At some point I saw this in the console, when having only tabs checkbox selected. It only happened on initial sync: Error: win.gFxWeaveGlue is undefined Source File: chrome://weave/content/firefox/tabs.js Line: 14
  • Update tests,
    • Win 7: 3.6.13 + sync 1.5.1 -> sync 1.6 tchung (PASS)
    • Win 7: 4.0b7 (should get an error to update to beta 8) tchung (PASS)
    • Fennec: 1.1 + sync 1.5.1 -> sync 1.6 tchung (PASS)
    • Win XP: 3.5.16 + sync 1.5.1 -> sync 1.6 tchung (PASS)
    • Linux: 3.6.13 + sync 1.5.1 -> sync 1.6 juanb (Pass)
    • Mac: 3.6.13 + sync 1.5.1 -> sync 1.6 juanb (Pass)
    • Mac: 4.0b7 (should get an error to update to beta 8) juanb (Pass)
  • Notes/Bugs
    • (tchung) results
      • Confirmed bug 548819 Weave utils.js produces error after syncing when trying to call onBeginUpdateBatch and onEndUpdateBatch
      • Filed bug 620593 Username should allow leading and trailing whitespace
      • Filed bug 620591 Exception thrown when updating to sync 1.6 on Fx3.5.16/Fx3.6.13

Test Strategy

  • Pass - Server testing. (tracy, ops)
    • passed QA against stage, but issues revealed in production.
  • Desktop testing complete, waiting on Mobile - With the help of the Waverly team, we'll want to ensure the critical upgrade paths (due to crypto version bump) and JPAKE account setups work properly. This testing will be tracked on this spreadsheet
    (Waverly, tracy and tony)
    • Bug 618042 - Sync Key change fails - FIXED in 1.6b3
    • Bug 618336 - Crummy experience adding latest storage version client to an existing storage version 3 client we've made support aware of this one
    • Bug 618068 - Cipher finalize failed on startup
  • In progress - Bug fix verifications (tracy)
  • Desktop testing complete, waiting on Mobile Run cross platform the funtional bfts (with particular focus on Bookmarks sync) for Fennec, Home, Firefox, and extension
    • Fx4 (tracy)
      • Windows Pass - I believe the captcha bug may be machine dependent. (couldn't repro on lab Win 7 machine)
      • Mac - Pass
      • Linux - Pass
    • 1.6 extension on 3.5/6 (tracy)
      • Windows Pass
      • Mac - Pass
      • Linux - Pass
    • Fennec (tony)
      • Fennec 1.1 (maemo) - Pass
      • Fennec 4.0b3 (android) - Pass
        • tests apply only with a desktop build+sync 1.6 for jpake setup
    • Home (tony)
      • tests apply only with a desktop build+sync 1.6 for jpake setup
      • test plan here
    • Bugs of note:
      • Bug 564296 - Form data deletes don't sync
      • Bug 564296 - Text input field not visible in captcha dialog.
  • Pass - Ensure functionality of pages at Mozilla Services websites (eg. https://services.mozilla.com/) (tracy)
  • Pass with untranslated strings l10n spot checks against a few tier 1 locales. (tracy) -
    • not sure that these are actually expected to be complete. es-ES looked fine, however, de wasn't completely translated. bug 619796 - Connect portion of Sync Setup dialogs are untranslated
  • unit tests on crossweave?
  • Accessibility? (marco)
  • host a sync testday after beta launches (not during all-hands, possibly 12/22) (tracy)

Schedule Scoping

  • Targeting for release 2010-12-?? (when beta8 release for built-in and Extension)
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/Sync/Test_Plan/1.6&oldid=274523"