Overview

Call out manual tests run for each level of Sync release train testing. Not intended to define test case steps to reproduce.

Client

Tests run for Sync as it is built into Firefox

Smoketests

definition: This set of tests is run to ensure the most basic and essential sync features work correctly

• ensure setup of a new account through the wizard works correctly
• ensure sync of each data type engine completes successfully
• ensure deactivate this account works correctly

Smoketests plus

definition: This is the above smoketests plus any tests related to bug fixes. ie. if bookmarks sync was touched, run all of the bookmarks sync basic functional tests.

Basic Functional Tests

definition: This set of tests is run to ensure every sync feature works correctly. It is of greater depth and breadth than the smoketests.

• smoketests
• ensure adding and removing data for each engine syncs correctly
• ensure Fx UI pieces (Sync Icon, Tools Menu Item, Discoverability, etc) work correctly
• ensure about:sync-tabs (Tabs From Other Computers) page works correctly
• ensure each section of Sync Preferences (Options) works correctly
• ensure about:sync-log works correctly

Servers

Since several different servers are involved, when referring to the lists below, keep in mind the server type under test.

Smoketests

definition: ensure the most basic and essential server features work correctly

• create a new sync account ((s)reg)
• add a client to existing account via the easy setup path. (pake)
• add a client to existing account via the reg path (don't have the other device with me). ((s)reg)
• delete an account (a.p. and (s)reg)

Smoketests plus

definition: This is the above smoketests plus any tests related to bug fixes. ie. if easy setup was touched, run all of the easy setup basic functional tests.

Basic Functional Tests

This set of tests is run to ensure every server feature works correctly. It is of greater depth and breadth than the smoketests.

• smoketests
• ensure all Manage Account items in Sync Preferences (options) work correctly (a.p. and (s)reg)
• Log in to and ensure all items of Account Portal (https://account.services.mozilla.com/) work correctly (a.p.)
• ensure timeout or cancel out of easy setup works correctly (pake)
• ensure failure paths in setup wizard work correctly. ie. Forgotten Password. ((s)reg)