QA/Firefox 4/QA/Account Manager Testplan
Contents
- 1 Feature Account Manager
- 2 Feature Release Readiness Assessment
- 3 Feature Documentation
- 4 Feature Bug Management
- 5 Feature Test Items
- 6 Feature Tests
- 7 Community Test Events
- 8 Feature Documentation Details
- 9 Feature Release Readiness Assessment Details
- 10 Feature Bug Management Details
- 11 Feature Test Items Details
- 12 Feature Tests Details
- 13 Community Test Events Details
Feature Account Manager
- Development Status: - In progress (July 13)
- Feature Testing: - In progress/ not landed (date)
- Team: Developer, QA contact 1, QA contact 2, Community Volunteer...
- Tracking Bugs:
Feature Description
(from https://wiki.mozilla.org/Labs/Weave/Identity/Account_Manager)
The Account Manager project aims to produce:
* A protocol definition that sites can use to define their account-and-session management features in a format a web browser can understand. (The latest draft of the specification is here).
* An implementation of this protocol as a Firefox addon.
The goal is to help users manage the process of "connecting" to a site, in a way that allows us to use secure browser chrome, and supports multiple authentication mechanisms.
The account manager is an evolution of the Firefox password manager and the Weave identity components (OpenID + auto-login). It will help users manage logins and profile information for each site, and it will automate currently manual tasks such as signing up for sites, generating passwords, etc. The first prototype will have support for "traditional" login methods (e.g., form + cookie), but it will also have some support for OpenID/federated logins.
Creating a new identity framework is a non-goal of this project, although some new file formats and protocols are in scope (see below for details).
Feature Release Readiness Assessment
The table below provides a top level go/no go assessment of whether the feature is release ready for the given milestone.
Milestone | Assessment |
---|---|
#Beta1 | N/A |
#Beta2 | N/A |
#Beta3 | N/A |
Feature Documentation
Item | Description | Status |
---|---|---|
#Project_Wiki | Wiki Links to all feature related entries | ok ? |
#Developer_Links (blogs) | Developer links to feature related sites | still need dev-doc |
#Other_Docs | Web links to feature related sites | |
#Developer_QA_Review | Details from developer and qa discussions regarding feature test strategies and issues. |
Feature Bug Management
Item | Description | Status |
---|---|---|
#Bug_Tracking | Top level bugs tracking feature | |
#Bug_Verification | Feature bugs that need verification | |
#Bug_Triage | Links triage bug tasks |
Feature Test Items
The table below provides a breakdown of all feature items that should be covered and how they will be tested. Not all items will be covered by internal QA team members. It is important to list what should be covered. If it is not covered, list it as not covered.
Note: not all items listed below will apply for a given feature
Test Item | Description | Covered By | Status |
---|---|---|---|
Item 1 | Item 1 Description | Developer Tests | |
Item 2 | Item 2 Description | Beta tester exposure | |
#Localization | Feature localization | ||
#Accessibility | Feature accessibility | ||
#Plugins | Plugins compatibility | ||
#Addons | Addons compatibility | ||
#Topsites | Top internet sites compatibilities |
Feature Tests
Automated Tests
Item | Description | Status |
---|---|---|
#Developer_Tests | Links to automated developer tests | |
#Mozmill_Tests | Links to automated mozmill feature test cases |
Manual Tests
Item | Description | Status |
---|---|---|
#Smoke_Tests | link to smoke tests | |
#Regression_Tests | link to BFT and/or regression tests | |
#Functional_Tests | link to FFT and/or complete functional tests |
Community Test Events
Item | Description | Status |
---|---|---|
#Testdays | Links to test day event results for feature | |
#Bugdays | Links to bug day event results for feature | |
#Meetups | Links to Meetup events for feature |
Feature Documentation Details
Project Wiki
Developer Links
- http://www.mozilla.com/en-US/firefox/accountmanager/
- http://mozillalabs.com/blog/2010/03/account-manager/
Other Docs
- tracking marked as doc needed
Developer QA Review
The QA person responsible for the feature should hold a formal interview with the lead developer or feature champion. Below are questions that should be asked in the interview:
- Do we have automated tests for the feature?
- What do they cover?
- What do they not cover?
- How well do they cover the feature?
- What are the important areas we should focus on?
- What are the dependencies?
- What is our comfort level with this feature in its current state?
- What feedback would you like from QA?
Feature Release Readiness Assessment Details
Beta1
Beta2
at risk ?
Beta3
Feature Bug Management Details
Bug Tracking
- Top level bugs tracking feature. Include any relevant bug queries that are helpful for tracking feature status.
Query Name | Description |
---|---|
bug 571409 | Tracking Bug |
Bug Verification
- Feature bugs that need verification
Bug Triage
- Bug triage information
Feature Test Items Details
Localization
- Testing of the Account Manager in various Localization Builds like P1 Localizations
Accessibility
- asking marco for a11y tests
Plugins
- Details of plugins compatibility test requirements
Addons
- Account Manager will be included in Firefox 4 - addon testing maybe required for the Account Manager Addon ?
Topsites
- Top Site planned with Crash Automation
Feature Tests Details
Automated Tests Details
Developer Tests
- Links to automated developer tests
Manual Tests Details
Smoke_Tests
- links to litmus smoke tests or description
Regression_Tests
- links to litmus BFT and/or regression tests description
Functional_Tests
- links to litmus FFT and/or complete functional tests description
Community Test Events Details
Testdays
- Testday Planned as soon as feature lands
Bugdays
- Feature will be new in Firefox 4, so no Bugday Planned before the Release.
Meetups
- Plan to present the Feature at the Meetup in Munich