QA/Firefox 4/Test Plan/Feedback/
Contents
- 1 Feedback (Test Pilot + Input)
- 2 Release Readiness Assessment
- 3 Documentation
- 4 Bug Management
- 5 Test Items
- 6 Tests
- 7 Community Test Events
- 8 Documentation Details
- 9 Release Readiness Assessment Details
- 10 Bug Management Details
- 11 Test Items Details
- 12 Tests Details
- 13 Community Test Events Details
Feedback (Test Pilot + Input)
- Development Status: - In progress (6/15)
- Feature Testing: - In progress (6/15)
- Team:
- Test Pilot - Developer: jono, QA contact: tracy
- Input - Developer: fwenzel, jorge QA contact: aakash
- Tracking Bugs:
- Backend - bug 565379
- FX4 beta integration UX - bug 562784
Description
Integration of Input and Test Pilot into "Feedback" for Fx4 betas
Input is intended to garner better constructive feedback from our users and demographic information before we release major version of our browsers.
Test Pilot is structured to collect user feedback through Firefox. Test Pilot studies explore how people use their web browser and the Internet - and help us build better products.
note: This feature is expected to be taking out of Fx4 prior to final release.
Release Readiness Assessment
The table below provides a top level go/no go assessment of whether the feature is release ready for the given milestone.
Milestone | Assessment |
---|---|
#Beta1 | On track |
#Beta2 | N/A |
#Beta3 | N/A |
Documentation
Item | Description | Status |
---|---|---|
#Project_Wiki | Wiki Links to all feature related entries | |
#Developer_Links (blogs) | Developer links to feature related sites | |
#Other_Docs | Web links to feature related sites | |
#Developer_QA_Review | Details from developer and qa discussions regarding feature test strategies and issues. |
Bug Management
Item | Description | Status |
---|---|---|
#Bug_Tracking | Top level bugs tracking feature | |
#Bug_Verification | Feature bugs that need verification | |
#Bug_Triage | Links triage bug tasks |
Test Items
The table below provides a breakdown of all feature items that should be covered and how they will be tested. Not all items will be covered by internal QA team members. It is important to list what should be covered. If it is not covered, list it as not covered.
Note: not all items listed below will apply for a given feature
Test Item | Description | Covered By | Status |
---|---|---|---|
#Test Pilot 1.0 | Extension | tracy, tchung | in progress at rc1 |
#Integration | Feedback integration into Fx 4 | tracy, tchung | rc landed via build config |
#Localization | Feature localization | localizers | tbd |
#Accessibility | Feature accessibility | marco | tbd |
#Plugins | Plugins compatibility | tracy, tchung, community | |
#Addons | Addons compatibility | tracy, tchung, community | issues with various ext interacting badly - bug 577349 |
#Topsites | Top internet sites compatibilities | not tested |
Tests
Automated Tests
Item | Description | Status |
---|---|---|
#Developer_Tests | Links to automated developer tests | |
#Mozmill_Tests | Links to automated mozmill feature test cases |
Manual Tests
Item | Description | Status |
---|---|---|
#Smoke_Tests | link to smoke tests | |
#Regression_Tests | link to BFT and/or regression tests | |
#Functional_Tests | link to FFT and/or complete functional tests |
Community Test Events
Item | Description | Status |
---|---|---|
#Testdays | Links to test day event results for feature | |
#Bugdays | Links to bug day event results for feature | |
#Meetups | Links to Meetup events for feature |
Documentation Details
Project Wiki
Developer Links
- Beta Integration planning page
- The API for implementing a Test Pilot experiment
- How to fix Test Pilot bugs
Other Docs
- How to package the Latest Feedback XPI yourself
- Labs home page
- Read our blog at Test Pilot blog
- Share your feedback at Google Discussion Group
- Follow our latest news via Twitter
- Make friends with other Test Pilots via Facebook Group
Release Readiness Assessment Details
Beta1
- Front end: UI and feature complete
- TP extension integrated pre-bundled
- "Input" fully integrated
- Back end: Stable and able to support of 4-10 million users
Beta2
- New studies
Beta3
- New studies
Bug Management Details
Bug Tracking
- Top level bugs tracking feature. Include any relevant bug queries that are helpful for tracking feature status.
Query Name | Description |
---|---|
Blocker/Critical bugs | Current blocker or critical bugs |
Open Test Pilot bugs | All open Test Pilot bugs |
Open Input bugs | All open Input bugs |
Bug Verification
Query Name | Description |
---|---|
unverified bugs | Fixed bugs needing QA verification |
Bug Triage
Query Name | Description |
---|---|
unconfirmed bugs | Bugs needing triage |
qawanted bugs | bugs with QA needs |
in-litmus? bugs | bugs requesting a manual test case be created |
Test Items Details
Localization
- Localization tracking list
- The demographic background surveys will be localized for beta r1.
- Extension will be localized in top languages for beta r2.
- TP study descriptions will be localized through community volunteers.
- TP website will be localized through community volunteers.'
Accessibility
- Details of feature accessibility test requirements - tbd
Plugins
- Details of plugins compatibility test requirements - tbd
Addons
- Details of addons compatibility - n/a
Topsites
- Details of top internet sites test requirements - n/a
Tests Details
Automated Tests Details
Developer Tests
- Links to automated developer tests
Mozmill Tests
Since this will be a temporary, beta track only feature, not released in final. We will not be requesting Mozmill automated tests.
Manual Tests Details
Litmus Test Pilot 1.0 test suite
It has yet to be determined if it will be necessary to create a separate Fx4 beta integration test suite in Litmus.
Smoke_Tests
- links to litmus smoke tests or description
Regression_Tests
- links to litmus BFT and/or regression tests description
Functional_Tests
- links to litmus FFT and/or complete functional tests description
Community Test Events Details
Testdays
- Links to test day event results for feature - date tbd
Bugdays
- Links to bug day event results for feature - date tbd
Meetups
- Links to Meetup events for feature include in Fx4 meet-up?