QA/Firefox 4/Test Plan/Feedback/

From MozillaWiki
< QA‎ | Firefox 4‎ | Test Plan
Jump to: navigation, search

Feedback (Test Pilot + Input)

  • Development Status: - In progress (6/15)
  • Feature Testing: - In progress (6/15)
  • Team:
    • Test Pilot - Developer: jono, QA contact: tracy
    • Input - Developer: fwenzel, jorge QA contact: aakash
  • Tracking Bugs:

Description

Integration of Input and Test Pilot into "Feedback" for Fx4 betas

Input is intended to garner better constructive feedback from our users and demographic information before we release major version of our browsers.

Test Pilot is structured to collect user feedback through Firefox. Test Pilot studies explore how people use their web browser and the Internet - and help us build better products.

note: This feature is expected to be taking out of Fx4 prior to final release.

Release Readiness Assessment

The table below provides a top level go/no go assessment of whether the feature is release ready for the given milestone.

Milestone Assessment
#Beta1 On track
#Beta2 N/A
#Beta3 N/A

top

Documentation

Item Description Status
#Project_Wiki Wiki Links to all feature related entries
#Developer_Links (blogs) Developer links to feature related sites
#Other_Docs Web links to feature related sites
#Developer_QA_Review Details from developer and qa discussions regarding feature test strategies and issues.

top

Bug Management

Item Description Status
#Bug_Tracking Top level bugs tracking feature
#Bug_Verification Feature bugs that need verification
#Bug_Triage Links triage bug tasks

top

Test Items

The table below provides a breakdown of all feature items that should be covered and how they will be tested. Not all items will be covered by internal QA team members. It is important to list what should be covered. If it is not covered, list it as not covered.

Note: not all items listed below will apply for a given feature

Test Item Description Covered By Status
#Test Pilot 1.0 Extension tracy, tchung in progress at rc1
#Integration Feedback integration into Fx 4 tracy, tchung rc landed via build config
#Localization Feature localization localizers tbd
#Accessibility Feature accessibility marco tbd
#Plugins Plugins compatibility tracy, tchung, community
#Addons Addons compatibility tracy, tchung, community issues with various ext interacting badly - bug 577349
#Topsites Top internet sites compatibilities not tested

top

Tests

Automated Tests

Item Description Status
#Developer_Tests Links to automated developer tests
#Mozmill_Tests Links to automated mozmill feature test cases

Manual Tests

Item Description Status
#Smoke_Tests link to smoke tests
#Regression_Tests link to BFT and/or regression tests
#Functional_Tests link to FFT and/or complete functional tests

top

Community Test Events

Item Description Status
#Testdays Links to test day event results for feature
#Bugdays Links to bug day event results for feature
#Meetups Links to Meetup events for feature

top

Documentation Details

Project Wiki

top

Developer Links

top

Other Docs

top

Release Readiness Assessment Details

Beta1

  • Front end: UI and feature complete
    • TP extension integrated pre-bundled
    • "Input" fully integrated
  • Back end: Stable and able to support of 4-10 million users

Beta2

  • New studies

Beta3

  • New studies

Bug Management Details

Bug Tracking

  • Top level bugs tracking feature. Include any relevant bug queries that are helpful for tracking feature status.
Query Name Description
Blocker/Critical bugs Current blocker or critical bugs
Open Test Pilot bugs All open Test Pilot bugs
Open Input bugs All open Input bugs

top

Bug Verification

Query Name Description
unverified bugs Fixed bugs needing QA verification

top

Bug Triage

Query Name Description
unconfirmed bugs Bugs needing triage
qawanted bugs bugs with QA needs
in-litmus? bugs bugs requesting a manual test case be created

top

Test Items Details

Localization

  • Localization tracking list
  • The demographic background surveys will be localized for beta r1.
  • Extension will be localized in top languages for beta r2.
  • TP study descriptions will be localized through community volunteers.
  • TP website will be localized through community volunteers.'

top

Accessibility

  • Details of feature accessibility test requirements - tbd

top

Plugins

  • Details of plugins compatibility test requirements - tbd

top

Addons

  • Details of addons compatibility - n/a

top

Topsites

  • Details of top internet sites test requirements - n/a

top

Tests Details

Automated Tests Details

Developer Tests

  • Links to automated developer tests

top

Mozmill Tests

Since this will be a temporary, beta track only feature, not released in final. We will not be requesting Mozmill automated tests.

top

Manual Tests Details

Litmus Test Pilot 1.0 test suite

It has yet to be determined if it will be necessary to create a separate Fx4 beta integration test suite in Litmus.

Smoke_Tests

  • links to litmus smoke tests or description

top

Regression_Tests

  • links to litmus BFT and/or regression tests description

top

Functional_Tests

  • links to litmus FFT and/or complete functional tests description

top

Community Test Events Details

Testdays

  • Links to test day event results for feature - date tbd

Bugdays

  • Links to bug day event results for feature - date tbd

Meetups

  • Links to Meetup events for feature include in Fx4 meet-up?