QA/Weave Test Plan/1.3: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(26 intermediate revisions by the same user not shown)
Line 7: Line 7:
== Current Tasks ==
== Current Tasks ==
* {{done|}} Flesh out BFT's and 1.3 client test plan
* {{done|}} Flesh out BFT's and 1.3 client test plan
* Verify fixed blocking and targeted bugs (translates to P1/P2 though not flagged that way)
* Add Weave/Fennec specific test cases to Litmus Weave test run
* Test Day on 4/23
* {{done|}} Test Day on 4/23
* Execute this test plan against 1.3 betas


== Schedule ==
== Schedule ==
* QA starts: April 21st ?
* QA starts: April 23rd
* Functional Tests: 1 person (3-4 days):
** 1.3b6 available 5/21
** Primary Platforms
** 1.3b5 available 5/7
* Large Profile First Sync testing: 1 person (1 day)
** 1.3b4 available 5/4
** 1.3b3 available 5/1
** 1.3b2 available 4/26
** 1.3b1 available 4/23
* Client testing sign-off eta 5/24
 
* Functional and exploratory testing on Primary Platforms: 1 person (3-4 days): PASS
** Windows 7 - Done - Pass
** Mac 10.6 - Done - Pass
** Windows XP - Done - Pass
 
* Large Profile First Sync testing: 1 person (1 day) PASS with 6 months accumulated profile.
** Primary Platforms
** Primary Platforms
* Related subgroup BFT of Fx: 1 person (1 day)
* Related subgroup BFT of Fx: 1 person (1 day)
** Windows 7 - Done - Pass
** Mac 10.6 - Done - Pass
* Fennec testing: 1 person (2 days)
* Fennec testing: 1 person (2 days)
* Release ?
* Release:
** Client code freeze - 5/7
** Ship - 5/25 (eta 5/17 - missed)


== Builds ==  
== Builds ==  
* [https://services.mozilla.com/sync/install.php experimental version]
* [https://services.mozilla.com/sync/install.php experimental version]
* Staging Server [https://stage-auth.services.mozilla.com https://stage-auth.services.mozilla.com]


== Test Results ==
== Test Results ==
* Functional testing - tbd
* Functional testing - PASS
* Large Profile Start up - tbd
* Large Profile Start up - not done
* Related Fx subgroup testing - tbd
* Related Fx subgroup testing - PASS
* Fennec testing - tbd
* Fennec testing - tbd


=== Bugs Filed ===
=== Bugs Filed ===
Please add whiteboard note ''[weave1.3]'' to generate this
Please add whiteboard note ''[weave1.3]'' to generate this list.
[https://bugzilla.mozilla.org/buglist.cgi?classification=Client%20Software;status_whiteboard_type=anywordssubstr;query_format=advanced;status_whiteboard=%5Bweave1.3%5D;bug_status=UNCONFIRMED;bug_status=NEW;bug_status=ASSIGNED;bug_status=REOPENED;bug_status=RESOLVED;bug_status=VERIFIED;product=Weave Bugs found in weave1.3] list.
 
[https://bugzilla.mozilla.org/buglist.cgi?status_whiteboard_type=anywordssubstr&query_format=advanced&status_whiteboard=%5bweave1.3%5d%2C%20weave1.3b1%2C%20%5bweave1.3b1%5d&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&bug_status=RESOLVED&bug_status=VERIFIED&product=Weave&classification=Client%20Software Bugs found in weave1.3 betas]


[https://bugzilla.mozilla.org/buglist.cgi?cmdtype=dorem&remaction=run&namedcmd=Weave.Next%20Blockers&sharer_id=125983 Open 1.3 blocker bugs]
[https://bugzilla.mozilla.org/buglist.cgi?cmdtype=dorem&remaction=run&namedcmd=Weave.Next%20Blockers&sharer_id=125983 Open 1.3 blocker bugs]
Line 38: Line 58:
Bug fixed since April 9th (1.2), but not verified [https://bugzilla.mozilla.org/buglist.cgi?chfieldto=Now&query_format=advanced&chfieldfrom=2010-04-09&bug_status=RESOLVED&component=Experimental%20Clients&component=Fennec%20UI&component=Firefox%20UI&component=General&component=Needs%20Triage&resolution=FIXED&classification=Client%20Software&product=Weave here]
Bug fixed since April 9th (1.2), but not verified [https://bugzilla.mozilla.org/buglist.cgi?chfieldto=Now&query_format=advanced&chfieldfrom=2010-04-09&bug_status=RESOLVED&component=Experimental%20Clients&component=Fennec%20UI&component=Firefox%20UI&component=General&component=Needs%20Triage&resolution=FIXED&classification=Client%20Software&product=Weave here]


[https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&classification=Client%20Software&chfieldto=2010-05-10&chfield=bug_status&query_format=advanced&chfieldfrom=2010-04-10&bug_status=VERIFIED&product=Weave verified bugs between Apr 10 and May 10]
[https://bugzilla.mozilla.org/buglist.cgi?resolution=FIXED&classification=Client%20Software&chfieldto=2010-05-25&chfield=bug_status&query_format=advanced&chfieldfrom=2010-04-10&bug_status=VERIFIED&product=Weave verified bugs between Apr 10 and May 25]

Latest revision as of 21:22, 21 May 2010

Weave 1.3 Test Plan

Manual test plan of 1.3. Focus on functional testing and large profile initial sync to ensure high quality user experience and no data loss

Description of Release

Point release with mainly fixes for usability and performance. Weave Update page

Current Tasks

  • [DONE] Flesh out BFT's and 1.3 client test plan
  • Add Weave/Fennec specific test cases to Litmus Weave test run
  • [DONE] Test Day on 4/23
  • Execute this test plan against 1.3 betas

Schedule

  • QA starts: April 23rd
    • 1.3b6 available 5/21
    • 1.3b5 available 5/7
    • 1.3b4 available 5/4
    • 1.3b3 available 5/1
    • 1.3b2 available 4/26
    • 1.3b1 available 4/23
  • Client testing sign-off eta 5/24
  • Functional and exploratory testing on Primary Platforms: 1 person (3-4 days): PASS
    • Windows 7 - Done - Pass
    • Mac 10.6 - Done - Pass
    • Windows XP - Done - Pass
  • Large Profile First Sync testing: 1 person (1 day) PASS with 6 months accumulated profile.
    • Primary Platforms
  • Related subgroup BFT of Fx: 1 person (1 day)
    • Windows 7 - Done - Pass
    • Mac 10.6 - Done - Pass
  • Fennec testing: 1 person (2 days)
  • Release:
    • Client code freeze - 5/7
    • Ship - 5/25 (eta 5/17 - missed)

Builds

Test Results

  • Functional testing - PASS
  • Large Profile Start up - not done
  • Related Fx subgroup testing - PASS
  • Fennec testing - tbd

Bugs Filed

Please add whiteboard note [weave1.3] to generate this list.

Bugs found in weave1.3 betas

Open 1.3 blocker bugs

Bug Verifications

Bug fixed since April 9th (1.2), but not verified here

verified bugs between Apr 10 and May 25