MozillaQualityAssurance:Home Page:Firefox 3.0 TestPlan:Fx3 QA Daily Smoketest

From MozillaWiki
Revision as of 15:28, 21 August 2007 by Twalker (talk | contribs)
Jump to navigation Jump to search

Tiger Team Testing Squad

al, marcia, tchung, tracy, tomcat, stephend

Platform Teams for Daily Smoketesting

  • Windows:
    • Vista - Tomcat/Marcia/Tony
    • XP - Al/Tracy/Stephen
  • Mac:
    • PPC - Marcia/Stephen/Tracy
    • Intel - Al/Marcia/Tomcat
  • Linux
    • Various Flavors - Tony/Tomcat/Tracy

Platforms are covered double so that we have :

  • a.) the chance for double testing on different machines
  • b.) 4 eyes looking at a test and not only 2
  • c.) in case of vacation / illness/ other urgent tasks there is always a backup
  • d.) one team member can run the smoketest, the other focus testing
  • e). in times of a low checkin rate, one team member can regenerate or working *for a week on other goals.

As Example the XP Platform Team would be also flexible that one member can concentrate on other tasks or focus testing and the 3rd one can pause for a week.

Key:

  • ST=Smoketest
    • The tester will run the Litmus smoketest.
  • Focused=Focused Testing
    • The tester will run focused testing around any checkins that have occurred. This means reviewing Burning Edge or bonsai.mozilla.org to see what has been checked in.
  • Test Results can be found in Litmus by using Smoketest Results. That is a load in sidebar bookmarkable page.

Tiger Testing Procedure

  • Refer to the schedule and perform smoketest or focused testing as noted for the platform(s) you're assigned to that week.
  • Use Litmus for smoketests reporting. File any bugs found.
  • Elevate Smoketest blocker bugs with the sheriff of the day.
    • Smoketest blocker is any bug that completely breaks some critical area(s) of the browser; breakage that can not be worked around in anyway.
    • Refer to the Sheriff Schedule to see who is on duty. Then notify them of the blocker bug, via irc or email, so they can do their Sheriff stuff.
    • Remain accessible to help with QA of the issue.

Schedule

August Schedule

Win XP Win Vista Intel Mac PPC Mac Linux
Week of August 6 al ST Tomcat Focused marcia Focused Tomcat ST tracy ST
Week of August 13 (week of onsite) n/a n/a n/a n/a n/a
Week of August 20 stephend Focused Tony ST Tomcat ST tracy Focused tracy ST
Week of August 27 Al Focused Tomcat ST Tomcat Focused stephen ST tracy ST

September Schedule

Win XP Win Vista Intel Mac PPC Mac Linux
Week of Sept 3 tracy - ST tony - Focused marcia - Focused stephen - ST tomcat - ST
Week of Sept 10 stephen - Focused marcia - ST al - Focused marcia - ST tony - ST
Week of Sept 17 al - ST tomcat - Focused tomcat - ST tracy - ST tracy - Focused
Week of Sept 24 tracy - Focused tony - ST marcia - ST stephen - Focused tomcat - ST

Reference Pages

Major Bugs Discovered during smoketesting

  • Please paste the major bug numbers in here so we can track metrics as we go along. This will be much easier than going back and having to dredge through Bugzilla later on. If you find a bug that has been reported previously or you end up confirming it, include that as well. If you are covering focused testing, it would be great to get some information about what you focused on testing by day.
  • Please put latest finding on top of this weekly list

Week of August 20, 2007

TBD

Week of August 13, 2007

n/a - Mofo all-hands

Week of August 6, 2007

  • bug 385925 "Open" link in download manager broken (linux - tracy)
  • bug 390711 autocomplete menus have no border (linux - tracy)
  • bug 391380 moz-icon: opens Launch Applicaion (linux - tracy)
  • bug 391388 modal dialog don't have focus on open (linux - tracy)

Week of July 30, 2007

  • 2007-08-03-08 (Intel Mac, marcia) Focused testing after josh's checkin Bug 354768 I hit some rough seas with lots of crashes, Bug 390707 was on file already and may cover my crashes. In general today's build is quite crashy. I crashed frequently in form fields and also hit the text zoom bug which crashes many sites when you increase the font size.

Week of July 23, 2007

Week of July 16, 2007

  • 2007-07-017-04 Mac (marcia) bug 388522 Found this regression while doing focused testing of drag and drop. I noticed there was a landing affecting d&d. Found regression window and cc'd devs.

Week of July 9, 2007

  • 2007-07-10-08 (Intel Mac, marcia) bug 387573
  • 2007-07-10-08 - (WinXP - ctalbert) bug 355538 Did not file, but found while running smoketest
  • 2007-07-10-08 - (WinXP - ctalbert) bug 387568 Found and filed
  • 2007-07-11-05 - (WinXP - ctalbert) bug 334305 Existing bug, found during test
  • 2007-07-11-05 - (WinXP - ctalbert) bug 351049 Existing bug, found during test
  • 2007-07-11-05 - (WinXP - ctalbert) bug 351049 Existing bug, found during test
  • 2007-08-12-05 - (WinXP - ctalbert) bug 387568 Existing regression, encountered during test
  • 2007-08-13-04 - (Intel Mac - marcia) bug 388082 Existing regression, encountered during test
  • 2007-07-09-08 ALL (Tomcat) bug 387446 Worked with devs on this Bug


Week of July 2, 2007

  • 2007-07-03-04 (Windows - tracy) Bug 386739
  • 2007-07-03-04 (Windows - tomcat)Bug 386656
  • 2007-07-05-04 (Mac - marcia) Bug 387002
  • 2007-07-06-04 (Mac - marcia) Bug 387084 I did not file the bug, but I discovered it during testing.
  • 2007-07-06-04 Bug 387188
Retrieved from "https://wiki.mozilla.org/index.php?title=MozillaQualityAssurance:Home_Page:Firefox_3.0_TestPlan:Fx3_QA_Daily_Smoketest&oldid=65917"