Firefox:2.0 QA Activities:BFTScheduleAndResults

From MozillaWiki
Jump to: navigation, search

Firefox 2.0 Basic Functional Testing Schedule and Results

Based on these guidelines below, this testing, from June 2 to Agust 7, will give us 9 runs on Windows, 4 runs on Intel Mac, and 2 runs each on Linux and PPC mac. Tracy will do 8 runs. Marcia, Juan and Adam will do 3 runs each.

  • Until FF2.0 stabalizes, run BFT's as follows:
    • Primary platform; weekly: Win
    • Secondary platforms; alternate Intel Mac with Linux, PPC Mac every other week.

Friday June 2, 2006

  • Windows XP
  • State: FAILED
    • Tester: Tracy
    • Build: 2006-06-02-04-mozilla1.8 (nsis installer)
    • Talkback Build ID: 2006060204
    • Bugs Found:
      • No exit survey - bug 340167 - (verified fixed 6/12/06)
      • Crash caused by Options; Privacy - bug 340133 - (verified fixed 6/12/06)
      • Print Preview ugliness switching from landscape - bug 340119 - (verified fixed 6/12/06)

Monday June 12, 2006

  • Windows XP
  • State: PASSED
    • Tester: Tracy
    • Build: 2006-06-12-04-mozilla1.8 (nsis installer)
    • Talkback Build ID: 2006061204
    • Bugs Found:
      • unconfirmed hang I believe due to Java applets - needs more investigation

Monday June 19, 2006

  • Windows XP
  • State: PASS (pending investigation into Java hang)
    • Tester: Tracy
    • Build: 2006-06-19-03-mozilla1.8
    • Talkback Build ID: 2006061903
    • Bugs Found:
      • litmus run: Two BFT Failures
        • Long time bug of copy and paste of items goes above selected item
        • Seeing a hang related to Java. I need to spend some time on this later tonight or tomorrow to nail down reproducible steps. (I have a feeling I may be running a wrong(old) version of Java)
  • Intel Mac
  • State:
    • Tester: Marcia
    • Build:
    • Talkback Build ID:
    • Bugs Found:

Monday June 26, 2006

  • Windows XP
  • State: (not run)
    • Tester: Juan
    • Build:
    • Talkback Build ID:
    • Bugs Found:
  • Linux
  • State: (moved to July 10)
    • Tester: Adam
    • Build:
    • Talkback Build ID:
    • Bugs Found:

Wednesday July 5, 2006

  • Windows XP
  • State: (not run)
    • Tester: Tracy
    • Build:
    • Talkback Build ID:
    • Bugs Found:
  • Intel Mac
  • State: (moved to July 10)
    • Tester: Juan
    • Build:
    • Talkback Build ID:
    • Bugs Found:

Monday July 10, 2006/Tuesday July 11, 2006

  • Windows XP
  • State: PASS
    • Tester: Marcia
    • Build: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1b1) Gecko/20060710 Firefox/2.0b1
    • Talkback Build ID: 2006071020 (but also tested RC1 and RC2 builds as well)
    • Bugs Found: Shutdown crash when browser was idle. Will investigate and get a bug on file based on stack.
  • PPC Mac
  • State: Litmus results : http://tinyurl.com/f4ugo : PASS
    • Tester: Tracy
    • Build: Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.8.1b1) Gecko/20060707 Firefox/2.0b1
    • Talkback Build ID: 2006070719
    • Bugs Found: bug 343772
  • Linux
  • State: Results: http://tinyurl.com/z5ge4 - Overall PASS
    • Tester: Adam
    • Build: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1b1) Gecko/20060708 Firefox/2.0b1
    • Talkback Build ID: 2006070800
    • Bugs Found: bug 344202, posted comments in a few other bugs; e.g. bug 316999

Monday July 17, 2006

  • builds getting stable, waiting for a few fixes. Pushing out testing for a week or two.

Monday July 24, 2006

  • Windows XP
  • State:
    • Tester: Tracy (testing July 25)
    • Build:
    • Talkback Build ID:
    • Bugs Found:
  • Linux
  • State:
    • Tester: Juan
    • Build:
    • Talkback Build ID:
    • Bugs Found:

Monday July 31, 2006

  • Windows XP
  • State: PASS
    • No new regressions found.
    • New Options dialog landed and pass:
      • Tabs and Feeds categories look baren without subcategory borders
    • Tester: Tracy
    • Build: 20060731
    • Talkback Build ID: 2006073104
    • Bugs Found:

Wednesday, August 2, 2006

Monday August 7, 2006

cancelled We are going to run Full Functional Tests immediately following code freeze for beta2. No need to BFT with the superset coming up in a couple days.