Firefox:1.5.0.7:Smoketests: Difference between revisions

 
(24 intermediate revisions by 4 users not shown)
Line 3: Line 3:
Please mark with '''PASS'''/'''FAIL'''.  Make note of any bugs found during testing and link to bugzilla.  Any additional comments concerning the quality of the test descriptions and applicability for each platform would also be helpful.
Please mark with '''PASS'''/'''FAIL'''.  Make note of any bugs found during testing and link to bugzilla.  Any additional comments concerning the quality of the test descriptions and applicability for each platform would also be helpful.


*Linux
=== RC2 builds - tested 08/29 ===
**Tester:
*Linux - PASS.
**Result:
**Tester: tracy
*Mac
**Build: 2006082913 (rc2)
**Tester:
**Result: [http://tinyurl.com/mgl97 test results]
**Result:
*Mac - PASS.
*Windows
**Tester: tracy (eggplant)
**Tester:
**Build: 2006082923 (rc2)
**Result
**Result: [http://tinyurl.com/pzs8s test results]
*Windows - PASS.
**Tester: tracy (eggplant)
**Build: 2006082915 (rc2)
**Result: [http://tinyurl.com/n68jj test results]
**Tester: Bobby(irc)
**Build: 2006082915 (rc2)
**Results: [http://tinyurl.com/mjwsm test results]
 
=== RC3 builds - tested 09/01 ===
*Linux - PASS.
**Tester: tracy
**Build: 2006083118 (rc3)
**Result: [http://tinyurl.com/kjyjw test results]
*Mac - PASS.
**Tester: tracy (eggplant)
**Build: 2006083118 (rc3)
**Result: [http://tinyurl.com/gpm7l test results]
*Windows - PASS.
**Tester: tracy (eggplant)
**Build: 2006083118 (rc3)
**Result: [http://tinyurl.com/jp4vc test results]
 
=== RC4 builds - tested 09/06 ===
*Linux - PASS.
**Tester: tracy
**Build: 2006090611 (rc4)
**Result: [http://tinyurl.com/mbly4 test results]
*Mac - PASS.
**Tester: tracy (eggplant)
**Build: 2006090611 (rc4)
**Result: [http://tinyurl.com/o7l52 test results]
*Windows - PASS.
**Tester: tracy (eggplant)
**Build: 2006090612 (rc4)
**Result: [http://tinyurl.com/o5qw4 test results]
 
=== RC5 builds - tested 09/07 ===
*Linux - PASS.
**Tester: tracy
**Build: 2006090621 (rc5)
**Result: [http://tinyurl.com/ohm4o test results]
*Mac - PASS.
**Tester: tracy (eggplant)
**Build: 2006090621 (rc5)
**Result: [http://tinyurl.com/rh4sf test results]
*Windows - PASS.
**Tester: tracy (eggplant)
**Build: 2006090622 (rc5)
**Result: [http://tinyurl.com/oy8h9 test results]
 
=== RC6 builds - tested 09/10 ===
*Linux - PASS.
**Tester: tracy
**Build: 2006090918 (rc6)
**Result: [http://tinyurl.com/mhjsh test results]
*Mac - PASS.
**Tester: tracy (eggplant)
**Build: 2006090921 (rc6)
**Result: [http://tinyurl.com/rdp8u test results]
*Windows - PASS.
**Tester: tracy (eggplant)
**Build: 2006090918 (rc6)
**Result: [http://tinyurl.com/gfmku test results]
 
 
'''Note: bug 343772 (all platforms) needs to be fixed on 1.5.0.x branch before next release.'''
 
Test case notes:  I will be reviewing and making some minor adjustments to the 1.5 smoketest suite to sync it with Eggplant.  Generally breaking up test cases that actually do two or more things.
 
== Thunderbird Smoketest results ==
 
=== RC3 builds - tested 09/01 ===
 
*Linux - PASS
**Tester: marcia
**Build:  2006090109(rc3)
**Result: in Litmus
*Intel Mac - PASS
**Tester: marcia
**Build:  2006090109 (rc3)
**Result: in Litmus
*Windows - PASS
**Tester: marcia
**Build:  2006090109 (rc3)
**Result: in Litmus
 
*Linux Crash: Incident ID: 22790373 <http://spike.mozilla.org/reports/incidenttemplate.cfm?bbid=22790373>
*Fedora Core 3 has an ugly progress meter bug that I have seen on Firefox as well *I will get a bug on file if there is not already one there.
 
=== RC5 builds - tested 09/07 ===
 
*Linux - '''PASS'''
**Tester: marcia
**Build: version 1.5.0.7 (20060907)
**Result: in Litmus
*Intel Mac - '''PASS'''
**Tester: marcia
**Build: version 1.5.0.7 (20060907)
**Talkback Build ID: 2006090710
**Result: in Litmus
*Windows - '''PASS'''
**Tester: Tomcat
**Build:  2006090710
**Result: in Litmus
 
=== RC6 builds - tested 09/11 ===
 
*Linux - '''PASS'''
**Tester: marcia
**Talkback Build ID: 2006090918
**Version: version 1.5.0.7 (20060909)
**Result: in Litmus
*Intel Mac - '''PASS'''
**Tester: marcia
**Talkback Build ID: 2006090918
**Version: version 1.5.0.7 (20060909)
**Result: in Litmus (run says PPC instead of Intel Mac by accident, test was run on Intel Mac not PPC)
*Windows - '''PASS'''
**Tester: Tomcat
**Talkback Build ID: (2006090918)
**Version:  version 1.5.0.7 (20060909)
**Result: in Litmus
 
=== Signing tests for RC6 build using Thawte Certificate ===
 
*Windows '''PASS'''
*Intel Mac - '''PASS'''
*Linux - '''PASS'''
 
=== Testing of Digital Signatures ===
 
**Tested install a Thawte certificate in Thunderbird 1.5.0.7 and sending a signed email - '''PASS''' on all three platforms.
**Turns out the CA cert is a compatability issue
 
=== Issues Noted ===
From marcia:
*Signing emails worked as expected on Windows - Tomcat sent me a message and it was signed.
*On Mac and Linux, the CA Cert that I used was able to be sent but it comes across as broken.
*On Linux, the Thawte cert that I used is sent but also comes across as broken on the receiving end.

Latest revision as of 19:35, 11 September 2006

Firefox Smoketest results

Please mark with PASS/FAIL. Make note of any bugs found during testing and link to bugzilla. Any additional comments concerning the quality of the test descriptions and applicability for each platform would also be helpful.

RC2 builds - tested 08/29

  • Linux - PASS.
  • Mac - PASS.
    • Tester: tracy (eggplant)
    • Build: 2006082923 (rc2)
    • Result: test results
  • Windows - PASS.
    • Tester: tracy (eggplant)
    • Build: 2006082915 (rc2)
    • Result: test results
    • Tester: Bobby(irc)
    • Build: 2006082915 (rc2)
    • Results: test results

RC3 builds - tested 09/01

  • Linux - PASS.
  • Mac - PASS.
    • Tester: tracy (eggplant)
    • Build: 2006083118 (rc3)
    • Result: test results
  • Windows - PASS.
    • Tester: tracy (eggplant)
    • Build: 2006083118 (rc3)
    • Result: test results

RC4 builds - tested 09/06

  • Linux - PASS.
  • Mac - PASS.
    • Tester: tracy (eggplant)
    • Build: 2006090611 (rc4)
    • Result: test results
  • Windows - PASS.
    • Tester: tracy (eggplant)
    • Build: 2006090612 (rc4)
    • Result: test results

RC5 builds - tested 09/07

  • Linux - PASS.
  • Mac - PASS.
    • Tester: tracy (eggplant)
    • Build: 2006090621 (rc5)
    • Result: test results
  • Windows - PASS.
    • Tester: tracy (eggplant)
    • Build: 2006090622 (rc5)
    • Result: test results

RC6 builds - tested 09/10

  • Linux - PASS.
  • Mac - PASS.
    • Tester: tracy (eggplant)
    • Build: 2006090921 (rc6)
    • Result: test results
  • Windows - PASS.
    • Tester: tracy (eggplant)
    • Build: 2006090918 (rc6)
    • Result: test results


Note: bug 343772 (all platforms) needs to be fixed on 1.5.0.x branch before next release.

Test case notes: I will be reviewing and making some minor adjustments to the 1.5 smoketest suite to sync it with Eggplant. Generally breaking up test cases that actually do two or more things.

Thunderbird Smoketest results

RC3 builds - tested 09/01

  • Linux - PASS
    • Tester: marcia
    • Build: 2006090109(rc3)
    • Result: in Litmus
  • Intel Mac - PASS
    • Tester: marcia
    • Build: 2006090109 (rc3)
    • Result: in Litmus
  • Windows - PASS
    • Tester: marcia
    • Build: 2006090109 (rc3)
    • Result: in Litmus

RC5 builds - tested 09/07

  • Linux - PASS
    • Tester: marcia
    • Build: version 1.5.0.7 (20060907)
    • Result: in Litmus
  • Intel Mac - PASS
    • Tester: marcia
    • Build: version 1.5.0.7 (20060907)
    • Talkback Build ID: 2006090710
    • Result: in Litmus
  • Windows - PASS
    • Tester: Tomcat
    • Build: 2006090710
    • Result: in Litmus

RC6 builds - tested 09/11

  • Linux - PASS
    • Tester: marcia
    • Talkback Build ID: 2006090918
    • Version: version 1.5.0.7 (20060909)
    • Result: in Litmus
  • Intel Mac - PASS
    • Tester: marcia
    • Talkback Build ID: 2006090918
    • Version: version 1.5.0.7 (20060909)
    • Result: in Litmus (run says PPC instead of Intel Mac by accident, test was run on Intel Mac not PPC)
  • Windows - PASS
    • Tester: Tomcat
    • Talkback Build ID: (2006090918)
    • Version: version 1.5.0.7 (20060909)
    • Result: in Litmus

Signing tests for RC6 build using Thawte Certificate

  • Windows PASS
  • Intel Mac - PASS
  • Linux - PASS

Testing of Digital Signatures

    • Tested install a Thawte certificate in Thunderbird 1.5.0.7 and sending a signed email - PASS on all three platforms.
    • Turns out the CA cert is a compatability issue

Issues Noted

From marcia:

  • Signing emails worked as expected on Windows - Tomcat sent me a message and it was signed.
  • On Mac and Linux, the CA Cert that I used was able to be sent but it comes across as broken.
  • On Linux, the Thawte cert that I used is sent but also comes across as broken on the receiving end.