QA/Fennec

Home of those who want to Propel Fennec Quality!

Milestones

• Current - 1.0 Maemo: Testplan

Planning

• 2010

What We Do

Testing Strategy

• Manual
  • Daily Verifications of resolved bugs on the latest nightly build
    • Run through the BFT(s) that are affect by resolved bugs
    • Perform exploratory testing of those features
  • Weekly Smoketesting
  • Bi-Quarterly Testdays
  • List of webpages to test on Mobile Firefox

• Automation
  • Unittests on Fennec
    • Mochitests on Fennec
    • Reftests on Fennec

Release Testing

• QA Requirements:
  • E-mail to Drivers pre/post-Release Cycle and pre/post-Respin
    • Includes:
      • Build location link
      • Blocker Bugs added to the newest release build
      • Release cycle schedule
      • Dev Contact available on-hand

• Template for results tracking page
• Updates Testing
  • HowTo:Maemo
  • HowTo:WinMo

Release	Smoketest	BFT	Blocker Verifications	L10n	Website	Updates
Early-Stage Betas	YES	NO	YES	1 RTL, 1 non-Latin, 1 Multi-L10n Switch	NO	YES
Late-Stage Betas (3+)	YES	YES	YES	1 RTL, 1 non-Latin, Full Multi-L10n Switch	NO	YES
Major Releases	YES	YES	YES	2 RTL, 2 non-Latin, Full Multi-L10n Switch	YES	YES

Where You Can Contact Us

• Forums
  • http://www.nokia-n900.org/
  • http://www.forum.nokia.com/
• Mailing Lists
  • mobile@mozilla.com
• Newsgroups
  • mozilla.dev.platforms.mobile
  • mozilla.dev.quality

What We Use

Tools

• QA Companion: Currently allows users to painlessly report bugs if they don't have a desktop on hand.
• Manual Testing:
  • Litmus Fennec 1.0 Test Run
  • Litmus Fennec 1.0 Localizer Test Run
• Performance

Resources

• Fennec HG Repository
• Fennec MXR Source Code Web-Based Viewer
• Builds
  • Trunk Nightly Builds
  • Hourly Tinderbox Builds
  • Fennec L10n Dashboard

Where Do We Need Help

Test Tool Development

• Write automated testcases
• Port Automation Frameworks to WinCE
• Find, Fix, Verify UnitTest Failures

Execution

• Triage Unconfirmed Fennec Bugs
• Create Litmus testcases for bugs flagged as in-litmus?
• TestDay Promotions within Mobile Community Channels
• Write technical documentation to perform quality execution