QA/Fennec/Waverley/2012-04-10

Meeting Notes for <04-10/2012>

Tuesdays, 8am PT / 4pm GMT
Backchannel: irc.mozilla.org #qa
Dial in: 800-707-2533
Password 369, conference #245

Welcome

(eg. headcount, updates with staffing, vacation/away time)

• ashughes: in Ontario, Canada for 11 days starting Friday
  • PTO: Apr 13, 19, 23
  • WFH: Apr 16, 17, 18, 20
• Reminder - Monday, April 16 is a national holiday in Romania; all SoftVision teams will be out of office
• Florin Strugariu: PTO - 12, 13

Take Ways From Last Week

(eg. Action items from last weeks's Take Aways)

Firefox Updates

(eg. Status, top issues)

• Mozilla (juanb, ashughes)
  • Firefox 12.0b4 shipped last week, Firefox 12.0b5 on schedule to ship this Friday
  • 10.0.4esr will go to beta next week (same time as 12.0b6)
  • Still working on finalizing Q2 goals -- should have a nearly final draft done by this week
  • Mozmill daily testruns are now automatically triggered through Jenkins via Pulse
    • use Mozmill CI Dashboard to triage results (functional and endurance)
    • we'll also be migrating to this for release automation in the near future
• SoftVision (Paul, Ioana, Mihaela, Virgil, Simona, VladG)
  • Firefox 12 Beta 3 Test Plan
    • Smoke tests across platforms Link
    • Focused tests Link
    • Fixed bugs verification Spreadsheet
    • Feature ownership
      • Media Controls Refresh - Mihaela - signed off on Beta
      • Silent Update OS Dialogs - Simona - signed off on Beta
  • Firefox 12 Beta 4 Test Plan
    • Smoke tests across platforms Link
    • Focused tests Link
    • Fixed bugs verification Spreadsheet
    • Feature ownership
      • Media Controls Refresh - Mihaela - signed off on Beta
      • Silent Update OS Dialogs - Simona - signed off on Beta
  • Firefox 13
    • Feature ownership
      • New Tab Page - Virgil - ran test cases on all platforms
      • Clean up user profile - Ioana - updated test plan
      • Incremental Garbage Colector - Ioana - exploratory testing, created additional test cases
      • SPDY - Ioana - no updates
      • Mandatory ASLR on Windows for binary components - Virgil - exploratory testing
      • Home Tab - VladG - created test plan and test cases
      • URL Autocomplete - VladG - created test plan and test cases
      • Hang Detector and Reporter - Simona - updated test plan, created test cases and exploratory testing
      • Enable Smooth Scrolling - Mihaela - created additional test cases, exploratory testing
      • Automatic Session Restore with Tabs on Demand - Mihaela - created additional test cases, exploratory testing
  • Firefox 14
    • Unconfirmed bugs triage Spreadsheet
    • Chrome Leak testing Test Plan
    • Endurance results monitoring
    • Ran Smoke Tests on Mac OSs using the mozilla central try builds
  • Feature - Silent Update Link
    • Removal of OS security dialog for Windows Link - Simona
      • Status: Health ok. signed off on Beta
    • Background updates Link - VladG
      • Status: Health ok. No updates
    • Workflow with Incompatible Add-ons Link - Ioana
      • Status: No updates

Automation Updates

(eg. Status, top issues)

WebQA (Selenium)

• SoftVision (Teodosia, Florin, Alin)
  • AMO retrospective Q1 meeting
  • migration of Socorro to WebDriver is done - link to Git repo
    • started refactoring Socorro code - tasks from PV
  • helping with the migration of Mcom to WebDriver - link to Git repo
  • write new tests (ongoing)
  • code review (ongoing)
  • merges (ongoing)
  • refactor tests (ongoing)
  • investigate/fix failing tests (ongoing)
• Mozilla (Marlena)
  • reviewing the install test from Vlad

Desktop (Mozmill)

• SoftVision (Alex, Vlad, Remus)

Highlights

• • Test development is still on hold except remote tests for webqa
  • Waiting to set Q2 goals
  • Working fwd on the same P1 jobs
    • fix failing tests
    • refactoring
• Mozilla (Anthony)
  • Still working to finalize Q2 goals -- continue to focus on failures and refactoring in the meantime

WebQA Manual Updates

(eg. Status, top issues)

• SoftVision (Cristi, Victor)

• Mozilla
  • Exploratory testing on AMO and Marketplace
  • Release testing for addons-dev.allizom.org and marketplace-dev.allizom.org in Litmus
  • Sanity testing on AMO and Marketplace
  • Verify fixed bugs
  • Verified login flow without Browser ID in AMO-dev on Win 7 and Firefox 11
  • Created test cases for Marketplace Consumer pages
  • Created Marketplace Smoke Testrun in Litmus https://litmus.mozilla.org/run_tests.cgi?test_run_id=449 and added test cases for Consumer pages and Dev hub.
  • Updated test cases for AMO and Marketplace
  • Verified the new promo module on Discovery pane on AMO-dev in Firefox 11 and Win 7

Fennec Updates

(eg. Status, top issues)

• Mozilla (test lead)

• SoftVision (Ioana, Andreea, Catalin, Adrian, Nicolae, Paul)
  • run BFTs and daily smoke tests on following devices ( Galaxy Tab, LG Optimus 2X P990, HTC Desire Z, Google Nexus S, Motorola Droid 2, Motorola Droid Pro, Samsung Galaxy SII) daily results ; archive .
  • bug validation - commented bugs;
  • bug triage - commented bugs
  • Logged issues
  • watch assigned features - spreadsheet
  • BFTs and exploratory - Nightly 14.0a1
  • bug verification on Firefox 13.0a1&Firefox 14.0a1
  • in-litmus TCs and update TCs for Test Run 13
  • Beta 12.0b4
  • test run for Fennec 14 added in litmus: phone and tablet
  • qawanted bugs
  • A|B Compositor Testing

• Important bugs:
  • bug 739584 - Loading http://www.kevs3d.co.uk/dev/ will freeze and shut down the device
  • bug 741319 - Adreno200-EGL: eglLockWindowSurface: failed to map the memory
  • bug 732794 - Empty bookmarks tab on awesomescreen
  • bug 742399 - crash [@ libflashplayer.so@0x55b14a ]
  • bug 743662 - Session is not restored when Firefox is restarted by an addon install/uninstall
  • bug 743223 - Undismissed doorhagers appear after loading a page which opens a new doorhanger
  • bug 742267 - URL content is cleared when entering a new character from the hardware keyboard

• Issues/Questions/ Proposals

BrowserID Updates

(eg. Status, top issues)

• SoftVision (Ioana Budnar)
  • Regression testing on train-2012.03.28 - Ubuntu 11.10 + Firefox 12.0 beta
    • Sanity/Acceptance/Smoke testing;
    • Basic Functional - Accounts and Email Verification testing;
    • Support For Primaries testing;
    • Specific RP/Client Functional - http://beta.myfavoritebeer.org;
    • UI testing.
    • Reopened bug 567.
    • Logged bugs: 1398, 1404.
• Mozilla (Tony)

Take Aways This Week

• Everyone play around with MozTrap and submit feedback so that we can discuss and escalate to Cam
• Mozilla QA to share their Q2 goals with their SV team