QA/Fennec/Waverley/2011-07-12
From MozillaWiki
Contents
Meeting Notes for <date/year>
Welcome
(eg. headcount, updates with staffing, vacation/away time)
Take Ways From Last Week
(eg. Action items from last weeks's Take Aways)
- Kevin to review waverley test cases
- [DONE] Anthony: needs to investigate features for Firefox 7
- Still need to work with Firefox team to improve communication -- Fx7 Flight Tracking page was not updated until day before merge -- this will be an area of "continuous improvement"
- I'll update the overall testplan every Wednesday, following the Platform and Firefox meetings, with feature status' conveyed from those meetings
- If you've already signed up to own a feature for Fx7, please be in touch with your feature developer and project manager on at least a weekly basis to get a status update
Round Table
- Noting more goodness in FF 6 test documentation (matt)
- Panorama_Groups_On_Demand
- Bug 595601 George
- Excellent comment for bug verification!
- Bug 595601 George
- Panorama_Groups_On_Demand
- FF 6 Feature verfication (matt)
- If feature wasn't verified on all platforms, please do so.
- For example: RevampAboutMemory
- Don't forget to check if there are one-off bug landings in beta and aurora. If you happen to see bug comments with checkins on those branches, please verify the fixes on the beta and aurora branches by using keywords verified-beta, verified-aurora (tchung)
- If feature wasn't verified on all platforms, please do so.
- Daily Stand-up (ashughes)
- Started last Friday doing a daily stand-up with Waverley via the Firefox and Automation etherpads -- it's just a top-level section
- Waverley reports issues, blockers, and questions
- Mozilla reports tasks to be completed and answers those issues, blockers and questions
- Not doing physical 1:1 yet -- will start if/when needed -- etherpad section seems to be working well so far
- Started last Friday doing a daily stand-up with Waverley via the Firefox and Automation etherpads -- it's just a top-level section
Firefox Updates
(eg. Status, top issues)
- Mozilla (juanb, ashughes)
- Fx 6(beta1) desktop and mobile, 7(aurora), 3.6.19/5.0.1 released: Great work!
- Fx 6(beta2): TBD this week.
- Waverley (Andrei, George, Simona, Vlad G)
- Dev Tools meeting minutes
- Test plan
- Firefox 3.6.19
- BFTs on Mac OS X 10.7 - Wiki-page
- Firefox 5.0.1
- Firefox 6.0 Beta
- Firefox 7.0 Aurora
- Firefox 5 spot-checking on Mac OS X 10.7 - Etherpad
- Fixed bug verification across platforms - Spreadsheet
- Logged issues - Bugzilla query
- Bug triage - Spreadsheet
- Updated testcases in Litmus Spreadsheet
- Firefox 3.6.19
- Project tracking
- Watch QA assigned Features Spreadhsheet
- Reviewed commented bugs
- Questions
- Should fixed bugs verification be done on Core and Toolkit products, besides Firefox?
- Should we focus on Ubuntu 10.10 or Ubuntu 11.04? (automation tests are run under Ubuntu 11.04)
- Once Mac OS X 10.7 is launched does it have a higher priority than Mac OS X 10.6?
Automation Updates
(eg. Status, top issues)
- WebQA (Selenium)
- Waverly (Teodosia, Florin)
- Moved tasks from AMO Spreadsheet to Pivotal Tracker
- Writing new tests for AMO
- Modifying test accordingly to the code review
- Mozilla
- Desktop (Mozmill)
- Waverley (Alex, Vlad)
- ASSIGNED bug list
- RESOLVED bug list
- Current tasks
- Refactor/fix tests as needed
- Creating restart tests for AOM (P1) mozmill spreadsheet
- Issues so far
- Lack of API for places makes those tests very low priority for now
- Add-on compatibility issues force us to skip some tests for aurora and default branch (will need manual testing for those branches unless we come up with compatible add-ons in the Discovery Pane sections)
- Questions
- What is to be done with litmus tests which cannot be 100% covered by mozmill? Should we take those and do what it can be done or leave them by to decide later? What about reporting these kind of situations?
- ANSWER: Deal with these on a case by case basis by calling them out in the daily standup section of the Etherpad -- Anthony will make the decision on each case
- What about API change/updates requests? Should we modify shared modules locally and upload along with patches? Or: file a bug, change the API, wait for that to land then upload test? We have done both sides so far. Finally, should we request Anthony or Henrik for the API changes?
- ANSWER: If it's a small couple line change to an existing API method, include it with your test patch. If it's a new method file a bug for Henrik, CC me, mark it blocking your test, and make a note of it in the daily stand-up section of the etherpad
- Mozilla (ashughes)
- We now have 8 P1 Add-ons Manager BFTs to automate -- focus on those once you have finished up any open Discovery Pane and Places tests
- I'll work with Dave Hunt this week to identify Endurance tests -- would like to see Vlad and Alex contribute 2 tests each
Fennec Updates
(eg. Status, top issues)
- Mozilla (kbrosnan)
- Beta 1 Shipped Friday
- there is a special beta 1 build from release engineering
- Beta 2 this week (we think)
- AAronMT will be the lead on Firefox 7
- kbrosnan will be the lead on Firefox 8
- Waverley (Ioana, Anna, Andreea, Nicolae)
- Weekly Status:
- run BFTs, OS integration tests and daily smoke tests on all new devices (LG Optimus 2X P990, HTC Desire Z, Google Nexus S, Motorola Droid 2) daily results ; archive . Builds tested as follows: Smoketests on Aurora (weekly) on Nightly (daily), BFTs and OS Integration Tests on Nightly and BFTs on Aurora.
- bug validation daily results ; archive ; Commented bugs;
- bug triage state of triaged bugs
- run performance tests (all) against daily builds with the add-on (daily on aurora and nightly)(result are on server)
- updated 6.0 tests in Litmus and other changed ones changes made here
- Beta 6.0b1 Results: here
- Smoketests on Android and Maemo for Beta 1 Special. Results: here
- Logged issues
- Important bugs:
- Questions / Issues:
- We could not install Fennec 6.0 Beta 1 special on Gingerbread
- A new option was added to favicon menu: Install as App. Is this a new feature? Could you tell us more about it please?
- Weekly Status:
Take Aways This Week
(eg. Action items)
- Anthony to update Fx7 bug queries for bug verifications
- Reminder: verify bugs across all platforms they apply to.