Meeting Notes for 2011-07-26

Welcome

• juanb: Vacation Aug 5-23; ashughes to cover for me.

Take Ways From Last Week

• Workweek automation next week - Automation
  • Meeting to has out objectives.
• Visit to Romania the week after.
• Answers to desktop questions:
  • Yes, you can reduce the overhead in wiki work by not using separate wikis for manual results. The important thing is to keep notes of major issues found, if any.
  • We'll look into issues when cloning testruns because some updated tests don't make the migration and they end up being broken as they are cloned. - juanb to look into it
  • Yes, you can set your own keywords (in the Whiteboard field) so you can keep track of features for bug queries.
  • Waverley still has no access to a repository to create and link artifacts to it. - juanb to send out forms to be filled out for HG access.
  • The bug queries in the Etherpad are useful to glance at the types of issues found, which have been many. Unfortunately, I've noticed that the bugs don't get traction because their severity doesn't make it obvious that they should be top priority in most cases, but I have no answers to the latter point for now. - juanb
• Answers to Fennec questions:
  • There are no special tasks that need to be addressed while the workweek is ongoing. Participation in the Etherpad by the Waverley team is not required at the moment. - Kevin
  • For now there isn't an update on the builds that will be available for tablets, and for now use the same Litmus test runs for it as for mobile. - Kevin

Round Table

• QA Automation Services workweek update
  • agenda & notes
  • http://mozqa.sync.in/55 etherpad to add thoughts, suggestions and issues

Firefox Updates

• Mozilla (test lead): Fx6b3 out. Expect b4 builds this week.
• Waverley (Andrei, George, Simona, Vlad G)
  • DevTools Meeting
  • Test plan
    • Firefox 6.0 Beta 3
      • Smoketests - Wiki-page
      • BFTs on WinXP - Wiki-page
      • Fixed Bug verification from pushlog - Spreahsheet
    • Fixed bug verification across platforms - Spreadsheet
    • Logged issues - Bugzilla query
    • Bug triage - Spreadsheet
    • Updated testcases in Litmus - Spreadsheet
  • Project tracking
    • Watch QA assigned Features - Spreadhsheet
    • Assigned new features
    • Reviewed commented bugs

Automation Updates

WebQA (Selenium)

• Waverley (Teodosia, Florin)
  • Implementing tests for AMO
  • Code reviewing
  • Merging pull requests
  • Having daily stand-up meeting on the irc
• Mozilla
  • With help from Dave Hunt came up with short term solution for a/b testing (still pondering long term)

Desktop (Mozmill)

• Waverley (Vlad, Alex)
  • ASSIGNED BUGS
  • RESOLVED BUGS
  • WONTFIX BUGS
  • P1 add-ons manager tests - 7/8 assigned - 4 have patches ready
  • We decided to have our own add-ons and themes to test on so this will block a little the P1 tests until these came in. We currently have a theme ready for review. Henrik will try to check in some more add-ons in the litmus data repo soon enough.
  • Ramp up with endurance tests
  • Fix code revisions and API changes as necessary
  • Questions
    • Is there a best practices document for endurance tests? If not, we'll just figure them out within the review process
• Mozilla

Fennec Updates

• Mozilla (test lead)
  • On Verifying fixed bugs: Please add more details on what tests you are running in the bug comments (tchung)
  • On Flagging tests for litmus: When verifying bugs, if you see patches that could use a litmus test, please set the flag "in-litmus=?", and create a testcase in the litmus testsuite for that bug. Follow up by +'ing the flag and comment the url of the testcase afterwards (tchung)
  • Please continue to raise severity by prioritizing issues in bugs occurring in Aurora and flag them if necessary (tracking-fennec: ?) (AaronMT)
  • Reminder to pick up variety of features for Milestone 8.0 and create test-plans and test-cases in Litmus, and solidify Milestone 7.0 (AaronMT)
    • Use https://wiki.mozilla.org/Mobile/Triage for querying aid (AaronMT)

• Waverley (Ioana, Anna, Andreea, Nicolae)
  • Weekly Status:
    • run BFTs, OS integration tests and daily smoke tests on all new devices (Tablet Acer 500 Iconia, LG Optimus 2X P990, HTC Desire Z, Google Nexus S, Motorola Droid 2) daily results ; archive . Builds tested as follows: Smoketests on Aurora (weekly) on Nightly (daily), BFTs and OS Integration Tests on Nightly and BFTs on Aurora.
    • bug validation daily results ; Commented bugs;
    • bug triage state of triaged bugs
    • run performance tests (all) against daily builds with the add-on (daily on aurora and nightly)(result are on server)
    • Beta 6.0b3 Results: here
    • Logged issues
  • Important bugs:
    • bug 672787 - Aurora build crashes [@ _moz_pixman_image_composite32] at start-up (07/20)
    • bug 672762 - The application Nightly (process org.mozilla.fennec" has stopped unexpectedly at update 07/20
    • bug 672779 - Fennec not re-sized correctly after switching between portrait/landscape mode on mobile webpages
    • bug 673910 - Suggestion popup is overlapped by a thumbnail/small graphic area when left sidebar is dismissed
    • bug 673926 - Tag field not visible using some third party keyboards
  • Questions / Issues:
    • we saw AaronMTs mail and we'll work on it asap (test plans, assignments,etc )

Take Aways This Week

There were a couple of things, but I forgot to write them down. Endurance test guideline perhaps.