QA/StaffMeetings/QA-Staff-10-12-2011: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 38: Line 38:
*** will be two tiered: automation and manual testing with various rich profiles
*** will be two tiered: automation and manual testing with various rich profiles
*** time-to-market should be roughly the same given that builds now come out Wednesday morning and some of this testing can be done in parallel (manual on betatest, automation on releasetest)
*** time-to-market should be roughly the same given that builds now come out Wednesday morning and some of this testing can be done in parallel (manual on betatest, automation on releasetest)
* q3 goals overview
* q3 goals overview [https://intranet.mozilla.org/QA/Q32011_QAgoals https://intranet.mozilla.org/QA/Q32011_QAgoals]
** team leads any take aways from Q3?
** team leads any take aways from Q3?
* q4 goals review
* q4 goals review [https://intranet.mozilla.org/QA/Q42011_QAgoals https://intranet.mozilla.org/QA/Q42011_QAgoals]
** matt added the top level org goals
** matt added the top level org goals
** add bhags to team goals (etherpad for each team)
** add bhags to team goals (etherpad for each team)

Revision as of 20:50, 12 October 2011

« previous mtg | QA Staff Home | next mtg »

QA Staff Meeting Notes Oct 12, 2011

Meeting Details

 # Every other Weds @ 1:30p Pacific Time - Mozilla HQ, Warp Core 
 #
 # Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=UK1zyrd7Vhym
 # Phone:  +1 650 903 0800 or 650-215-1282 x92 Conf# 95312 (US/INTL)
 #         +1 800 707 2533 (pin 369) Conf# 95312 (US Toll Free)
 #         +1 416 848 3114 x92 Conf# 95312 (Canada)
 # IRC:    irc://irc.mozilla.org:6697/#qa

QA Org Items

  • New Hires
    • John H, Mobile QA automatoin - Already here 4 weeks (say hi!)
    • John M, Sevices QA team - ETA 11/7
  • Upcoming Events
  • PTOs
    • [juanb]: Oct 13, 14; wedding in Seattle (my brother's).
    • tchung: oct 16-28, pto, hawaii.
    • Dave Hunt: Any day now, for 2 weeks.
    • Henrik Skupin: Oct 13, 14
    • Tracy: afternoon of 10/13 and all day 10/14
    • Cameron: Oct 20, 21

Discussion Items

  • overview of 7.0.1 postmortem - Anthony
    • general take-away:
      • QA needs to be more aggressive in helping to reproduce bugs, diagnose severity and prevalence
      • PM needs to be more aggressive in making sure issues are visible to QA
      • Update testing strategy cannot rely solely on automation
    • Updates strategy going forward -- see QA project page
      • will be two tiered: automation and manual testing with various rich profiles
      • time-to-market should be roughly the same given that builds now come out Wednesday morning and some of this testing can be done in parallel (manual on betatest, automation on releasetest)
  • q3 goals overview https://intranet.mozilla.org/QA/Q32011_QAgoals
    • team leads any take aways from Q3?
  • q4 goals review https://intranet.mozilla.org/QA/Q42011_QAgoals
    • matt added the top level org goals
    • add bhags to team goals (etherpad for each team)
  • scrumpads discussion
    • move to new system
    • overview of usage
  • pass down from directors meeting
  • Progress on Team Slides?
    • Would like these in advance of some of the upcoming events.
    • 2-3 Slides that show easy paths to contribute to your particular team area

QA Team Updates

Desktop Firefox (Juan, Anthony)

  • Firefox 8 (juanb): Testing in progress, to be released Friday morning.
  • Firefox 9 (ashughes): No status update
  • Firefox 10 (juanb): Heads up on probable compatibility issues due to two digit version. Web Compatibility test run in planning phase.
  • Crash Status and Investigation
  • Maintenance and Security ESR (Al)
    • No new updates at this time.
  • New Lab Operating Systems Available
    • Windows 8 Developer Preview
    • Windows 2000

Browser Technologies (Tony)

  • Issues
    • Native Fennec for Android project announced this week as a top Priority, starting Firefox 10. QA brainstorm here
    • The "503 meltdown of 2011" post mortem is scheduled 10/13
  • Fennec (Aaron/Kevin)
    • Performance Benchmark baseline to be established
    • Crash reporting for Fennec working with Socorro team
    • biweekly newsletter being sent out
    • Toronto Mobile Workweek next week
  • Sync (Tracy)
    • Sync fell over last week due to servers not being prepared for load increase of Instant Sync released in Fx7. Client was also not correctly respecting back-off requests from the server which made it difficult for OPs to repair the servers on the fly. Post-mortem scheduled for 10/13
    • Setup process has been somewhat simplified and Mobile devices can now initiate device pairing process before a sync account is even setup.
    • Mihaela from Softvision is getting up to speed with weekly client train cycles and is starting to take on some test case writing.
  • Test pilot (tracy)
    • Test Pilot for Mobile was released last week as was updated version for desktop
  • Sync Server (jbonacci)
    • Deployments have been delayed for a couple of weeks due to the sync/503 meltdown and other issues
    • Upcoming (planned) deployments:
      • Bug 693385 - deploy updated server-core (2.6.x) to syncstorage
      • server-node-assignment rpm-1.6-1
      • Something for Account Portal
      • Bug 686485 - roll out membase
  • BrowserID (jbonacci)
    • BrowserID has taken a giant step forward with the current Beta train: 10/06/2011
      • New functionality, certs support, IE9 support, and, of course, the new UI
    • BrowserID Test Day 1 is coming up this Friday, 10/14/2011
    • ==> QA NEEDS MODERATORS! ... https://etherpad.mozilla.org/testday-20111014 <==
  • Pancake (nhirata)
    • .17 Release
    • backend algorithm is being revamped
    • Places is being used

WebQA (Stephen)

  • AMO
    • AMO 6.2.6 went live 10/06
    • goals are set
    • working on paypal testing for marketplace
    • refactoring page objects for themes
  • Affiliates - on track to dark launch on 10.13.11
  • Input - Q4 bug triaging in-progress
  • Mozilla.com
    • working on 4.1 release
  • MDN
  • Socorro
    • 2.3 milestone shipped on 10.10.11
    • Softvision is very active on the project
  • SUMO
  • Mozillians

Community (Marcia)

  • Video Work
    • Revised nightly video has been completed and a bug has been filed to get it upon the Nightly First Run page.
  • QMO.next (Al):
    • Should be updating Buddypress to version 1.5 with an updated theme on Tuesday or Thursday next week, depending on Craig Cook's time.
    • We're pulling from Github to our new Dev server every 10 minutes automatically now, making testing changes easier.

QA Automation Service (Henrik, David)

  • General
  • Selenium
    • Selenium 2.8 has been released
  • Mozmill
    • Mozmill 1.5.5 has been released
    • Mozmill 2.0rc1 has been released
    • A-team has started work on Mozmill 2.1 (e10s support)

Project updates

  • Project pages for new projects have to be created and leads have to be assigned:
    • Fully automated Mozmill tests for releases
    • Prototype of Fennec driver
    • Community Documentation
    • CI system for daily and localized Firefox builds
    • Selenium Grid for Android and iOS
    • Long-term Goals for 2012
Case Conductor
  • Marching forward to get our staging instance up and running with IT. Keep working through platform and logistical issues as they come up.
  • Working toward the 0.6 milestone for the uTest Demo
  • Demo'd the product to the uTest designer they just hired.
  • Carl Meyer will visit Mt. View and be in-da-house Oct 17th & 18th.
  • Q4 goals done, but haven't yet gone over them with Matt.

Notes, Takeaways and Action Items

Today

Last Meeting

  • Action Items
    • draft of Q4 goals for teams by tuesday
    • draft of Q4 goals for individuals by end of week
    • add feedback to workweek for those that haven't commented yet
    • mevans: schedule of post mort
      • how to respond on emergency situation; checklist to be followed/consulted
    • marlenac to post as QMO event about E. Hendrickson's brown bag
    • all: overall presentation; each group does it's talk
    • Marlena/David : event planning for GTAC
    • Mevans : ask James Whittiker for brown bag
    • David C: Blog post about his unit test development framework
    • Juan : update tests for chemspill issue
Retrieved from "https://wiki.mozilla.org/index.php?title=QA/StaffMeetings/QA-Staff-10-12-2011&oldid=357709"