QA/StaffMeetings/QA-Staff-02-29-2012: Difference between revisions
< QA | StaffMeetings
Jump to navigation
Jump to search
| (26 intermediate revisions by 14 users not shown) | |||
| Line 16: | Line 16: | ||
** item | ** item | ||
* Community Members Onboarding | * Community Members Onboarding | ||
** | ** Mohamed (past intern) back doing more work for apps qa | ||
* Upcoming Events | * Upcoming Events | ||
** item | ** item | ||
* PTOs | * PTOs | ||
**marcia 3/1-3/2 | **marcia 3/1-3/2 | ||
** juanb 3/26 - 4/6 (two weeks) | |||
== QA Team Updates == | == QA Team Updates == | ||
| Line 46: | Line 47: | ||
* What happened this week? | * What happened this week? | ||
** | ** Finalized top apps quality analysis to determine what apps to demo (jsmith) | ||
*** MWC apps selected is [https://mana.mozilla.org/wiki/download/attachments/6390638/Overall+and+MWC+Top+Apps.xls?version=1&modificationDate=1330483485208 here] | |||
*** Quality analysis is [https://mana.mozilla.org/wiki/download/attachments/18973947/MWCDemoAppAnalysis.doc?version=2&modificationDate=1330548655956 here] | |||
*** Tagged Soup release 0.4 with MWC blockers all fixed | |||
** Supported MWC demo team as needed (e.g. IT Support document, answer questions, top apps screenshots) (jsmith + tchung) | |||
* Myapps staging server | |||
** Deployed Myapps rpm, Appsync rpm | |||
** DNS changes were approved and put in place | |||
* MochiTest WebApps | |||
** (Worked with Geo) to setup an initial dummy test | |||
** Created a blog post to advertise how it was done, as well as serve as a guide as to how to write more | |||
*** http://onecyrenus.wordpress.com/2012/02/28/github-webapps-mochitest-repo/ | |||
* What's next? | * What's next? | ||
** | ** Verify that we can test the myapps staging service using the extension, firefox, chrome..etc. | ||
** Post-MWC cleanup (e.g. make sure bugs are all logged, documentation updated for test cases, apps strategy on-going) (jsmith) | |||
** Web compatibility discussion and analysis (fennec + apps) | |||
** Manual test run to check quality state of desktop app experience (jsmith) | |||
** MWC QA Retrospective (jsmith + marlena) | |||
=== Browser Technologies (Tony) === | === Browser Technologies (Tony) === | ||
| Line 54: | Line 71: | ||
** | ** | ||
*Fennec (Kevin/Aaron) | *Fennec (Kevin/Aaron) | ||
** | ** Doing daily triage and bug noms against this [https://mozqa.etherpad.mozilla.org/qa-bug-triage list] (from Mobile/Triage page) | ||
*** M: 9am PST, W,F: 7am PST, T,Th: 1pm PST | |||
** [https://etherpad.mozilla.org/mobile-automation Discussion] on breaking out automated fennec smoketests in robocop | |||
*** Tests will be organized [https://docs.google.com/spreadsheet/ccc?key=0AhE7m4JB2j6tdDJBT2dlbVJwUk9PSy1RbHo4WVNiUGc here] | |||
** Daily testing on Maple and Nightly builds | |||
** Stability (nhirata) | ** Stability (nhirata) | ||
***[https://wiki.mozilla.org/Platform/2012-02-28#Mobile_2 Crash Report] and [https://wiki.mozilla.org/index.php?title=Mobile/Testing/02_29_12 Soccorro work] for 2/29/2012 | |||
*Sync (Tracy) | *Sync (Tracy) | ||
** | ** Sign off on a small desktop train last week | ||
** tested around Android Sync bookmarks improvements | |||
*** nightly user found {{bug|731024}} | |||
** blogging about sync QA to commence this week (I've never been a good writer, so I'm just a leettle ascared to start) | |||
*Test pilot (tracy) | *Test pilot (tracy) | ||
** | ** nothing to report this week | ||
*Sync Server (jbonacci/jrgm) | *Sync Server (jbonacci/jrgm) | ||
** | ** security review of tokenserver | ||
*BrowserID (jbonacci/jrgm) | *BrowserID (jbonacci/jrgm) | ||
** | ** browserid train-2012.02.16 going to production today (02/29) | ||
*Pancake (nhirata) | *Pancake (nhirata) | ||
** | ** Need to work on cleaning up the bug database and catching up | ||
*B2G/WebAPIs (jhammink) | |||
**MWC workweek was a success! | |||
**doing tri-weekly test pass against latest b2G gonk gaia. Test Spec and Test Log is here: http://shrt.st/2dck | |||
**also triaging bugs for gonk/gaia | |||
**redoing test plan against M2.1 Target: https://wiki.mozilla.org/Gaia/Planning/2.1#Projects | |||
**also looking into automation plan; some scripts ready for mozSMS, mozTelephony - still needing edge case work | |||
**adding one more build machine to support new targets (Maguro/Akami) | |||
=== WebQA (Stephen) === | === WebQA (Stephen) === | ||
| Line 74: | Line 106: | ||
** We shipped marketplace.mozilla.org yesterday. | ** We shipped marketplace.mozilla.org yesterday. | ||
** AMO [http://cl.ly/3w083Q2Y433k2C3k0D39 6.4.4] is scheduled to go out tomorrow (03/01). | ** AMO [http://cl.ly/3w083Q2Y433k2C3k0D39 6.4.4] is scheduled to go out tomorrow (03/01). | ||
** We've got mobile tests | |||
** Merged another contributor test | |||
** Thanks to Automation Services for their help this week! | |||
* Engagement Projects | * Engagement Projects | ||
** | ** Likely shipping [https://firefoxflicks.allizom.orgFirefox Flicks] today | ||
* | ** DTPT phase II on hold for security review | ||
** Betafarm is now in process | |||
* | |||
** | |||
* Mozilla.com | * Mozilla.com | ||
** | ** shipped 1.8 milestone | ||
*Mozillians | *Mozillians | ||
**Feature testing is currently blocked by [[bug 731206]] | **Feature testing is currently blocked by [[bug 731206]] | ||
**We have 2 new contributors on the project. One WebDev and one QA. | **We have 2 new contributors on the project. One WebDev and one QA. | ||
* MDN | * MDN | ||
** | ** shipped 2.3 milestone | ||
*Socorro | *Socorro | ||
** [https://bugzilla.mozilla.org/buglist.cgi?cmdtype=runnamed;namedcmd=socorro-2.4.4;list_id=2495938 2.4.4 milestone] successfully released today | ** [https://bugzilla.mozilla.org/buglist.cgi?cmdtype=runnamed;namedcmd=socorro-2.4.4;list_id=2495938 2.4.4 milestone] successfully released today | ||
** May do an out of band release to land ESR support | ** May do an out of band release to land ESR support | ||
* SUMO | * SUMO | ||
** | **[http://moxie.jamessocol.com/bugstats/sumo/2012-02-28 2/28] release went out | ||
** [http://moxie.jamessocol.com/bugstats/sumo/2012-03-06 3/6] in process | |||
=== Community (Marcia) === | === Community (Marcia) === | ||
| Line 111: | Line 145: | ||
=== QA Automation Service (Henrik, David) === | === QA Automation Service (Henrik, David) === | ||
==== General ==== | ==== General ==== | ||
* | * Helped BrowserID get up and running with a [http://travis-ci.org/#!/mozilla/browserid CI] | ||
====Project updates==== | ====Project updates==== | ||
===== On-Demand Test Framework (Geo) ===== | ===== On-Demand Test Framework (Geo) ===== | ||
* | * Updating deployment documentation for Windows slaves | ||
* Modifying job creation scripts to accurately replace previously created jobs | |||
===== Mozmill 2.0 Automation Scripts Update (Henrik) ===== | ===== Mozmill 2.0 Automation Scripts Update (Henrik) ===== | ||
| Line 131: | Line 166: | ||
* Repository has been moved to https://github.com/mozilla/memchaser | * Repository has been moved to https://github.com/mozilla/memchaser | ||
* Working excessively on getting version 0.2 released with incremental GC support - hopefully we can upload the version on AMO later today | * Working excessively on getting version 0.2 released with incremental GC support - hopefully we can upload the version on AMO later today | ||
* [http://travis-ci.org/#!/mozilla/memchaster CI Setup] is done and runs on every commit | |||
===== Open Positions (DavidB) ===== | ===== Open Positions (DavidB) ===== | ||
| Line 136: | Line 172: | ||
===== Weekly Blog Posts ===== | ===== Weekly Blog Posts ===== | ||
* | * [http://www.theautomatedtester.co.uk/blog/2012/automation-services-week-13-17-feburary.html 13 - 17 February] | ||
===== [https://wiki.mozilla.org/QA/TCM Case Conductor] ===== | ===== [https://wiki.mozilla.org/QA/TCM Case Conductor] ===== | ||
* | * Still working with IT on getting 0.8 deployed to staging. | ||
** Haven't heard from them in a couple days, so I bumped the priority to Critical and pinged mrz and solarce (the IT guy assigned) | |||
* Requested the infrrasec review | |||
* Working with Ubuntu on their evaluation | |||
* Stephend and I to start getting Jenkins setup to run tests once staging -dev server is setup. | |||
* 1.0 still slated for 3/30 | |||
== Roundtable/Discussion Items == | == Roundtable/Discussion Items == | ||
Latest revision as of 21:37, 29 February 2012
« previous mtg | QA Staff Home | next mtg »
QA Staff Meeting Notes February 29, 2012
Meeting Details
# Every Weds @ 1:30p Pacific Time - Mozilla HQ, Warp Core # # Vidyo: https://v.mozilla.com/flex.html?roomdirect.html&key=UK1zyrd7Vhym # Phone: +1 650 903 0800 or 650-215-1282 x92 Conf# 95312 (US/INTL) # +1 800 707 2533 (pin 369) Conf# 95312 (US Toll Free) # +1 416 848 3114 x92 Conf# 95312 (Canada) # IRC: irc://irc.mozilla.org:6697/#qa
QA Org Items
- New Hires & Interviews
- item
- Community Members Onboarding
- Mohamed (past intern) back doing more work for apps qa
- Upcoming Events
- item
- PTOs
- marcia 3/1-3/2
- juanb 3/26 - 4/6 (two weeks)
QA Team Updates
Desktop Firefox (Juan)
- Fx.Next
- 11.0b5 available for testing (test plan), targeting release on Friday
- 11.0b6 go to build Monday, targeting release on Wednesday
- 3.6.13 -> 10.0.2 live yesterday, targeting major updates for straggler releases (3.6.* and Betas)
- Windows 2000 support dropped for Nightly as of today (bug 699247)
- Feedback of "slowness" have increased by ~50% between Firefox 10 and 11
- Please run the Beta as your daily build and report any noticeable slowness to Juan, Anthony, and Cheng
- We are trying to reach out to anyone who can reproduce any "slow" condition
- There's a thread on r-d titled "Re: Slowness reports on beta, what to do"
- Firefox ESR (ashughes)
- 10.0.3 go to build Friday (based on Firefox 11)
- Crash Investigation
- Stability Report for this week
- Early version of Stability Dashboard
- Looking at tracking bugs for Firefox 11: Tracking 11
- Automation
- Vlad and Alex now have commit access, will hopefully accelerate our landing performance
Apps Desktop and Mobile (DavidC)
- What happened this week?
- Myapps staging server
- Deployed Myapps rpm, Appsync rpm
- DNS changes were approved and put in place
- MochiTest WebApps
- (Worked with Geo) to setup an initial dummy test
- Created a blog post to advertise how it was done, as well as serve as a guide as to how to write more
- What's next?
- Verify that we can test the myapps staging service using the extension, firefox, chrome..etc.
- Post-MWC cleanup (e.g. make sure bugs are all logged, documentation updated for test cases, apps strategy on-going) (jsmith)
- Web compatibility discussion and analysis (fennec + apps)
- Manual test run to check quality state of desktop app experience (jsmith)
- MWC QA Retrospective (jsmith + marlena)
Browser Technologies (Tony)
- Issues
- Fennec (Kevin/Aaron)
- Doing daily triage and bug noms against this list (from Mobile/Triage page)
- M: 9am PST, W,F: 7am PST, T,Th: 1pm PST
- Discussion on breaking out automated fennec smoketests in robocop
- Tests will be organized here
- Daily testing on Maple and Nightly builds
- Stability (nhirata)
- Crash Report and Soccorro work for 2/29/2012
- Doing daily triage and bug noms against this list (from Mobile/Triage page)
- Sync (Tracy)
- Sign off on a small desktop train last week
- tested around Android Sync bookmarks improvements
- nightly user found bug 731024
- blogging about sync QA to commence this week (I've never been a good writer, so I'm just a leettle ascared to start)
- Test pilot (tracy)
- nothing to report this week
- Sync Server (jbonacci/jrgm)
- security review of tokenserver
- BrowserID (jbonacci/jrgm)
- browserid train-2012.02.16 going to production today (02/29)
- Pancake (nhirata)
- Need to work on cleaning up the bug database and catching up
- B2G/WebAPIs (jhammink)
- MWC workweek was a success!
- doing tri-weekly test pass against latest b2G gonk gaia. Test Spec and Test Log is here: http://shrt.st/2dck
- also triaging bugs for gonk/gaia
- redoing test plan against M2.1 Target: https://wiki.mozilla.org/Gaia/Planning/2.1#Projects
- also looking into automation plan; some scripts ready for mozSMS, mozTelephony - still needing edge case work
- adding one more build machine to support new targets (Maguro/Akami)
WebQA (Stephen)
- Affiliates
- Successful 2.22.12 release
- no release this week - Flux team is having a workweek
- AMO
- We shipped marketplace.mozilla.org yesterday.
- AMO 6.4.4 is scheduled to go out tomorrow (03/01).
- We've got mobile tests
- Merged another contributor test
- Thanks to Automation Services for their help this week!
- Engagement Projects
- Likely shipping Flicks today
- DTPT phase II on hold for security review
- Betafarm is now in process
- Mozilla.com
- shipped 1.8 milestone
- Mozillians
- Feature testing is currently blocked by bug 731206
- We have 2 new contributors on the project. One WebDev and one QA.
- MDN
- shipped 2.3 milestone
- Socorro
- 2.4.4 milestone successfully released today
- May do an out of band release to land ESR support
- SUMO
Community (Marcia)
- Events
- Tech Talk at Brown University last week went well
- Haven't heard response back yet re: MozCamp Latin America
- Results of Dave Hunt's WebQA live testday
- Selenium Meetup tonight: http://www.meetup.com/seleniumsanfrancisco/events/51852312/
- Upcoming Testdays/BugDays/Meetups
- Video Work
- Planned work on new nightly first page video will resume next week
- QMO.next (Raymond):
QA Automation Service (Henrik, David)
General
- Helped BrowserID get up and running with a CI
Project updates
On-Demand Test Framework (Geo)
- Updating deployment documentation for Windows slaves
- Modifying job creation scripts to accurately replace previously created jobs
Mozmill 2.0 Automation Scripts Update (Henrik)
- David Guo is investigating if a smooth upgrade of our scripts to Mozmill 2.0 is possible
- If it turns out end of this week it's not possible, we will start from scratch
CI system for daily and l10n Firefox Builds (Henrik)
- Added mozilla-esr10 builds to test matrix
- Fixed some smaller bugs
Mozmill Dashboard Validation (DavidB)
- No update
MemChaser extension (Henrik)
- Repository has been moved to https://github.com/mozilla/memchaser
- Working excessively on getting version 0.2 released with incremental GC support - hopefully we can upload the version on AMO later today
- CI Setup is done and runs on every commit
Open Positions (DavidB)
- No update
Weekly Blog Posts
Case Conductor
- Still working with IT on getting 0.8 deployed to staging.
- Haven't heard from them in a couple days, so I bumped the priority to Critical and pinged mrz and solarce (the IT guy assigned)
- Requested the infrrasec review
- Working with Ubuntu on their evaluation
- Stephend and I to start getting Jenkins setup to run tests once staging -dev server is setup.
- 1.0 still slated for 3/30
Roundtable/Discussion Items
- item
Notes, Takeaways and Action Items
Today
- Add notes here
Last Meeting
- Action Items