QA/StaffMeetings/QA-Staff-04-11-2012: Difference between revisions

 
(44 intermediate revisions by 13 users not shown)
Line 14: Line 14:
== QA Org Items ==
== QA Org Items ==
* New Hires & Interviews
* New Hires & Interviews
** item
** Working on it (jbonacci)
** Promoted BugMaster position on QMO Facebook page and Twitter
* Community Members Onboarding
* Community Members Onboarding
** item
** item
Line 20: Line 21:
** item
** item
* PTOs
* PTOs
**
** ashughes: Fri Apr 13, Thu Apr 19, Mon Apr 23, working remote every day in between


== QA Team Updates  ==
== QA Team Updates  ==
Line 26: Line 27:
=== Desktop Firefox (Juan)  ===
=== Desktop Firefox (Juan)  ===
* Fx.Next
* Fx.Next
**  
** Mozmill w/Jenkins working for release testing (special thanks to davidg, davehunt, geo, whimboo)
*** we can now run automation by simply uploading a cfg file to Jenkins
*** this means Softvision can kick off our automation now if builds come out late at night
*** ashughes will be documenting the process once it gets put through a live run
* Firefox ESR (ashughes)
* Firefox ESR (ashughes)
**
** 10.0.4ESR going to build for a ''beta'' next week
** Will also be testing warning billboards / hotfix for Win2k, Win XP SP1, and 3.6 EOL next week
* Crash Investigation
* Crash Investigation
** [https://wiki.mozilla.org/Platform/2012-04-10#Desktop Stability Report for this week]
** [https://wiki.mozilla.org/Platform/2012-04-10#Desktop Stability Report for this week]
Line 34: Line 39:


=== Browser Technologies (Tony)  ===
=== Browser Technologies (Tony)  ===
*Issues
*Highlights
**  
** Goals draft is up
** Fennec working toward trimming beta blockers.  theres now a "soft" triage section for softblockers.  On target Apr 26th
** Server team is busy with AITC, Token Server, and Sync server.  Also, busy with BrowserID - hotfix and deployment this week.
** B2G is working toward milestone 3, and taking on tagging/building of flash builds for now.  Workweek in May
*Fennec (Kevin/Aaron)  
*Fennec (Kevin/Aaron)  
**  
** See https://wiki.mozilla.org/Mobile/Notes/11-Apr-2012#QA
** Stability (nhirata)
** Stability (nhirata)
*** Stability getting better since the Maple merge.  having said that there still needs some work done.
*** Stability getting better since the Maple merge.  having said that there still needs some work done.
Line 43: Line 51:
* Apps WebRT (David/Jason/Aaron)
* Apps WebRT (David/Jason/Aaron)
** What happened this week?
** What happened this week?
***
*** Finalized Q2 goals discussion for apps - Dissolved into goals for each team
*** More digging into mobile web compatibility [https://docs.google.com/spreadsheet/ccc?key=0AiZoGR-iOAlUdHVQemJDVjBQSXdvc01QN1BiYm43QlE#gid=0 here]
*** Initial exploratory testing of web apps integration into fennec native conducted for one feature currently landed
** What's next?
** What's next?
***
*** Finalize app quality checklist for developers
*** On-going of test plans for web apps integration into desktop and android
*** Starting test plan development for apps in the cloud client integration
*** Get clarity on QA requirements for WebRT for marketplace beta release
*** Continue doing web compatibility testing on mobile for gecko vs. webkit
*Sync (Tracy)
*Sync (Tracy)
** Android
** Android
Line 52: Line 66:
*** Form performance improvements landed
*** Form performance improvements landed
** Desktop
** Desktop
*** A small train of sorts is pending QA today.
*** A small train rolled out to m-c today.
*** 2.0 client work being done in git.  Nothing to test at this time, per gps.
*** 2.0 client work being done in git.  Nothing to test at this time, per gps.
*Test pilot (tracy)
*Test pilot (tracy)
** UI Heatmap 2012 study had to go through a couple of iterations (jono on pto this week)
** UI Heatmap 2012 study had to go through a couple of iterations. It is live. (jono on pto this week)
*Sync Server (jbonacci/jrgm)
*Sync Server (jbonacci/jrgm)
**  
** Functional and load test of AITC and TokenServer continues on qa1, qa2, and local installs
** Functional and load test of AITC and TokenServer in Dev continues
** Test planning for AITC and TokenServer in Stage
** Rough draft AITC for April Test Plan is posted for review: https://mozqa.etherpad.mozilla.org/79
** QA team recruiting is just ramping up
*BrowserID (jbonacci/jrgm)
*BrowserID (jbonacci/jrgm)
**
** Finishing up current train: Train 24: Bug 740272 - QA and deploy BrowserID train-2012.03.28 to production
** "Final" BID team Q2 goals should be posted by Thursday
*Pancake (nhirata)
*Pancake (nhirata)
** Search mechanism changed
** Search mechanism changed
** Drive to try to release internally either today or tomorrow
** Drive to try to release internally either today or tomorrow
*** chances are at earliest it would be next week.  Most likely the following week
*** chances are at earliest it would be next week.  Most likely the following week
*B2G (jhammink/Geo)
**working on long range/M3 Test Plan for B2G
***several new features in process of landing
**Reviewing APIs and test pages with an eye on automation
** Working with rest of dev team to get weekly candidate builds tagged and generated


=== WebQA (Stephen)  ===
=== WebQA (Stephen)  ===
* Affiliates
* Affiliates
**
** Release being delayed until tomorrow to complete dev work
** Moving to continuous deployment (we have statsd)
* AMO
* AMO
**
**Increased test coverage
**Improving on making sure build is green
* Careers page
** Pushing out [https://bugzilla.mozilla.org/show_bug.cgi?id=744310 minor updates/fixes]
* Marketplace
** Getting litmus tests into tracker for selenium automation
* Engagement Projects
* Engagement Projects
** [https://mozillalabs.allizom.org/en-US/ Betafarm] will be released 4/16
** [https://mozillalabs.allizom.org/en-US/ Betafarm] will be released 4/16
** [https://air.allizom.org/ AirMozilla] theme refresh will be released 4/16
** [https://air.allizom.org/ AirMozilla] theme refresh will be released 4/16
* Flightdeck
**
* Input
**
* Mozilla.com
* Mozilla.com
** working on 2.0 release
** working on 2.0 release
* Mozillians
* Mozillians
**
** Releasing today - [[bug 744473]]
** New responsive UI hotness
* MDN
* MDN
** [http://mzl.la/mdn_20120410_release release]shipped 4/10
** [http://mzl.la/mdn_20120410_release release] shipped 4/10
** Working on  next [http://mzl.la/mdn_20120424 release]
** Working on  next [http://mzl.la/mdn_20120424 release]
* Socorro
* Socorro
**
** [http://bit.ly/HxybDP Milestone 6] released today
** Automation is moving to [https://github.com/mozilla/Socorro-Tests/tree/webdriver WebDriver] - HUGE shout out to the team for doing the refactor!
* SUMO
* SUMO
** continuous deployment
** continuous deployment
** Supporting (and found issues with) a couple IT site moves from SJC -> SCL
*** [https://bugzilla.mozilla.org/show_bug.cgi?id=741815 getpersonas.com]
*** [https://bugzilla.mozilla.org/show_bug.cgi?id=743162 wiki.mozilla.org]
* Selenium 2.21.0 is released
** ...so we'll be taking a look at it soon (lots to work through)
* Infrastructure
** Getting access to our new [https://bugzilla.mozilla.org/show_bug.cgi?id=741956 Selenium VMs in PHX] -- (private bug) hopefully today
*** This means we should be able to run our tests and have them reporting in [https://ci.mozilla.org/ WebDev's CI]
**** ...which means getting shared responsibility/coverage on tests should be a lot easier


=== Community (Marcia)  ===
=== Community (Marcia)  ===
Line 93: Line 130:
* Upcoming Events
* Upcoming Events
** MozCamp LATAM is progressing well
** MozCamp LATAM is progressing well
*** Juan, Marcia and John Hammick attending
*** Juan, Marcia and John Hammink attending
*** John will present a BOF session on how to build B2G
*** John will present a BOF session on how to build B2G
*** Meeting at 3 PM today to discuss the content of the Mobile Testing Workshop
** Mini-MozCamp in Italy is at risk
** Mini-MozCamp in Italy is at risk
*** Not enough movement on planning. Might be better to postpone until the fall
*** Not enough movement on planning. Might be better to postpone until the fall


* Video Work
* Video Work
**  
** no update
*QMO.next (Raymond):
*QMO.next (Raymond):
** no update
** no update


=== QA Automation Service (Henrik, David)  ===
=== Automation Development (Henrik, Dave)  ===
==== General ====
==== General ====
* No update
* Working hard to get Mozmill 1.5.10 released soon
* [http://www.hskupin.info/2012/04/07/memchaser-0-3-is-out/ MemChaser 0.3 has been released]
* Next week we have our [https://intranet.mozilla.org/Auto-tools/SF_WorkWeek_April_2012 Auto-Tools work week] in San Francisco


====Project updates====
==== Projects ====
===== On-Demand Test Framework (Geo) =====
* Mozmill CI: On-demand solution is live and has been tested by Anthony against Firefox 12.0b5 candidate builds
* No update
* Mozmill CI: Henrik is working to get coverage of beta candidate builds via Pulse by end of this week
 
* Tests: Refactoring current Mozmill tests to make them compatible with Mozmill 2.0
===== Mozmill 2.0 Automation Scripts Update (Henrik) =====
* No update
 
===== CI system for daily and l10n Firefox Builds (Henrik) =====
* No update
 
===== Mozmill Dashboard Validation (DavidB) =====
* No update
 
===== MemChaser extension =====
* No update
 
===== Open Positions (DavidB) =====
* No update
 
===== Weekly Blog Posts =====
* No update


===== [https://wiki.mozilla.org/QA/TCM MozTrap] =====
===== [https://wiki.mozilla.org/QA/TCM MozTrap] =====
* got some security / privacy feedback.  addressing now.
* Beginning dev work on case ID prefix (Ubuntu request)
* Beginning dev work on case ID prefix (Ubuntu request)
* spec'ing out:
* spec'ing out:
Line 138: Line 162:


== Roundtable/Discussion Items  ==
== Roundtable/Discussion Items  ==
* Q2 Goals for Entire QA Organization (jsmith)
* [https://wiki.mozilla.org/Kilimanjaro/ProductDraft Kilimanjaro Draft] is publicized.  Discuss QA strategy and approach (tchung)
* [https://intranet.mozilla.org/QA/Q22012_QAgoals Q2 Goals] for Entire QA Organization (jsmith)
* Switching meeting structure to new QA org (jsmith)
* Switching meeting structure to new QA org (jsmith)
** Desktop
** Desktop
** Mobile
** Mobile
** Server
** Services
** Web
** Web
** Automation
** Automation
Line 151: Line 176:


=== Today ===
=== Today ===
* Add notes here
* Action Items
**
** Contact Jason or Tony if you are interested in joining the Monday 1 PM Web App meeting.
** Krupa to lead the effort to create a description of a "good" bug
** Reference http://www.lehigh.edu/~inhro/documents/SMART_GoalsHandout.pdf when refining your goals.
** Think about ways we can improve the ways people use Bugzilla, Github to communicate within the project.
** Geo will refine the QA weekly staff meeting template and add a Kilimanjaro section
** Figure out the best way to use the Mac Minis.
* Notes
** Try to use other channels to talk besides IRC
** Try to help each other out with Test Days - get out of your area for a bit
** Very small desktop team - the rest of the team needs to help when asked because the platform is our bread and butter.
** Dogfood your android device :) and help with the mobile effort
** If someone seems slammed, ask them if they need help.
** 50 Mac Minis are available for our use - see the email that Bob sent
 
=== Last Meeting ===
=== Last Meeting ===
* Action Items
* Action Items
**
**
Confirmed users
1,867

edits