April 24, 2013 # Every Weds @ 1:30p Pacific Time - Mozilla HQ, Warp Core # # Vidyo: https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh # Phone: +1 650 903 0800 or 650-215-1282 x92 Conf# 9245 (US/INTL) # +1 800 707 2533 (pin 369) Conf# 9245 (US Toll Free) # +1 416 848 3114 x92 Conf# 9245 (Canada) # IRC: irc://irc.mozilla.org:6697/#qa
QA Org Items
New Hires & Interviews Upcoming Events/Conferences
Jammink at SFHTML5 conference, April 25th; also invited to speak at MobileWebDevcon in Boston, July 16th
mbrandt @ Telerik Test Summit, May 2 - 3
Mozilla Reps Mexico, juanb presenting over Google Hangout, April 26 @ 11am.
Anthony Hughes will be late to this meeting indefintely (cannot join until 2pm PT due to competing commitment)
Travel / PTO
QA Team Updates
Firefox 21.0b4 candidates available for testing, planning to ship tomorrow
New stub installers in QA's hands for testing.
Firefox for Metro iteration #6 underway.
Desktop Stability Report: https://wiki.mozilla.org/Platform/2013-04-23#Stability
http://arewestableyet.com/ might be of interest
Debugging media flow automation checking & Peer Connection FxAndroid automation failures
Figuring out our automation story with TURN server
Misc exploratory testing & QAWanted investigations
Automation analysis - Media flow checking & FxAndroid support
Misc exploratory testing on Desktop and FxAndroid
Compatibility testing for mixed-content blocking feature
libstagefright testing (h264)
beta 4 qualification
Around 10 p1s, 18 p2s for CO - 2 new p2s in tracker for VE - need to retest some issues with latest on ikura, since they are on very very old build (3/21)
pre-certification test plan? We have specs from carrier.
Test runs http://pastebin.mozilla.org/2344048
1.1. test run in progress
1.0.1 test run completed last week
still need to mine bugs from this and triage
Review testrun for new cases completed; testcases not updated
Madrid Work Week
jsmith fixed a tef+ bug!
Partner Customization Testing is under way for preinstalled apps
Another pass by Martijn on the mochitest exclude list has us up to 215K mochitests running: https://bugzilla.mozilla.org/show_bug.cgi?id=860748
Martijn also working on timeout changes, should enable another bunch of tests https://bugzilla.mozilla.org/show_bug.cgi?id=861850
Luqman working on Device Storage tests https://bugzilla.mozilla.org/show_bug.cgi?id=861456 -- currently exploring code path coverage and making sure they actually test sd card access rather than /tmp access.
David Clarke working on suite of Camera mochitests https://bugzilla.mozilla.org/show_bug.cgi?id=864621
On-device API validation tests for CTS scoped, initial focus on verifying hardware interactions. http://bit.ly/moz-cts-planning
A meeting will be scheduled next week to talk about refining the smoketests
Community Members Onboarding
Services (Edwin) SignIn/PiCL Work Week 5/6-5/10 Team now has a Win8 Surface Pro to test Now contains 4 sub-teams: Sign In, PiCL, UP, B2G
AWS integration next week
PiCL (Attached Services) planning
Work continues on picl-server, picl-client, picl-android
Discussions continue around design of authentication and how all this will look in FireFox (desktop/android)
Karl spending 2 days of testing Heka 0.2
James is tracking HW work in Services (PHX1 dbs) and the move to AWS
Have commercial RIL Unagi builds (v1-train) on a regular basis now, hooking them up to our CI
Have Leo (1.1), Inari, and Hamachi (1.0.1)
Now testing Marketplace on dev
searching for free/paid apps (https://github.com/mozilla/gaia-ui-tests/pull/713)
Found this week from automation:
https://bugzilla.mozilla.org/show_bug.cgi?id=865255 - Apps reporting incorrect empty message when USB plugged in (basically, SD card status is broken over USB connections to Unagis)
https://bugzilla.mozilla.org/show_bug.cgi?id=865279 - Adding bookmark to full homescreen does not create a new panel
Nice way to track our activity via GitHub's API:
xfailing 19 tests :-(
New Marionette issues filed since last week:
https://bugzilla.mozilla.org/show_bug.cgi?id=864296 - Marionette webelement.find_element(locator) returns values even if the webelement is no longer present on the page
https://bugzilla.mozilla.org/show_bug.cgi?id=863608 - [B2G] Marionette error sending message to frame, frame opens/closes quickly
https://bugzilla.mozilla.org/show_bug.cgi?id=863117 - After running a Gaia UI Test and locking, unlocking homescreen, UI shifts dramatically and unusably
which looks like a potential dupe of https://bugzilla.mozilla.org/show_bug.cgi?id=859264 - Click's scroll into view is too aggressive on the Select wrapper
(still) Having issues with cell data, and Taipei is investigating:
https://bugzilla.mozilla.org/show_bug.cgi?id=853489 - Cannot connect to carrier after reboot during automated test
looks like it might be a problem with the "modem"; triaging
Several tests (clock, language, FTU/FTE, keyboard, others) are affected by https://bugzilla.mozilla.org/show_bug.cgi?id=859264 - Click's scroll into view is too aggressive on the Select wrapper
regression from another Marionette fix
Need https://bugzilla.mozilla.org/show_bug.cgi?id=853622 - need sendNativeTouchEvent to be able to replace more click() calls with tap()
as it doesn't work everywhere
Always up-to-date list of bugs affecting Marionette automation:
bugs blocking that are in https://bugzilla.mozilla.org/show_bug.cgi?id=801898
Firefox Flicks was updated with the first Early Entry Video winner: https://firefoxflicks.mozilla.org/en-US/ [also new partners and winners pages]
New release for ReMo with new events by categories, plus bug fixes: https://reps.mozilla.org/
Krupa's in her Payments work week
no pushes this week
Several issues with the dev cluster - https://bugzilla.mozilla.org/show_bug.cgi?id=864422
Milestone 43 successfully released on 04.24.2013
added new coverage for critical click-paths for logged-in contributors to SUMO
Community Members Onboarding
Mozilla Reps are growing...
There are now over 400 Mozilla Reps! https://reps.mozilla.org/
One and Done - https://wiki.mozilla.org/QA/Taskboard [pragmatic] Work has started on creating a wizard for gently guiding newbie contributors towards their possible area of interests.
Meetup.com QA Meetup for May - could get contributors to test upcoming features (see https://quality.mozilla.org/2013/04/webrtc-testing-try-out-conversat-io-with-other-users-and-file-bugs/ ) or create test cases
Summit2013 - https://etherpad.mozilla.org/2013-mozilla-summit
Community Nominations have concluded. A set of stewards is now reviewing the list of individuals who indicated interest in coming by adding themselves to the Summit2013 group
Mozilla Summit Assembly will be held June 14-16 in the Paris office.
If there is interest, we can try to plan some kind of QA event as a separate event to involve new community in the Summit Cities
Mozilla Festival (London, early November)
Zac and Marcia brainstormed a bit regarding some possible topics. Anyone interested in being involved in doing something there please let Marcia or Zac know.
Open Badges Presentation by Emily Goligoski on May 2, 2013 at noon (Everyone should have a calendar entry in place for this event)
Reminder: Review https://docs.google.com/spreadsheet/ccc?key=0AsHml-k4XnX7dG1tV0JLTE1yZjJlM2RqaVdfS24zX0E#gid=0 prior to the event.
Firefox 21 Beta 4 Test Day
No update this week
appsec is actively reviewing dev instance with Persona plugin and Buddy Press removal
working on a fix to https://bugzilla.mozilla.org/show_bug.cgi?id=856649 (security bug)
Community Members Onboarding
Automation Development (Henrik, Dave)
mozdownload 1.7 has been released (progress meter, retries)
Big thank you to Johannes Vogel (:nebelhom) who worked most on this release!
IT is working on the last network issues with the new Mac Minis (hopefully done by today)
Once done I will connect the new machines and do testruns (if no failures are found we might want to have the transition next week)
Awaiting feedback from Anthony and Juan which tests are applicable
See long roundtable discussion of the automation meeting about Mozmill vs. Marionette
Community Members Onboarding
[jsmith] JS Integration Tests (developer) vs. Gaia UI Tests (QA) contention and discussion
[jsmith] Establishing a way to bring a global perspecsupertive and quality tracking for automation priorities
[marcia] Any meetup topics for May? Email sent out previously regarding starting up meetups in Mt. View again
[marcia] q2 goals - https://intranet.mozilla.org/QA/Q22013_QAgoals
[jammink] what should our level of engagement be in partner certificati on efforts?
[geo] Luqman's last day is 4/30, be sure to say goodbye!
Notes, Takeaways and Action Items
Template for this document is here: https://etherpad.mozilla.org/qa-staff-template