April 10, 2013
# Every Weds @ 1:30p Pacific Time - Mozilla HQ, Warp Core # # Vidyo: https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh # Phone: +1 650 903 0800 or 650-215-1282 x92 Conf# 9245 (US/INTL) # +1 800 707 2533 (pin 369) Conf# 9245 (US Toll Free) # +1 416 848 3114 x92 Conf# 9245 (Canada) # IRC: irc://irc.mozilla.org:6697/#qa
QA Org Items
New Hires & Interviews
Jammink at SFHTML5 conference, April 25th; also invited to speak at MobileWebDevcon in Boston, July 16th
B2G Workweek in Madrid (Apr 15-19)
Travel / PTO
[marcia] PTO April 12
Firefox OS Work Week in Madrid April 15-19 - https://intranet.mozilla.org/FxOS_Madrid [bob, tchung, marcia, jsmith, zac)
jammink - april 8-16 in Chile for IOT (Interoperability Testing)
[juanb] PTO April 18, 19
[edwong] possible jury duty April 22+
QA Team Updates
Firefox 21.0b2 released (featuring multiple Social providers and about:healthreport)
Firefox 20.0.1 to be released tomorrow.
New Funnelcake builds also in the works for this/next week.
Targeted for Fx22 ship - 7 blockers remaining
Automation remote story debate - TURN & STUN server integration in mochitests
Quality concerns - data channel automation needs improvement, audio latency
Status - This Week
More WebRTC Exploratory Testing - E2E Dogfooding + DOM API Analysis
Investigate bug 859395 to diagnose call failure
Status - Last Week
Offer media constraint mochitests landed (bug 850275)
Exploratory testing for Peer Connection & Data Channel DOM APIs
First stab at checking media flow mochitests (bug 831789)
Dogfood exploratory sessions with audio/video chat testing
Misc automation development (bug 855796, bug 850587)
CSP planning, IDN cleanup, assorted security bugs
[jsmith] Advertised WebRTC dogfooding and testing opportunities on various communication channels - https://quality.mozilla.org/2013/04/webrtc-testing-try-out-conversat-io-with-other-users-and-file-bugs/
Amid a cycle for Firefox for Android 20.0.1 containing promo removal and stability ride-alongs; targeting release tomorrow
http://bugzil.la/858561 – Move BrowserDB.expireHistory from GeckoApp.onPause to GeckoApplication.onActivityPause
http://bugzil.la/859425 – Move decoding/storing favicons to background thread
http://bugzil.la/817775 – Marketplace promo is active on beta on about:home, but it shouldn't be
Smoketest continue to fail on commercial RIL
Workweek next week, focus involved v1.0.1 bug stomping
IOT issues found this week in Chile and Spain for round 1. See below for details
Inari and Leo devices are ported with nightly builds. Buri is next focus, has known driver issues
Working on a h264 device compatibility test plan
mfinkle made a change on friday to help, please test around the following bugs
in need of LG device to test around geolocation crash
bug 859915 - crash in [@ libqc_b2g_ril.so@0x41ba4]
UX bugs (nhirata): details:
TestRun 1.1a (camd, mbrandt)
TestRun 1.1a has not been created yet - waiting for go-ahead from jammink
jammink gives go-ahead; I'll be leaning on Barker to set up the breakdown and help dole out tasks
camd created a script using Moztrap's API that can create new testruns based off of a list of testcase ids - https://moztrap-connect.readthedocs.org/en/latest/api.html
Tracking bugs from Mozilla:
https://bugzilla.mozilla.org/show_bug.cgi?id=855378 - Certification Blockers for Latam IOT (incomplete)
https://bugzilla.mozilla.org/show_bug.cgi?id=855322 - Certification blockers for Spain IOT
Whiteboards all bugs updated (IOT, <region>, Ikura). Combined Bugzilla Query for ALL IOT whiteboard bugs: http://bit.ly/10MocpA PLEASE CHECK THIS QUERY! I am seeing 56 bugs (Spain and Chile combined)
Top issues (numbers as yet refer to vendor-specific bug tracker, not bugzilla):
#43554 - Messaging delivery reports are received poorly decoded.
#43555 - The DuT does not send messages to destinations of 8 digits
#43257 - [BLOCKER] The links on the web pages do not work
#NOT ENTERED YET - [BLOCKER] The DUT is unable to import the contacts from the SIM.
Keypad for entering PUK, PIN and new PIN does not show any keys (not in (no issue in system yet)
Other issues found in IOT (my rubbish translation, sorry)
DUT displays options or bookmarks in English (no issue in system yet)
Media player not paused when a call is recieved #43552
Audio still present when volume set to 0 #43553
Facebook does not allow you to upload a photo #43556
Current IOT risks:
ZTE and TEF are using their own system to log certification bugs There seems to be quite a bit of disconnect as to how bugs are getting entered into Bugzilla and or handled on our side, and there is a risk that issues will get dropped
I'm going to propose that we switch to either their system or ours.
TEF has expressed some concern that bugs are not being bumped to P1.
We have a scarcity of IKURA devices to which to repro bugs, collect logcats and screenshots. I'm working with Gerald to fix this and get us a loaner device for the duration of the time I'm here; in the meantime, we've made a few visits already to certification facility to collect this info; we'll return to AT4 for next round this friday.
AT4 (the certification facility) is testing on a very old build - which no one between TEF and ZTE can agree which it actually is. David from TEF says it's 3/21; the phones I checked at AT4 today were on a 3/28 build.
I've been asked by ZTE today to possibly stay for - or return immediately for- another week. Certification testing is only just now getting underway, and there is much to do re: co-ordination
Continuing to explore compatibility document/test suite for 1.0.1. Have list of documentation targets from engineering, going through estimation/scoping on what we have.
Smoketest effort continues
We have been testing with the Mozilla RIL the past few few days due to compatability issues
Community Members Onboarding
Sign In Beta 2 announcement and social media blitz
AWS - jrgm - gene continuing buildout, have confirmed initially for keysigner and verifier; need readonly databases to get much further.
working on fixing up automation - edwong/karl
PiCL - jbonacci
Prototypes and demos!
Integrating SimplePush, MySQL, also
Focus is on picl-server and marteau this week. Next week will probably shift to desktop and mobile
Heka 0.1.2 for Sync is due to go out to Prod today (jbonacci)
Heka 0.1.4 for Marketplace is due to go out to Prod today (Services QA spectating)
Heka 0.2 release is getting ready for some QA effort (kthiessen)
1 v1-train regression caught
6 new tests added
Some coverage gained, some lost due to Marionette changes
working through https://bugzilla.mozilla.org/show_bug.cgi?id=860274 - Deploy bouncer redirect in support of 20.0.1 Firefox release
brandon (dev) added tests for them in https://github.com/mozilla/bouncer-tests/pull/30/files
nothing this week
Firefox Health Report
Diagnosing STR for https://bugzilla.mozilla.org/show_bug.cgi?id=860477
Krupa's been in apps/marketplace meetings; will have her update after the meetings
mozilla.org test day last Friday April 5th, 2013 https://etherpad.mozilla.org/mozilla-org-testday-april-2013
Milestone 04-04-2013 released this week
Releases are blocked until stage is stood back up
[tracker] Mo' stage, mo' problems: issues with backfilling and crontabber
Community Members Onboarding
Grow Mozilla Meetings
Notes from April 4 meeting - https://wiki.mozilla.org/Grow/Meeting_04_04_13
Open Badges Presentation - May 2, 2013 at Noon in Ten Forward. Will be streamed on Air Mozilla.
Please come prepared with questions and review this spreadsheet prior to the presentation:
One and Done
Some discussion on the community-building mailing list regarding the scope of the project
Delphine's feedback from her presentation at Mozilla Hispano Work Week (approx. 20 people attended):
People felt that this should be a tool oriented to newcomers only - and not to people that are already Mozilla or Open Source contributors
They said that it would probably be difficult for people to judge how much time a task could take, especially if they are new. This was said for example when showing the mockup where there is a time line, and that the contributor has to say where in the task he is
Some people present thought that the reward process was not "rewarding" enough, or not something they would personally find rewarding. This makes me wonder how successful Open Badges are going to be in other countries than the US.
However I'd like to note that the people who thought that receiving a badge or swag was not perceived as rewarding are old-time contributors, who say that they already have too much Mozilla swag and don't care about Badges. For newcomers though, this might be perceived as rewarding...
Some time ago, I remember some community members in Europe for example saying that they did not feel interested by the badge rewarding system. This may have changed since then, but maybe it's worth looking into?
Otherwise feedback was generally positive. People think this can be a very useful tool to attract new contributors and are interested in seeing it develop more
Had a conference call with Mike Hoye, Liz Henry and Kat from the Linden School in Toronto. They are interested in integrating some Mozilla content into their curriculum for the fall semester and are willing to consider proposals that would be suitable for 15-17 year old young women
Created https://mozqa.etherpad.mozilla.org/Linden-School-Ideas to track ideas
Mozilla Summit - https://wiki.mozilla.org/Summit2013
October 4th, 5th and 6th
Awaiting word on how community nominations will be handled after they have registered in Mozillians
High-Level Timeline as published on wiki:
April 17th - Final day for volunteers to update their Mozillians.org profiles (add location and join "summit 2013" group).
April 30th - Summit invitation list (volunteers only) final.
By second week in May - Volunteers who will receive invitations will be contacted via email.
First weeks in June - Invitations sent to staff + volunteers.
June 14th - 16th - Summit Planning Assembly (Paris, France)
Remo - Mozilla Mexico - April 26 - 28
Firefox 21 Beta testday this Friday, April 12, 2013:
No update this week
waiting on security review of plugin
Community Members Onboarding
Automation Development (Henrik, Dave)
Overall A-team goals for Q2 2013: https://wiki.mozilla.org/Auto-tools/Goals/2013Q2
Still no update yet for the mozqa.com move - not sure when IT will actually handle it (bug 811869)
Still a slow process by IT to get ready with our new Mac Minis (bug 853074)
Mozmill CI [henrik]
Henrik landed a patch (bug 857956) which drastically improved the robustness of the update tests (lets cross fingers that it will stick)
Last blocker for pulsebuildmonitor has been fixed and we can most likely push it to production tomorrow
Testing localized builds for beta and release candidate builds are on the way (bug 857980 for pulsetranslator needs to be fixed first)
Lots of work going into making the Gaia UI tests run reliably on B2G desktop. A lot of fixes already landed for next Marionette release, and hopefully more soon.
[camd] - working on a few more small updates
[camd] - created new suite for b2g of test cases in v1.1.0 that are not in v1.0.1
Community Members Onboarding
When do you want Q2 goals finalized by? [tony]
Or generally, can we can update from each team on Q2 Goals?
Do we have anyone in the pipeline for Director of QA? [mbrandt]
Criteria for giving equipment to community members [marcia]
Request for a contributor funneled over from David Boswell
Notes, Takeaways and Action Items
Template for this document is here: https://etherpad.mozilla.org/qa-staff-template