QA/StaffMeetings/QA-Staff-10-23-2013

Wed October 23, 2013

# Every Weds @ 1:30p Pacific Time - Mozilla HQ, Warp Core 
#
# Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
# Phone:  +1 650 903 0800 or 650-215-1282 x92 Conf# 9245 (US/INTL)
#         +1 800 707 2533 (pin 369) Conf# 9245 (US Toll Free)
#         +1 416 848 3114 x92 Conf# 9245 (Canada)
# IRC:    irc://irc.mozilla.org:6697/#qa

QA Org Items

   QA Show and Tell

   This week: John Hammink - How to flash a B2G phone is a few quick easy steps! (internal only) 

   https://wiki.mozilla.org/QA/Show-and-Tell#Schedule

   Next week: Desktop QA

   New Hires & Interviews

   Web QA interviewing intern candidates; looking good

   mobile QA interns and FTE resumes are rolling in now, phone screens starting

   services: me too, phone screens

   Upcoming Events/Conferences 

   Notices

Travel/PTO

   [mbrandt] - getting close to baby launch 

   https://twitter.com/m8ttyb/status/390560627816538113

   [marcia] Tribes Training in SF: October 29-30

   [kthiessen] Also at TRIBES SF, 29-30 Oct.

   [nhirata] November 13-14 Tribes

   [pdehaan] in SF for HTML5DevConf Oct 22-23

   [jsmith] Birthday 10/25

   [mwobensmith] MozFest plus remote 10/23-10/30

   [ashughes] Upcoming PTO: Nov 16-30, 2013

   [tchung] taipei : Nov 11-15 

   [Henrik] Nov 1, Nov 13

   [retornam] Tribes Training in SF: October 29-30

   [davehunt] MozFest October 25-27

QA Team Updates

Desktop (Juan)

   Firefox 

   All versions of Java click-to-play for Firefox 24+ -- may decide to unblock 7u45  based on feedback and bug 926605

   Firefox 25.0b11 shipped today and Firefox 25RC respun to disable OCSP due to some sites unexpectedly pushing live misconfigured implementations -- a fix will be landed in Firefox 26 to more gracefully handle these misconfigurations -- see bug 929617 for more details

   For those of you curious about OCSP:

   "The Online Certificate Status Protocol (OCSP) is one method for  obtaining certificate revocation information. When presented with a  certificate, the browser asks the issuing CA if there are any problems  with it. If the certificate is fine, the CA can respond with a signed  assertion that the certificate is still valid. If it has been revoked,  however, the CA can say so by the same mechanism."

   https://blog.mozilla.org/security/2013/07/29/ocsp-stapling-in-firefox/

   Mavericks [10.9] is now available for free download in the Mac App Store.

   On the lookout for crashes and any new issues

   ESR (mwobensmith) 

    Continued security bug verification for 17esr, 24esr and all other branches

   Stability (marcia) 

   Overall Stability numbers look good for all channels: https://wiki.mozilla.org/Platform/2013-10-22#Stability_.28kairo.2Fbsmedberg.29

   Automation (ashughes)

   Security (mwobensmith)

   En route to London for MozFest

   Shumway review

   Community 

Mobile (Tony)

   Firefox for Android (Kevin/Aaron) 

   25.0b10 shipped

   bug 928441 -  content view truncated in landscape 

   this week's notes: https://wiki.mozilla.org/Mobile/Notes/23-Oct-2013

   test day Nov 1 (new about:home)

   Stability (kbrosnan) 

    crash rate is slowly creeping up (FaviconRevamp/new about:home)

   B2G (Geo/jhammink) 

   Telefonica announced that Vivo will sell the new LG Fireweb and Alcatel One Touch Fire Firefox OS phones in Brazil, starting Oct 22. We're in the tech news!

   Official Blog https://blog.mozilla.org/blog/2013/10/22/telefonica-vivo-launches-firefox-os-smartphones-in-brazil/

   Slashdot http://slashdot.org/submission/3066909/lg-launches-fireweb-its-first-firefox-os-smartphone-for-200

   C|net http://news.cnet.com/8301-1035_3-57608752-94/lg-launches-firefox-phone-in-brazil/

   Hacker News http://news.ycombinator.com/item?id=6598153

   Stability (nhirata)

   https://wiki.mozilla.org/CrashKill/2013-10-21#B2G

   1.0.1 to 1.1 upgrade issue : https://bugzilla.mozilla.org/show_bug.cgi?id=928256

   Great work by nhirata diagnosing the root cause of https://bugzilla.mozilla.org/show_bug.cgi?id=927433 [marcia]

   [jsmith] SIM Customization testing & data development ongoing

   [jammink] Helping jsmith with sim customization testing

   currently reference installation on buri doesn't get past flash screen:  trying on Helix, Buri, Leo (TBD)

   [jammink] testcase reviews ongoing prior to burirun3

   area owners, review your testcases in moztrap (check your 'needs review' tagged testcases)

   [jammink] flashing oodles of phones and training IT

   [jammink] filing bugs against Helix devices

   [jammink] some scripting and automation

   [marcia] Smoketesting

   Some Mozilla Central regressions this week involving Marketplace and the Web IDL landing (affected Contacts App)

   https://bugzilla.mozilla.org/show_bug.cgi?id=928976

   Mochitest porting to the point where we can consider handing off responsibility for unit test areas back to the engineering owners. Currently documenting tests and figuring out first steps to this end.

   TCP Socket and WebApps APIs work underway in compatibility test suite. WebApps due to land this week, TCP Socket to follow.

   Community Members Onboarding

Services (Edwin)

   Identity/Persona

   node update deployed

   FxA

   Desktop client has finally made it into Nightly ELM, even though it is only about 50% functional

   Android client is moving along well

   FFos team is on a work week in Madrid with Telefonica. Daily updates are coming in as they piece together a FFos-compatible solution

   Sync

   Nothing new to report. FxA will at some point soon be hooked into our current Sync storage.

   SimplePush

   planning on working on a community test app

   Heka

   Heka v0.4 will be announced late this week or early next week. Several of the services products, including FxA, are already using this new version.

   Loads

   jbonacci: nothing new to report this week. Further load testing of FxA on hold pending further development of the backend datastore

   AddOns Registration

   jbonacci: I just started working on this with the EU team. Backend work and load test development is happening now. Client work is TBD.

   Community

   1 lead on on-boarding

   working on the idea of community tools development email list (if it doesn't exist)

   worked on one and done mvp

   working on task gathering for one and done

   Talkilla

   if you're interested: Fx >25 - https://talkilla-stage.mozillalabs.com/

   In Firefox, set media.navigator.permission.disabled to true

Web (Stephen)

   B2G/Gaia testing: 

   General device stability++  getting around 90+% passes with the fails a split of intermittent and legitimate failures

   big shout-out to Naoki, Dave, and Raymond for working really hard to get host and esp. device/job stability for Hamachis!

   UI Tests caught big regression over the weekend where Contacts API was changed but corresponding Gaia apps were not.  The Gaia apps, and all affected desktop tests were fixed by the devs. We followed up with fixes to the affected device tests.

   Contacts bustage was reported to manual QA team before they started smoketesting helping them to concentrate their testing

   New tests added: test number keyboard,  test add existing contact to sms, test export contact vcf to sdcard, test import contact vcf from sdcard, test notification on lockscreen, 

   Getting Aurora/1.2 UI tests back on track.. Lost 4 days after bad Marionette uplift and time distracted by Travis/Contacts API bustage. Expect it to be green again by early next week. Peipei contacted and a partner in China wants to run 1.2 branch. tef reported the Marionette breakage too

   Working with Taipei to better-coordinate our joint automation efforts (share the pain, share the gain), esp. around Wi-Fi/cell-data, etc.

   shameless self-plug: found a 100% reproducible crasher:

   https://bugzilla.mozilla.org/show_bug.cgi?id=928066 - B2G  27.0a1 Crash Report [@ XPCStringConvert::ReadableToJSVal(JSContext*,  nsAString_internal const&, nsStringBuffer**) ] running  browserscope.org test

   Bouncer 

    https://bugzilla.mozilla.org/show_bug.cgi?id=922281 - /api/create_update_alias returns 101 errors when trying to update an alias has been verified by RelEng, as part of the larger work in https://bugzilla.mozilla.org/show_bug.cgi?id=916181 - Update  firefox-latest, firefox-stub, firefox-latest-euballot bouncer aliases  as a part of post-release builder (and same for beta)

   Engagement Projects 

   REMO is releasing updates on Events

   Careers page is under test

   Web QA has kicked off the One&Done task list with this QMO post: https://quality.mozilla.org/2013/10/exploratory-testing-sumo-ask-a-question/  & This Moztrap run with tag 'oneanddone' https://moztrap.mozilla.org/runtests/environment/2511/

   Firefox Marketplace 

    Weekly release [1] was shipped 10/22

   Mozilla.com 

    shipped CTA for Brazil

    fix for Chrome blocking Firefox download due to mixed content landed on Bedrock stage and is under testing

   Mozillians 

    Weekly release went out on Thurs, rbillings is covering for mbrandt

   MDN 

   starting to work on refactoring our tests (there will be a testday planned, too) to cover the awesome new design:

   https://developer-dev.allizom.org/en-US/

   Socorro 

    shipping version 64 today: https://wiki.mozilla.org/Breakpad/Status_Meetings/2013-October-23

   SUMO 

   met and agreed with developers to resurrect a few smoketests for Input

   the longer-term plan is to use Input as a model for potentially tighter dev/QA integration (automated tests)

   Community Members Onboarding

   some new members reaching out to us on our mailing list, and we've responded with ways for them to get involved

Community (Marcia)

   Projects 

   One and Done: Result of Meeting held on October 22: Gather user stories for a Version 0.1

   Agreed upon user stories: https://etherpad.mozilla.org/One-Done-Meeting-2013-10-22

   Karl (kthiessen) would like  volunteers from each QA sub-group to list a dozen low-hanging manual  test cases for inclusion in One and Done when it's ready.  He'll ask for  volunteers in this meeting, and then follw up with them in the next  week.

   WebQA has kicked off the One&Done task list with this QMO post: https://quality.mozilla.org/2013/10/exploratory-testing-sumo-ask-a-question/  & This Moztrap run with tag 'oneanddone' https://moztrap.mozilla.org/runtests/environment/2511/

   WebAPI/Platform QA for B2G doesn't really have manual testcases, but I'll try to figure out something appropriate. Also worth mentioning that initially we only seem to be targeting standing tasks, rather than one-time-run tasks [geo]

   Plan to get resources from the community: write up a blog post that introduces our project, lists out the scope of the MVP, categorizes the type of resources needed (design, web dev, db, testing),  requests people to join the mozillians.org group "one-and-done".

   https://mozillians.org/en-US/group/one-and-done/

   Cross-post to Creative Team, Developer Engagement and  Community blog. Email to Reps mailing list. Publish in monthly Mozillians newsletter. Social media accounts.

   New section in the Monday Community meeting for new contributors: https://wiki.mozilla.org/WeeklyUpdates. Please feel free to add names of new community members to the weekly update page.

   Working with David Boswell to print the Summit 2013 Group Photos to canvas and get them installed in the SF Community Space

   We should start brainstorming about Community Goals for next year

   Upcoming Events 

   Community  Building Meetup in SF: December 11-13

   https://etherpad.mozilla.org/community-building-meetup-late-2013

   Mozilla Festival - http://mozillafestival.org/ -October 25 – 27, 2013 in London

    Past Events

   Mozilla Summit Survey: http://www.surveygizmo.com/s3/1408505/Post-Summit-feedback-survey

   Testdays (ashughes)

   Firefox for Android 26 Test Day: https://quality.mozilla.org/2013/10/firefox-for-android-beta-26-testday/ 

   Video Work

   No update this week

   QMO.next (Raymond)

    will work with IT to get an anti-spam plugin enabled to help filter spam comments, now that they're enabled

   Community Members Onboarding

Automation Development (Henrik, Dave)

   General

   Automation Development report – week 42 2013: http://www.hskupin.info/2013/10/23/automation-development-report-week-42-2013/

   Automation Development team goals for Q4 2013: http://www.hskupin.info/2013/10/23/automation-development-team-goals-for-q4-2013/

   Projects

   Mozmill CI

   Ugraded mozmill-ci to Jenkins 1.509.4: https://github.com/mozilla/mozmill-ci/issues/298

   To lower time spent in sending emails we disabled them for successful testruns: https://github.com/mozilla/mozmill-ci/pull/336

   OS X 10.9 nodes are getting upgraded to final release by IT

   We have strange system crashes for our Windows 8.1 64 bit nodes (see https://bugzilla.mozilla.org/show_bug.cgi?id=916746 )

   Nearly all 4th nodes per platform are online

   Eideticker CI

   Will has a patch for what we believe to be the last blocker to getting this running and sending reports to a people account. We should have reports to see next week.

   B2G

   Marionette implemented moztest for test results instead of unittest, which gives us more flexibility. Unfortunately it caused a number of regressions in the XML and HTML reports. These are all fixed now and we hope to release a new version of the client tomorrow.

   MozTrap (Cameron)

   Community Members Onboarding 

   Johannes Vogel (:nebelhom) now has an inari device and will be helping out with the B2G performance testing.

Roundtable/Discussion Items

   [Tony] Great blog posts by David Clarke that is getting lots of App developer attention!

   Breakdown of Chrome APIs to Gecko APIs: 

   http://onecyrenus.wordpress.com/2013/10/14/firefox-vs-chrome-app-apis-how-do-the-apis-compare/

   How to port a Chrome packaged App to FxOS: 

   http://onecyrenus.wordpress.com/2013/10/11/rockin-the-free-web-how-to-convert-a-chrome-packaged-app-to-a-firefox-os-packaged-app/

   And MDN team documented it at : https://developer.mozilla.org/en-US/Apps/Developing/Porting_Chrome_apps_to_open_web_apps

   [jsmith] Referral Hunting for Job Openings & College Recruiting for Interns

   Full-Time

   http://careers.mozilla.org/en-US/position/oJuUXfwO

   http://careers.mozilla.org/en-US/position/oWoSXfwT

   http://careers.mozilla.org/en-US/position/o08KXfwz

   Internships

   http://careers.mozilla.org/en-US/position/ojkSXfwc

   http://careers.mozilla.org/en-US/position/oVNTXfwi

   [jsmith] QA's views round 2 on modified train model

   [edwong] QA in the open: dev-quality is the primary public email list QA should be using for paid-staff and all contributors

   Know it's been mentioned in past, but can we clarify where qa@mozilla.com and qa@mozilla.org go? Is it all hooked up to the dev.quality newsgroup or what? [geo]

   this is outlined here: https://bugzilla.mozilla.org/show_bug.cgi?id=794762#c11

   Wow. that's kind of confusing. Wish we could kill both of the qa@ and make them aliases to dev-quality. [geo]

   [jsmith] We've been really bad about this - definitely agree we need to fix this problem.

   QAURGENT keyword is now available in Bugzilla. ( https://wiki.mozilla.org/QA/qawanted_proposal )

Notes, Takeaways and Action Items

   Today 

   Notes

   Action Items

   Last Meeting 

   Action Items