QA/StaffMeetings/QA-Staff-04-24-2013

   April 24, 2013
# Every Weds @ 1:30p Pacific Time - Mozilla HQ, Warp Core 
#
# Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
# Phone:  +1 650 903 0800 or 650-215-1282 x92 Conf# 9245 (US/INTL)
#         +1 800 707 2533 (pin 369) Conf# 9245 (US Toll Free)
#         +1 416 848 3114 x92 Conf# 9245 (Canada)
# IRC:    irc://irc.mozilla.org:6697/#qa

QA Org Items

   New Hires & Interviews 

   Upcoming Events/Conferences 

   Jammink at SFHTML5 conference, April 25th; also invited to speak at MobileWebDevcon in Boston, July 16th

   mbrandt @ Telerik Test Summit, May 2 - 3

   Mozilla Reps Mexico, juanb presenting over Google Hangout, April 26 @ 11am.

   Notices

    Anthony Hughes will be late to this meeting indefintely (cannot join until 2pm PT due to competing commitment)

Travel / PTO

   [item here]

QA Team Updates

Desktop (Juan)

   Firefox 

    Firefox 21.0b4 candidates available for testing, planning to ship tomorrow

   ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/21.0b4-candidates/build1/

   New stub installers in QA's hands for testing.

   Firefox for Metro iteration #6 underway.

   ESR (mwobensmith) 

   Stability (marcia) 

    Desktop Stability Report: https://wiki.mozilla.org/Platform/2013-04-23#Stability

   http://arewestableyet.com/ might be of interest

   Automation (ashughes)

   WebRTC (jsmith)

   Working On

   Debugging media flow automation checking & Peer Connection FxAndroid automation failures

   Figuring out our automation story with TURN server

   Misc exploratory testing & QAWanted investigations

   Last Week

   Automation analysis - Media flow checking & FxAndroid support

   Misc exploratory testing on Desktop and FxAndroid

   Security (mwobensmith)

   Compatibility testing for mixed-content blocking feature

   Community 

Mobile (Tony)

   Issues 

   Fennec (Kevin/Aaron)

   libstagefright testing (h264)

   beta 4 qualification

    Stability (nhirata) 

    https://wiki.mozilla.org/CrashKill/2013-04-22#Mobile

   B2G (Geo/jhammink) 

   Stability (nhirata)

   https://wiki.mozilla.org/CrashKill/2013-04-22#B2G

   IOT  (jammink)

   Around 10 p1s, 18 p2s for CO  - 2 new p2s in tracker for VE - need to retest some issues with latest on ikura, since they are on very very old build (3/21)

   pre-certification test plan?  We have specs from carrier.

   Test runs http://pastebin.mozilla.org/2344048

   1.1. test run in progress

   1.0.1 test run completed last week 

   still need to mine bugs from this and triage

   Review testrun for new cases completed; testcases not updated

    Madrid Work Week

   jsmith fixed a tef+ bug!

   Partner Customization Testing is under way for preinstalled apps

   Platform

   Another pass by Martijn on the mochitest exclude list has us up to 215K mochitests running: https://bugzilla.mozilla.org/show_bug.cgi?id=860748

   Martijn also working on timeout changes, should enable another bunch of tests https://bugzilla.mozilla.org/show_bug.cgi?id=861850

   Luqman working on Device Storage tests https://bugzilla.mozilla.org/show_bug.cgi?id=861456 -- currently exploring code path coverage and making sure they actually test sd card access rather than /tmp access.

   David Clarke working on suite of Camera mochitests https://bugzilla.mozilla.org/show_bug.cgi?id=864621

   On-device API validation tests for CTS scoped, initial focus on verifying hardware interactions. http://bit.ly/moz-cts-planning

   Smoketest refinement

   A meeting will be scheduled next week to talk about refining the smoketests

   Community Members Onboarding

Services (Edwin) SignIn/PiCL Work Week 5/6-5/10 Team now has a Win8 Surface Pro to test Now contains 4 sub-teams: Sign In, PiCL, UP, B2G

   SignIn

   AWS integration next week

   yahoo-alias-fix deployment

   PiCL (Attached Services) planning

   Work continues on picl-server, picl-client, picl-android

   Discussions continue around design of authentication and how all this will look in FireFox (desktop/android)

   Services

   Karl spending 2 days of testing Heka 0.2

   James is tracking HW work in Services (PHX1 dbs) and the move to AWS

Web (Stephen)

   Affiliates 

    No updates

   B2G/Gaia testing:

   Highlights:

   Have commercial RIL Unagi builds (v1-train) on a regular basis now, hooking them up to our CI

   Have Leo (1.1), Inari, and Hamachi (1.0.1)

   Now testing Marketplace on dev

   sign in

   searching for free/paid apps (https://github.com/mozilla/gaia-ui-tests/pull/713)

   Found this week from automation:

   https://bugzilla.mozilla.org/show_bug.cgi?id=865255 - Apps reporting incorrect empty message when USB plugged in (basically, SD card status is broken over USB connections to Unagis)

   https://bugzilla.mozilla.org/show_bug.cgi?id=865279 - Adding bookmark to full homescreen does not create a new panel

   Nice way to track our activity via GitHub's API:

   https://github.com/mozilla/gaia-ui-tests/pulse

   Barriers/Blockers:

   xfailing 19 tests :-(

   New Marionette issues filed since last week:

   https://bugzilla.mozilla.org/show_bug.cgi?id=864296 - Marionette webelement.find_element(locator) returns values even if the webelement is no longer present on the page

   https://bugzilla.mozilla.org/show_bug.cgi?id=863608 - [B2G] Marionette error sending message to frame, frame opens/closes quickly

   https://bugzilla.mozilla.org/show_bug.cgi?id=863117 - After running a Gaia UI Test and locking, unlocking homescreen, UI shifts dramatically and unusably

   which looks like a potential dupe of https://bugzilla.mozilla.org/show_bug.cgi?id=859264 - Click's scroll into view is too aggressive on the Select wrapper

   (still) Having issues with cell data, and Taipei is investigating:

   https://bugzilla.mozilla.org/show_bug.cgi?id=853489 - Cannot connect to carrier after reboot during automated test

   looks like it might be a problem with the "modem"; triaging

   Several tests (clock, language, FTU/FTE, keyboard, others) are affected by https://bugzilla.mozilla.org/show_bug.cgi?id=859264 - Click's scroll into view is too aggressive on the Select wrapper

   regression from another Marionette fix

   Need https://bugzilla.mozilla.org/show_bug.cgi?id=853622 - need sendNativeTouchEvent to be able to replace more click() calls with tap()

   as it doesn't work everywhere

   Always up-to-date list of bugs affecting Marionette automation:

   bugs blocking that are in https://bugzilla.mozilla.org/show_bug.cgi?id=801898

   Bouncer 

    no updates

   Engagement Projects 

    Firefox Flicks was updated with the first Early Entry Video winner: https://firefoxflicks.mozilla.org/en-US/    [also new partners and winners pages]

   New release for ReMo with new events by categories, plus bug fixes: https://reps.mozilla.org/

   Firefox Marketplace 

    Krupa's in her Payments work week

   Mozilla.com 

    no pushes this week

   Mozillians 

    Several issues with the dev cluster - https://bugzilla.mozilla.org/show_bug.cgi?id=864422

   MDN 

    http://bit.ly/UbALKp

   Socorro 

    Milestone 43 successfully released on 04.24.2013

   https://bugzilla.mozilla.org/buglist.cgi?query_format=advanced&target_milestone=43&product=Socorro&list_id=6390000

   SUMO 

    added new coverage for critical click-paths for logged-in contributors to SUMO

   https://github.com/mozilla/sumo-tests/pull/189

   Community Members Onboarding

Community (Marcia)

   Mozilla Reps are growing...

   There are now over 400 Mozilla Reps! https://reps.mozilla.org/

   Projects 

    One and Done - https://wiki.mozilla.org/QA/Taskboard [pragmatic] Work has started on creating a wizard for gently guiding newbie contributors towards their possible area of interests.

   Meetup.com QA Meetup for May - could get contributors to test upcoming features (see https://quality.mozilla.org/2013/04/webrtc-testing-try-out-conversat-io-with-other-users-and-file-bugs/ ) or create test cases

   Upcoming Events 

    Summit2013 - https://etherpad.mozilla.org/2013-mozilla-summit

   Community Nominations have concluded. A set of stewards is now reviewing the list of individuals who indicated interest in coming by adding themselves to the Summit2013 group

   Mozilla Summit Assembly will be held June 14-16 in the Paris office.

   If there is interest, we can try to plan some kind of QA event as a separate event to involve new community in the Summit Cities

   Mozilla Festival (London, early November)

   Zac and Marcia brainstormed a bit regarding some possible topics. Anyone interested in being involved in doing something there please let Marcia or Zac know.

   Open Badges Presentation by Emily Goligoski on May 2, 2013 at noon (Everyone should have a calendar entry in place for this event)

   Reminder: Review https://docs.google.com/spreadsheet/ccc?key=0AsHml-k4XnX7dG1tV0JLTE1yZjJlM2RqaVdfS24zX0E#gid=0 prior to the event.

   Testdays (ashughes)

    Firefox 21 Beta 4 Test Day 

   https://quality.mozilla.org/2013/04/firefox-21-0-beta-4-testday-april-26th/

   Video Work

    No update this week

   QMO.next (Raymond)

   appsec is actively reviewing dev instance with Persona plugin and Buddy Press removal

   https://bugzilla.mozilla.org/show_bug.cgi?id=851679

   working on a fix to https://bugzilla.mozilla.org/show_bug.cgi?id=856649 (security bug)

   Community Members Onboarding

Automation Development (Henrik, Dave)

   General

    mozdownload 1.7 has been released (progress meter, retries)

   https://github.com/mozilla/mozdownload/blob/1.7/History.md#17--2013-04-24

   Big thank you to Johannes Vogel (:nebelhom) who worked most on this release!

   Projects

    Mozmill CI

   IT is working on the last network issues with the new Mac Minis (hopefully done by today)

   Once done I will connect the new machines and do testruns (if no failures are found we might want to have the transition next week)

   Mozmill-Tests

   Metro tests

   Awaiting feedback from Anthony and Juan which tests are applicable

   See long roundtable discussion of the automation meeting about Mozmill vs. Marionette

   https://wiki.mozilla.org/Auto-tools/Automation_Development/Meetings/130422#Roundtable

   MozTrap (Cameron)

   Community Members Onboarding 

Roundtable/Discussion Items

   [jsmith] JS Integration Tests (developer) vs. Gaia UI Tests (QA) contention and discussion

   [jsmith] Establishing a way to bring a global perspecsupertive and quality tracking for automation priorities

   [marcia] Any meetup topics for May? Email sent out previously regarding starting up meetups in Mt. View again

   [marcia] q2 goals - https://intranet.mozilla.org/QA/Q22013_QAgoals

   [jammink]  what should our level of engagement be in partner certificati on efforts?

   [geo] Luqman's last day is 4/30, be sure to say goodbye!

Notes, Takeaways and Action Items

   Today 

   Notes

   Action Items

   Last Meeting 

   Action Items 

Template for this document is here: https://etherpad.mozilla.org/qa-staff-template