QA/StaffMeetings/QA-Staff-08-21-2013

From MozillaWiki
Jump to: navigation, search

Wednesday, August , 2013

# Every Weds @ 1:30p Pacific Time - Mozilla HQ, Warp Core 
#
# Vidyo:  https://v.mozilla.com/flex.html?roomdirect.html&key=nL4PESn1IaVh
# Phone:  +1 650 903 0800 or 650-215-1282 x92 Conf# 9245 (US/INTL)
#         +1 800 707 2533 (pin 369) Conf# 9245 (US Toll Free)
#         +1 416 848 3114 x92 Conf# 9245 (Canada)
# IRC:    irc://irc.mozilla.org:6697/#qa

QA Org Items


   QA Show and Tell
   This week:
   https://wiki.mozilla.org/QA/Show-and-Tell#Schedule
   Vaidik!
   Next week: (Aaron Train) Appthwhack! - http://appthwack.com/
   New Hires & Interviews 


   Upcoming Events/Conferences 
   [geo] Performance Meetup, Toronto, Aug 26 - 30
   B2G work week, Oslo, Sept 7 - 15
   https://wiki.mozilla.org/FxOS/Oslo_2013-09-06
   Stability workweek - Aug 19 - 23 in Mt. View


   Notices
   Next week is Samvedana's last week -- please thank her for contributions to Metro Firefox, SocialAPI, Windows 8.1 compatability, and Mozmill Tests


Travel / PTO


   [juanb] PTO Aug 8 - 26
   [jammink] TRIBES training, Toronto, Aug 28 - Sept 1
   [zac] PTO Aug14-Sept 2nd holiday w/some work
   [jsmith] PTO Aug 22nd - 23rd
   [jbonacci] floater PTO Aug 23
   [rbillings] PTO Sept 2-13 
   [tony] - work from seattle aug 29, 30, PTO, aug 28
   [tony] - PTO sept 5- 10 
   [mbrandt] - Stability work from MV Aug 19th - 23rd
   [tracy] - in MV 19th-22nd (traveling on the 18th and 23rd)
   [nhirata] - work from MV Aug 19th ~ 22nd ; work from seattle aug 29, 30
   [marcia]  PTO August 23
   [krupa] - working from India Sep 5-17th
   [delphine] PTO from August 26-Sep 3


QA Team Updates

Desktop (Juan)


   Firefox 
   23.0.1 shipped 8/16 to address WebRTC regression with a few unrelated ride-alongs
   https://wiki.mozilla.org/Releases/Firefox_23/Test_Plan#Firefox_23.0.1
   24.0.b4 shipped 8/20
   Tentative plan for beta10 of the fast beta cycles is to make beta10 RC1 instead. This is to potentially get more users in bake time so we can catch random things like the unreliably reproducable Radeon crasher.
   also considering ceasing the process of generating double RCs since this has failed to prevent us from shipping point releases
   Further post-mortem greatness:
   https://wiki.mozilla.org/Releases/Firefox_23/Test_Plan#Post-Mortem
   ESR (mwobensmith) 



   Stability (marcia) 
    Work week in progress. session notes: https://etherpad.mozilla.org/StabilityWeek2013-Notes
    23.0.1 - Radeon crash fixed.  Also Relevant knowledge blocklisting change is workiing.


   Automation (ashughes)


   Security (mwobensmith)
   CSP, MCB, other acronyms


   Community 


Mobile (Tony)

   Firefox for Android (Kevin/Aaron) 
   new about:home landed on m-c; focus of testing now
   http://lucasr.org/2013/08/21/revamped-ui-in-firefox-for-android/
   Loss of functionality
   UI breakage
   meeting tomorrow to discuss fate of WebRTC on Fx24 (Beta)
   Fx23 deployed also to korean tstore
   http://www.tstore.co.kr/userpoc/game/viewProduct.omp?insProdId=0000385058
   Stability (kbrosnan) 
   https://wiki.mozilla.org/CrashKill/2013-08-19#Mobile
   B2G (Geo/jhammink) 
   Swaroopa last day yesterday
   highlights: B2G Notifications, automated l10n screenshot work, 1.1HD testing, and tons of other great work!   
   1.2 testing is starting with Nexus 4, TCL phones
   need to work with UI automation for device coverage
   Joint presentation on QA/A-team work and goals for quality at the Oslo WW. (Jason, John, Jonathan)
   Functional team weekly updates - https://etherpad.mozilla.org/gaia-meeting-notes
   Stability (nhirata)
   https://wiki.mozilla.org/CrashKill/2013-08-19#B2G
   Stability work week happening
   [nhirata] Browser:
   blockers for testing:
   Bug 895480, Bug 821519, Bug 895484 Need receivers for Share (URL) web activities
   suggested by jsmith to create webapp
   need the time to do this
   Bug 905831 - [Browser] Searching for words in the URL bar is not giving a search results 
   Bug 906231 - Please create an update channel for Hamachi to go to 1.2 
   Need Nexus 4 / Helix for HD graphics testing; Nexus 4 for device testing
   Wasabi for CDMA testing (belayed)
   [jsmith] Media Recording API & Web Notifications API test planning, exploratory testing, automation dev
   API Compatibility test suite
   Positive feedback: FMradio & Geolocation feedback from 3rd party
   Device Storage tests in flight
   [mwargers]: workaround to get xul/xbl mochitests working
   bug 846090 -  XBL mochitests timing out/failing on b2g
   [mwargers]:  mochitest exception list cleanup for b2g  
   bug 901387  - b2g.json cleanup and  reorder
   Smoketest [marcia]
   1.2 Smoketest has moved from the Unagi Device to the Buri device
   https://bugzilla.mozilla.org/show_bug.cgi?id=907444 - Updates issue
   1.1 Leo Smoketest continues
   1.1 Unagi Sanity check continues (Dogfooding build)
   [jammink] Comms - Test Planning, Testcase Reviews, Exploratory Testing
   [jammink] Productivity - Starting to look into Productivity areas
   [jammink] General - Testcase cleanup and reorg in Moztrap
   [jammink] Automation - Starting work with L10 tool
   [jammink] Presentation - outlining and templating Quality presentation for Oslo WW
   Community Members Onboarding



Services (Edwin) Edwin will be working from home on Tue and Thu for the next few weeks as he gets back into the swing of things post-baby.


   Identity
   train-2013.07.31 planned to go to production today. is live in production at 12:04PDT
   new train-2013.08.15 will go to stage today
   Mozilla IdP testing/deployment still stalled on blocker bugs.


   Services
   Testing of SimplePush continues.
   Campaign Manager in danger of becoming a "real product" with real QA needs.
   PiCL is basically dead. It has been replaced by FF Accounts (FxA) and Sync 1.1 for the next several milestones leading up to "new" Sync v1.
   Dev an QA continues on FF Accounts (was picl-idp) API, client, and server.
   Big meeting tomorrow to figure out an accelerated schedule for Sync 1.1 Stage environment and, possibly, a separate "new" Sync Stage environment
   Tracking continues on Loads tool, Heka, etc.
   (jbonacci) I sent email to a handfull of QA team members with some quick information and links about "new" Sync. When this gets to regular Nightly releases in/on ELM, we will need help from Desktop and Mobile QA. Will also need some input from Tools and Automation...We should probably meet first week of September to discuss resources.


Web (Stephen)


   Our Selenium automation suites caught (and were affected by) a 5-star Persona issue https://github.com/mozilla/browserid/issues/3811, in production
   pull has been merged, pending hotfix to prod:
   https://github.com/mozilla/browserid/pull/3817


   B2G/Gaia testing:
   our first TBPL "bug": https://github.com/mozilla/gaia-ui-tests/issues/1262 - it's great to be on + visible, in TBPL
   (we needed to updated our calendar test due to an intended functionality change)
   back with Wi-Fi coverage again on both branches: https://github.com/mozilla/gaia-ui-tests/pull/1261
   Automation is largely stable (between 1 and 3 sporadic failures on both v1-train and master!)  and continues to find bugs
   http://qa-selenium.mv.mozilla.com:8080/view/B2G%20Unagi/job/b2g.unagi.mozril.gaia.master.ui/86/
   We're excited to hopefully soon be able to interact with security/modal dialogs:
   https://github.com/mozilla/gaia-ui-tests/pull/1265
   MMS test is in place:
   https://github.com/mozilla/gaia-ui-tests/blob/master/gaiatest/tests/messages/test_sms_with_attachments.py
   Vaidik's looking into augmenting our calling tests with http://plivo.com/


   Bouncer 
    now have a robots.txt on prod, with test coverage. Super-woot fantastic, the dev who wrote the feature supplied the pull request for the testcase
   https://github.com/mozilla/bouncer-tests/pull/37


   Engagement Projects 
   Another small release of Firefox Flicks went out
   Reps is working on updating foundation templates for CD


   Firefox Health Report
   Stability workweek this week - rewriting the testplan. Heavier emphasis on automation with a lower emphasis on manual regression testing (for web qa)
   workweek outcomes - https://etherpad.mozilla.org/StabilityWeek2013-Actions
   Firefox Marketplace 
   http://mzl.la/159ZWRj  went live on 08/20


   Mozilla.com 
    Our automation caught a pretty severe PHP/redirect issue
   https://bugzilla.mozilla.org/show_bug.cgi?id=906973 is just one example (there were 7 failing tests)
   Small changes lately to marketing banners, and a lot of underlying l10n


   Mozillians 
   Testing playdoh updates on staging - this will likely land on prod tomorrow, 8/21/2013
   Strong emphasis on user stories that take into account mobile users, the quarterly goal is to identify and implement features that support the upcoming summits
    https://bugzilla.mozilla.org/show_bug.cgi?id=902008
   Socorro 
    Stability workweek this week - a major rewrite of the testplan is occuring this week
   SUMO
   Have landed automated-test support for Persona integration on SUMO: https://github.com/mozilla/sumo-tests/commit/48c9fefb5fc2da3bf0e8e1bb615abfef2ccc77ef
   which found a bad bug:
   https://bugzilla.mozilla.org/show_bug.cgi?id=905118 - [stage][browserid] Signing in from other pages always redirects user to home_page


   Community Members Onboarding
   Sasha Kruglov is a rockstar: https://github.com/sashakruglov?tab=activity
   roarange is working with Vaidik on Marketplace tests (Selenium/Python)


Community (Marcia)


   Projects 
   Open Badges
        The last day for submissions for General QA Participation Badge designs was Fri Aug 16, 2013. A total of 5 badge designs have been submitted:
       https://secure.flickr.com/photos/tags/mozqabadges/             
       https://secure.flickr.com/photos/99032178@N06/sets/72157634940903895/
       https://secure.flickr.com/photos/dinobiscuits/sets/72157634638799645/
       https://secure.flickr.com/photos/gilaadnir/sets/72157634610922798/
       https://secure.flickr.com/photos/100269221@N02/sets/72157635085039730/
       http://www.flickr.com/photos/100375890@N02/tags/mozqabadges/
   Upcoming Events 
   Mozilla Summit 2013 - Brussels/Toronto/Santa Clara
   Site Hosts wanted, especially in Brussels and Santa Clara: https://wiki.mozilla.org/Summit2013/Experiences/Site_Hosts. Track Stewards role has now been folded into Site Hosts role
   https://wiki.mozilla.org/Summit2013/TrackOwners - Sign up here if you are interested in being a Track Owner
   Your travel should be booked and your registration should be complete
   Mozilla Festival - London - October 25-27
   http://mozillafestival.org/


   Testdays (ashughes)
   Samvedana is working on a Metro Testday for next Friday, August 30
   Firefox for Android Test Day this Friday: https://quality.mozilla.org/2013/08/testday-for-firefox-for-android-24-beta/


   Video Work
   No update this week


   QMO.next (Raymond)
    Persona WordPress plugin


   Community Members Onboarding



Automation Development (Henrik, Dave)


   General
   Automation Development report week 33 2013: http://www.hskupin.info/2013/08/20/automation-development-report-week-33-2013/
   Johannes (:nebelhom) our new reviewer for mozdownload: https://groups.google.com/forum/#!topic/mozilla.dev.automation/n6c4-iRc6us


   Projects
   Mozmill 2.0
   3 bugs remaining to be fixed: http://mzl.la/1d2COdA
   We will create the new hotfix-2.0 branch soon, so that new features can land on master again
   Mozmill CI
   Workaround for mozmill-tests merge issues and mozmill-ci landed:
   https://groups.google.com/forum/#!topic/mozilla.dev.automation/btvuB2ezIZQ
   Work is happening to upgrade our Jenkins version to the latest LTS (will hopefully fix the high memory consumption)
   Starting with the next beta candidate builds we can test other locales than en-US via Pulse now (bug 805812)
   Ubuntu 13.04 VMs to be activated most likely tomorrow
   mozdownload
   Test harness and the first test has landed. Many thanks to Johannes (nebelhom)!


   MozTrap (Cameron)
    Working on 1.4.8 to add test case priority field.
   https://moztrap-dev.allizom.org
   Community Members Onboarding 

Roundtable/Discussion Items


   [tracy] Please make sure your team landing page on QMO is up to date and helpful in getting people involved in your active projects.  The WebQA team page is a good model to follow. (Services QA would be the opposite of WebQA then!) - we will work on it.
   QA event to follow the meeting!  https://etherpad.mozilla.org/qa-outting-signup


Notes, Takeaways and Action Items


   Today 
   Notes
   Action Items
   Last Meeting 
   Action Items