Test Pilot/Meeting/2017-07-31

Meeting Details

• Every other Monday @ 9:30AM Pacific

• Dial-in: Audio-only conference# 98858
  • People with Mozilla phones or softphones please dial x4000 Conf# 98858
  • US/Toll-free: +1 800 707 2533, (pin 4000) Conf# 98858
  • US/California/Mountain View: +1 650 903 0800, x4000 Conf# 98858
  • US/California/San Francisco: +1 415 762 5700, x4000 Conf# 98858
  • US/Oregon/Portland: +1 971 544 8000, x4000 Conf# 98858
  • CA/British Columbia/Vancouver: +1 778 785 1540, x4000 Conf# 98858
  • CA/Ontario/Toronto: +1 416 848 3114, x4000 Conf# 98858
  • UK/London: +44 (0)207 855 3000, x4000 Conf# 98858
  • FR/Paris: +33 1 84 88 37 37, x4000 Conf# 98858
  • Gmail Chat (requires Flash and the Google Talk plugin): paste +1 650 903 0800 into the Gmail Chat box that doesn't look like it accepts phone numbers
  • SkypeOut is free if you use the 800 number
• "TestPilot" Vidyo room. Guest link: https://v.mozilla.com/flex.html?roomdirect.html&key=IhVRDY8lR7CVYxW8IO0A0Dljzc
• #testpilot for backchannel

General Topics / Roundtable

(Want to share a useful library? Blocked on something? Wondering how other experiment teams do something?)

• Changes to how we do metrics:
  • GA by default for new experiments
  • Standards for reporting: https://github.com/mozilla/testpilot/blob/master/docs/experiments/ga.md
  • Library to ease compliance with standards: https://github.com/mozilla/testpilot-ga
• The SDK will stop working really, really soon. Date TBD. Could be 8/2 or later (if we ask them to wait)
  • Signing requirements change on 8/2, new signing pipeline
• Contribute site is live! https://contribute.testpilot.firefox.com/
  • Please tag your issues appropriately.
  • If your project/repo/library is suitable and isn’t on here, holler.
  • Will eventually be sucked into Test PIlot itself, probably after the Photon redesign.

Friends of the Test Pilot team

(Give a shoutout/thanks to people for helping fix and test bugs in Test Pilot or experiments. Introductions for new contributors)

• Resolved bugs (excluding employees):
  • More than one bug fixed:

Project Updates

Test Pilot

(includes eng, UX, user research, product)

• SDK wackiness!

Add-ons

Activity Stream

• Activity Stream is in nightly
  • Integrated with Pocket recommendations in Nightly, check it out!
  • Might be behind an activity-stream or photon pref

Cliqz

Containers

• Shield
• Graduating to AMO
• Roughly EOQ for graduation?

Send (formerly Portal)

• Also lookin’ good
• 1.0 is in production https://send.firefox.com
  • Try it out!
• [UR] Will be monitoring in the first week for research questions to explore in next round of unmoderated research
• Hot new video: https://www.youtube.com/watch?v=ZGWZGYtAS3U

Min Vid

• Webextension conversion issue with YouTube API (thinking it may be a domain security issue)
• Need to bump the version number and push a release today signed by new cert

Firefox Notes (formerly Hoverpad)

• Hot new video: https://youtu.be/vaFvr_70yxw
• [UR] Will be monitoring in the first week for research questions to explore in next round of unmoderated research

Pulse

Screenshots

• We continue to march forward to release
• We’re discussing longer-term release processes
• Backed out full page shooting for now
• After release we’re focusing on performance improvements
• We're on in 50% of Beta
• Maintenance plan draft. comments welcome: https://docs.google.com/document/d/1CSzT45tpTRyDh3yiGCSOqcd74WDOJFTooiadKkXjFXY/edit

Snooze Tabs

• Likely graduating around EOQ, similar to containers

Tab Center

Voice Fill (formerly SpeakToMe)

• https://youtu.be/wjvM18UWMmM
• Mark Liang did some awesome UI patching last week 😃
• H/T Chuck for metrics work! 😃