Loop/QA/Meetings:2014-06-12

From MozillaWiki
< Loop‎ | QA
Jump to navigation Jump to search

Attendees

Notices

  • Anthony Hughes will be on PTO June 25-July 2nd -- who can run the meeting?
    • Nils can do it

Previous Action Items

  • Anthony is working on getting an email alias set up for easier communication
  • Everyone please update the wiki with their project status
  • Ask Maire about submitting bug reports once landed in Nightly
    • Maire's answer: Yes, please go ahead and start filling bug - note: so far only the account less mode works
  • Ask TokBox about staging vs. production
  • Setup meeting with Adam and Edwin

High-level Project Status

Detailed Project Status

Please list the status for each section including any outstanding blockers, concerns, or questions that need to be addressed.

Platform

WebRTC

  • Syd is working on WebRTC testing wrt connection negotiation on different networks, building out infrastructure necessary

H264

Owner: Jason (CAF doing testing)

  • CAF is going to lead testing of H264 WebRTC support
    • CAF has the tools to test, Moz does not
    • jsmith will be Moz representative
  • Draft test plan built by CAF - sent out via email (~16 or so test cases for call workflows)

MSISDN

Owner: Martijn Wargers

  • No updates here - need to followup with mwargers to get working on this
  • Server: Peter/Jbo

Performance

Owner: Geo Mealer (FxOS) [need a co-owner] 6/12

  • FxOS Performance team interested in joining effort once we have a solid client app to test against, but probably not in the 2.0 timeframe. In the meantime, can concentrate on system-level session quality metrics available from session stats, but need to drive this separately from the main perf effort.
  • https://github.com/mozilla-b2g/firefoxos-loop-client can possibly be instrumented, but still need to resolve jsmith's concern re: representative system from last week
  • For overall cross-platform, would be nice to converge with tiger-team/WebRTC desktop effort to do session quality tests since the basic goals there are identical. Need to nail down timetable with sydpolk to understand feasibility.

6/5

  • FxOS performance strategy still needs definition. Some ideas have been raised in an initial roadmap meeting, but we haven't narrowed down to what we can actually feasibly do in near-term.
  • Have planning meeting w/ FxOS Performance team manager to determine what level of involvement the FxOS perf team intends to take, both prior to having a testable client and after.
  • May initially want to focus on some of the system-level metrics (connection, SNR, delay, etc.) that were brought up in the kickoff as they will primarily involve the WebRTC team and not rely on also coordinating w/ the perf team.
  • Per jsmith, need extremely customized FxOS/KitKat build to have anything near representative performance. Availability might be a blocker.
  • Also, need to determine owners for performance of other parts of the system. Geo has FxOS Performance, but probably can't support the entire perf strategy solo.

Privileged API

Owner: Jason Smith

  • Draft brainstorm of test cases for Audio Channel Privileged support
  • Need to work on test cases for other areas

Tokbox

Owner: Nils Ohlmeier

  • dmose is working on getting super basic functional tests of the desktop loop client up and running.
  • Moz Dev wants automated tests running through TokBox infrastructure
  • Email introduction to TokBox QA has been made and we are trying to setup an initial meeting
  • TokBox agreed that we can run basic automated test on their production systems
  • Initial meeting with TokBox QA was interesting and helpful. We covered
    • Basic understanding of what each party is testing so far
    • Agreed on basic communication/interaction plans
    • Made plans for getting each other convenient access to resources like email alias etc
  • TokBox QA told us at our meeting that the Mozilla TokBox installation is separate from their other customers. Never the less the QA folks want to give us another test system or give us access to their own dev installation for any automated CI tests.

Desktop

Owner: Anthony Hughes

  • Starting on developing smoketests, bug reporting process so people can start dogfooding now that Loop MLP has landed in mozilla-central
  • Question[edwong]: When should we log bugs? Team: Let's coordinate with Dev before we unleash a flood of bugs.

Firefox OS

Owner: Jason Smith

  • TEF has a draft test plan of the mobile client (~550 test cases) for each user story
  • See H264, MSISDN, and Privileged API for further updates
  • Actively working with TEF to build test plans for Loop OS dependencies in Comm Apps
  • Need to chase mwargers down on MSISDN
  • Working on privileged API test plan
  • Question[edwong]: will fxOS2.0 ship with this app? does it use Settings level account?
    • Loop mobile client app will only ship as a marketplace app - not part of the operating system or a customization

Server

Scalability

Owner: James Bonacci Loop-Server stage environment deployed just this week. This is a very basic deployment to start some load testing. There still needs to be some logging and other OPs changes that will need to happen soon. Size/Scale for AWS will not start happening till at least next week. Load testing is in progress this week and will continue next week. TokBox infrastructure testing may start next week (tied into our Stage environment and load test tool). Loop-Server prod environment is a WIP but should be available for the Nightly requirements.

  • Question[edwong]: How is TokBox involved? Team: initial handshakes go through tokBox, at which, a decision will be made to use peer to peer or TokBox Proxy/Tunnel.

API

Owner: Peter deHaan

  • Submitted a few PRs against loop-client and loop-server
  • Looking into l10n (currently looks like "en" and "fr" are supported)
  • Looking into testing server API directly using cURL with valid/invalid values

Services

Firefox Accounts Integration

Owner: Richard Pappalardo

  • Plan is to leverage and adapt existing marionette JS testcase(s) for FMD, Settings, etc. that validate authentication on B2G
  • Testcases to cover additional features related to auth will be added as needed

Private Build/Repository

Who owns this?

  • Devs working on desktop client working from private repository due to Tokbox requirements
  • #media, dmose
    • "soon" - target is for 32
    • Something else being used instead of Simple Push temporarily
    • Simple Push target is for Fx34
    • Fx33 something else being used as temporary solution

Discussion

<add your discussion items below>

Action Items

Retrieved from "https://wiki.mozilla.org/index.php?title=Loop/QA/Meetings:2014-06-12&oldid=990651"