Loop/QA

Summary

Links

• Screensharing
• Loop MLP
• MVP bugs
• Requirements document
• Project wiki

People

• Lead - TBD
• Desktop - TBD
• Mobile - TEF, ?
• Platform - Nils Ohlmeier
  • H264 - Paul Yang, Martijn Wargers
  • MSIIDN - Martijn Wargers
  • Performance - Geo Mealer, Syd Polk
  • Privileged API - TBD
• Server - Richard Pappalardo, Stuart Philp
• Services - Peter deHaan, Stuart Philp

Meetings

(these may be outdated)

Meeting	When	Where	Notes	Last Meeting
Project Status	11:30h Pacific on Tuesday	Shell Escalante's Vidyo room	Agenda
Partner Testing Coordination	09:30h Pacific on Wednesday	Shell Escalante's Vidyo Room
Tokbox Testing Coordination	14:00h Pacific on Wednesday	Opentok	Agenda

Tracking Bugs

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 406 [1] => Not Acceptable ) ) 1

Top-level Status

Milestones

By Firefox Version

• Firefox 32: Ship OpenH264
• Firefox 33: Ship Screensharing and Loop MLP
• Firefox 34: Ship Loop MVP

By Product Feature

• Screensharing via OpenH264: Begin testing in Firefox 32, ship in Firefox 33
• Loop MLP: 0 Open; 11 Resolved; 46 Verified; (target: Firefox 33)
• Loop MVP: 23 Open; 14 Resolved; 24 Verified; (target: Firefox 34)
• Server/Services:
• Mobile Client: B2G 2.0 via bug 1036490
• Platform:

Dashboards

• WebRTC Progress Overview
• Firefox 33 Product Changes
• Firefox 33 Platform Changes

Bugs Tracked for Loop MLP

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 406 [1] => Not Acceptable ) ) 1

Bugs Tracked for Loop MVP

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 406 [1] => Not Acceptable ) ) 1

Client

Desktop

Owner: TBD

• draft testplan
• Steps to pre-trial Loop
• https://wiki.mozilla.org/QA/WebRTC/Loop/MVP/Desktop_Client

Goals

• Target all Desktop platforms
• Target LAN, WiFi, and various NAT/Firewall configurations

Dogfooding

Follow these steps to start dogfooding the Desktop Loop client. If you have any questions, contact ashughes in #media on IRC (irc.mozilla.org) or ahughes@mozilla.com via email.

• Download, install, and start the latest Nightly
• Click the phone icon (you may need to enter Customize mode to add it)
• Create a call and share the URL with a friend
• Run these tests (or just play around with it until you break it)
• Report any issues, be sure to include the following information:
  • Operating system and version
  • Firefox version including build ID from about:support
  • Whether the bug reproduces on a new profile
  • Descriptive steps to reproduce the bug
  • Screenshots/screencasts if it helps illustrate the problem

Testing

The following will be tested as part of the sign-off of the Desktop Loop client for MVP.

• Features work as intended/described
  • Authentication/Registration using Firefox Accounts
  • User Identity
  • Contact list
  • Call history
  • Receiving and sending calls when authenticated or not
  • In-call controls (mute, full screen, etc)
  • URL handling (ex. callback)
  • Privacy/security controls
  • Accessibility - TO BE DETERMINED
  • Localization - TO BE DETERMINED
  • Switching between primary and fallback codec usage
  • Error handling pre-call, in-call
  • Post-call user feedback
  • Stress Test Coverage
    • Sending/receiving calls when device is under load
    • Sending/receiving calls when device has poor/intermittent connectivity
• MVP is performant across all supported platforms
• MVP is stable across all supported platforms
• Call quality is on par with traditional service (Skype, Vidyo, etc)
• Calling between desktop<->desktop, desktop<->mobile, firefox<->chrome, firefox<->opera
• Calling between different network types: Wifi, Ethernet, GSM, etc
• Limited automated tests are getting implemented bug 976116

Blockers

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 406 [1] => Not Acceptable ) ) 1

Mobile

Owner: TEF, TBD

• Mozilla/TEF Weekly Meeting Notes

Goals

• Target Firefox OS 2.0
• Target 2G (EDGE), 3.5G (HSPA), and open WiFI (MozGuest) networks

Testing

• TEF internal test plan -- Jason to review with Massimo to clarify gaps and to portion the testing based on Platform fixes

Blockers

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 406 [1] => Not Acceptable ) ) 1

Bugs

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 406 [1] => Not Acceptable ) ) 1

Platform

Tracked Bugs

H264 Support

Owner: Paul Yang, Martijn Wargers

Bugs

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 406 [1] => Not Acceptable ) ) 1

MSISDN Support

Owner: Martijn Wargers

• Test Plan
• Server-side code repository
• bug 988469 (loop_msisdn_verific) MSISDN verification API for privileged apps

Performance

Owner: Geo Mealer, Syd Polk

• Draft FxOS performance roadmap (rough, work-in-progress)

Testing

• Proposed scenarios
  • AV Sync performance over a 15 minute WebRTC call
  • CPU performance over a 1 minute WebRTC call
  • Power usage over a 1 minute WebRTC call
  • E2E latency over a 1 minute WebRTC call

Privileged API

Owner: TBD

Blockers

Bugzilla query error

Array ( [type] => error [message] => http-bad-status [params] => Array ( [0] => 406 [1] => Not Acceptable ) ) 1

Partner Backend

Owner: Nils Ohlmeier

• Meetings: Tuesday @ 2pm Pacific

Goals

• Various networked environments, including NAT and Firewalls (CAF to assist?)

Testing

• Tokbox test plan

Services

Owner: Stuart Philp

• Cloud Services project page

Scalability

Owner: Richard Pappalardo

Goals

• Three primary goals
  • Functional test of the Loop Server as deployed to the Stage environment (AWS stack)
  • Stability testing of the Stage environment
  • Size and Scalability testing of the Stage environment for capacity planning in Production

Testing

• All of the server-side testing has just started this week (first week of June). There are two parts of this testing:
  • Standard functional/stress testing using the Loads tool and cluster
  • Performance testing of the TokBox infrastructure using the Loads tool and cluster
• Loop-Server load test
  • https://github.com/mozilla-services/loop-server/tree/master/loadtests
• Test documentation - TBD
  • Currently all in text form - I will be creating/editing wikis similar to the following
    • https://wiki.mozilla.org/QA/Services/FxATestEnvironments
    • https://wiki.mozilla.org/QA/Services/TokenServerAndSyncLoadTesting
• Test Plan - N/A
  • But, I may create a test tracking bug, similar to the following:
    • https://bugzilla.mozilla.org/show_bug.cgi?id=968396

Blockers

• None at this time

Bugs

• Classification = Other
• Product = Loop
• Component = Server
• Bugzilla search: http://mzl.la/1iYe9Vn

API

Owner: Peter deHaan

Bugs

• Classification = Other
• Product = Loop
• Component = Server
• Bugzilla search: http://mzl.la/1iYe9Vn

Server/Scalability/API References

• https://github.com/mozilla-services/docs/blob/master/source/loop/apis.rst
• https://wiki.mozilla.org/Loop/Architecture
• https://docs.services.mozilla.com/loop/apis.html
• https://people.mozilla.org/~dhenein/labs/loop-docs/
• https://etherpad.mozilla.org/msisdnapi
• https://github.com/mozilla-services/msisdn-gateway/blob/master/API.md
• https://github.com/mozilla/fxa-auth-server/wiki/API-extensions-for-supporting-MSISDN-verification-in-FxA-auth-server

Firefox Accounts Authentication

Owner: Richard Pappalardo

Goals

• Validation and Stability of FxA Authentication Workflow

Testing

• New user authentication
• Existing user authentication
• Create B2G FxA test tool for client-side validation