Confirmed users
35
edits
Media/WebRTC Audio Perf: Difference between revisions
Jump to navigation
Jump to search
no edit summary
No edit summary |
No edit summary |
||
| Line 39: | Line 39: | ||
#RTCP based analysis | #RTCP based analysis | ||
#Codec Configuration Variability Analysis | #Codec Configuration Variability Analysis | ||
## Sample Rate, Input and Output Channels, Reverse Channels, Echo Cancellation, Gain Control, Noise Suppression, Voice Activity Detection, Level Metrics, Delay, Drift compensation, Echo Metrics | |||
## Video Frame-rate, bitrate, resolutions | |||
#Hardware and Platform Variability Analysis | #Hardware and Platform Variability Analysis | ||
| Line 45: | Line 47: | ||
== Ongoing Work == | == Ongoing Work == | ||
== Audio Performance Framework. == | == Audio Performance Framework. == | ||
{{ | {{Bug|909524}} is ongoing effort to provide minimal components that serves as a good starting point | ||
for carrying out Peer Connection audio quality analysis as part of Mozilla's Talos framework | for carrying out Peer Connection audio quality analysis as part of Mozilla's Talos framework | ||
Below picture captures the test setup for reporting Perceptual Evaluation of Speech Quality (PESQ) | Below picture captures the test setup for reporting Perceptual Evaluation of Speech Quality (PESQ) | ||
scores for audio played through Peer Connection. | scores for audio played through the Peer Connection. | ||
[[File:AudioPerf-Setup.png|650px]] | [[File:AudioPerf-Setup.png|650px]] | ||
The idea here is to compute PESQ scores between | The idea here is to compute PESQ scores between the input audio file fed into the local Peer Connection and | ||
output audio audio file recorded at the play-out of the remote Peer Connection in a fully automated fashion. | output audio audio file recorded at the play-out of the remote Peer Connection in a fully automated fashion. | ||
Following sub-sections explain in details the various components for this setup. | Following sub-sections explain in details the various components for this setup. | ||
=== Talos === | === Talos === | ||
[[Talos]] is Mozilla's python performance testing framework that is usable on Windows, Mac and Linux. | |||
Talos provides automated way to start/stop Firefox , perform tests and capture results to be reported to the Mozilla's graphing server across various Firefox builds. | |||
Talos is used in our setup to run media tests along with other start-up and page-loader performance tests. | |||
=== MozCaptureStream and Peer Connection === | === MozCaptureStream and Peer Connection === | ||
=== Audio Tools - PulseAudio, Sox, PESQ === | === Audio Tools - PulseAudio, Sox, PESQ === | ||
=== Summary === | === Summary === | ||
=== Open Issues === | |||
=== TODO Feature List === | |||
== Open Issues == | |||
Analysis of tools and techniques for measuring WebRTC Audio Performance. | Analysis of tools and techniques for measuring WebRTC Audio Performance. | ||