QA/Fennec/WebRTC: Difference between revisions

Jump to navigation Jump to search
1,322 bytes removed ,  4 September 2013
no edit summary
No edit summary
Line 297: Line 297:
  | {{done|}}
  | {{done|}}
  | Caller: '''PASS''' <br> Callee: '''PASS'''  
  | Caller: '''PASS''' <br> Callee: '''PASS'''  
|-
|Nightly 26.0a1 (2013-09-03) (Android(4.0.3), Samsung Galaxy S2, Office WiFi)
|Nightly 26.0a1 (2013-09-03) (Android(4.1.2), LG Otimus 4x, Office WiFi)
| {{done|}}
| Caller: '''PASS''' <br> Callee: '''PASS'''
|-
|
|
| {{risk|}}
| Caller: <br> Callee:
|-
|
|
| {{risk|}}
| Caller: <br> Callee:
|-
|
|
|
| Caller:  <br> Callee:
|-
|
|
| {{risk|}}
| Caller:  <br> Caller:
  |-
  |-
  |
  |
|
| {{risk|}}
| Caller:  <br> Callee:
|-
|
  |  
  |  
  | {{risk|}}  
  | {{risk|}}  
Line 306: Line 336:
  |  
  |  
  | {{risk|}}  
  | {{risk|}}  
| Caller: <br> Callee:
|-
|
|
| {{risk|}}
| Caller:  <br> Callee:
|-
|
|
| {{risk|}}
| Caller:  <br> Callee:
|-
|
|
| {{risk|}}
| Caller:  <br> Callee:
|-
|
|
| {{risk|}}
| Caller:  <br> Callee:
|-
|
|
| {{risk|}}
| Caller: <br> Callee:
|-
|
|
| {{risk|}}
| Caller: <br> Callee:
|-
|
|
| {{risk|}}
| Caller: <br> Callee:
|-
|
|
| {{risk|}}
  | Caller: <br> Callee:  
  | Caller: <br> Callee:  
|-
|
|
| {{risk|}}
| Caller:  <br> Callee:
|-
|
|
| {{risk|}}
| Caller:  <br> Callee:
|-
|
|
| {{risk|}}
| Caller:  <br> Callee:
|-
|
|
| {{risk|}}
| Caller:  <br> Callee:
  |-
  |-
  |  
  |  
Line 315: Line 405:
  |  
  |  
  |  
  |  
  |
  | {{risk|}}
  | Caller:  <br> Callee:  
  | Caller:  <br> Callee:  
  |-
  |-
Line 321: Line 411:
  |  
  |  
  | {{risk|}}  
  | {{risk|}}  
  | Caller:  <br> Caller:  
  | Caller:  <br> Callee:  
  |-
  |-
|
  |
  |
| {{risk|}}
| Caller: <br> Callee:
|-
|
  |  
  |  
  | {{risk|}}  
  | {{risk|}}  
  | Caller:  <br> Callee:  
  | Caller:  <br> Callee:  
   
  |-
  |}
  |}


Line 336: Line 431:
Test Case Steps
Test Case Steps


# Go to a webrtc test site on the browser under test on device A under a target network configuration
# Go to apprtc.appspot.com on the browser under test on device A under a target network configuration
# Accept permissions for camera/microphone for device A
# Accept permissions for camera/microphone for device A
# Go to the apprtc URL generated in step 1 on the browser under test on device B under a target network configuration
# Go to the apprtc URL generated in step 1 on the browser under test on device B under a target network configuration
Line 354: Line 449:
  | Mountain View Mozilla Wifi with Samsung Galaxy Nexus on Android 4.2
  | Mountain View Mozilla Wifi with Samsung Galaxy Nexus on Android 4.2
  | Mountain View Mozilla Wifi with Samsung Galaxy S3 on Android 4.3
  | Mountain View Mozilla Wifi with Samsung Galaxy S3 on Android 4.3
  | Call establishes on apprtc.appspot.com. Video/audio latency is extremely bad to the point of being unusable from start to end of the call (e.g. chopped up syllables, choppy video).
  | Call establishes. Video/audio latency is extremely bad to the point of being unusable from start to end of the call (e.g. chopped up syllables, choppy video).
  |  
  |  
  |-
  |-
Line 363: Line 458:
  |  
  |  
  |-
  |-
  | AaronMT
  |  
  | Toronto Mozilla Wifi with Samsung Galaxy S4 on Android 4.3
  | Toronto Mozilla Wifi
  | Toronto Mozilla Wifi with LG Nexus 4 on Android 4.3
  | Toronto Mozilla Wifi
  | Call establishes, no audio/video latency on apprtc.appspot.com
  |  
  | Call establishes, no audio/video latency on apprtc.appspot.com
  |  
  |-
  |-
  | AdrianT
  | AdrianT
  | Romania SV Wifi with Samsung Galaxy Tab 2 on Android 4.1
  | Romania SV Wifi with Samsung Galaxy Tab 2 on Android 4.1
  | Romania SV Wifi in Romania with Samsung Galaxy Note on Android 4.0
  | Romania SV Wifi in Romania with Samsung Galaxy Note on Android 4.0
  | Video freezes a lot and the audio is distorted at first and then starts to be more understandable but with ~2 min delay on apprtc.appspot.com
  | Video freezes a lot and the audio is distorted at first and then starts to be more understandable but with ~2 min delay.
  | Eventually managed to connect after a few tries. Audio is distorted and hard to understand but of better quality then on Firefox on apprtc.appspot.com
  | Eventually managed to connect after a few tries. Audio is distorted and hard to understand but of better quality then on Firefox
|-
| jsmith & AaronMT
| Verizon 4G Data with Samsung Galaxy Nexus on Android 4.2 in Mountain View
| Mozilla Toronto Wifi with Galaxy S4 on Android 4.3 in Toronto
| Call fails to establish on talky.io
| Call fails to establish on talky.io
|-
| jsmith & AaronMT
| Verizon 4G Data with Samsung Galaxy Nexus on Android 4.2 in Mountain View
| Mozilla-G Toronto Wifi with Galaxy S4 on Android 4.3 in Toronto
|
| Call fails to establish on talky.io
|-
| Tchung & AaronMT
| T-mobile office Guest Wifi with Galaxy Tab 3 10.1" on Android 4.2.2 in Mountain View
| Mozilla-G Toronto Wifi with Galaxy S4 on Android 4.3 in Toronto
| Tested on codeshare.io. We established audio/video on both ends for about 10 minutes of testing.  Audio seemed to lag ~5 seconds behind but would catch up.  a few times, audio came out robotic, but nothing too concerning.  Video was fairly smooth throughout the connection, as we were both walking around the building.  video transitions was usable and stability was good throughout the whole exercise.
| Tested on codeshare.io. (tried 2 different sites) I established my audio/video to Aaron, but never saw his audio/video back.  I did see him type realtime, so connection did establish
|-
| tchung & jsmith
| T-mobile office Guest Wifi with Galaxy Tab 3 10.1" on Android 4.2.2 in Mountain View
| Haxxor ateam wifi in Mountain View Office with Samsung Galaxy Nexus on Android 4.2
| Tested on codeshare.io. Call established. Call lasted a few minutes. Video came through smooth even when walking around, but audio fell behind overtime by up to 6 - 8 seconds and became more choppy as time passed.
| Tested on codeshare.io. Call didn't completely establish - I could see tchung's video, but he couldn't see me. Audio wasn't heard by either person, so we could not talk to each other at all.
  |}
  |}


Line 405: Line 476:
* WebRTC - Site Testing
* WebRTC - Site Testing
** [https://wiki.mozilla.org/QA/Fennec/WebRTC/Top_Site_Testing This document] provides an overview of how to do top site testing around WebRTC web applications, see [https://wiki.mozilla.org/QA/Fennec/WebRTC/Top_Site_Testing top site testing]
** [https://wiki.mozilla.org/QA/Fennec/WebRTC/Top_Site_Testing This document] provides an overview of how to do top site testing around WebRTC web applications, see [https://wiki.mozilla.org/QA/Fennec/WebRTC/Top_Site_Testing top site testing]
==Capturing Logs==
Nightly
* adb shell am start -a android.activity.MAIN -n org.mozilla.fennec/.App --es env0 NSPR_LOG_MODULES=mediamanager:5,signaling:5,mediastreamgraph:6,mtransport:5
Beta
* adb shell am start -a android.activity.MAIN -n org.mozilla.firefox_beta/.App --es env0 NSPR_LOG_MODULES=mediamanager:5,signaling:5,mediastreamgraph:6,mtransport:5


== Resources ==
== Resources ==
Confirmed users
798

edits

Navigation menu