QA/Loop/Firefox 34: Difference between revisions

Line 2: Line 2:
== Checklist ==
== Checklist ==
* {{done|}} [[QA/Loop/Firefox_34/Aurora_Uplift|Pre-uplift sign-offs using the Fig branch]]
* {{done|}} [[QA/Loop/Firefox_34/Aurora_Uplift|Pre-uplift sign-offs using the Fig branch]]
* {{ok|}} All use cases covered by Moztrap smoketests


=== Use Case Coverage ===
== Smoketesting ==
Guest Mode
=== Guest Mode ===
==== Tests ====
* Conduct a 1:1 call via Copy
* Conduct a 1:1 call via Copy
* Conduct a 1:1 call via E-mail (Thunderbird, Outlook, Mail.app, Gmail, Yahoo Mail, Hotmail, Mail.ru)
* Conduct a 1:1 call via E-mail with Thunderbird as the default email handler
* Do not disturb mode on/off (clear icon)
* Conduct a 1:1 call via E-mail with Outlook as the default email handler
* Pop-out/in the conversation window
* Conduct a 1:1 call via E-mail with Mail.app as the default email handler
* Minimize/maximize the conversation window
* Conduct a 1:1 call via E-mail with Gmail as the default email handler
* Terms of Service
* Conduct a 1:1 call via E-mail with Yahoo Mail as the default email handler
* Privacy Policy
* Verify entering do-not-disturb mode changes the button appearance and prevents receiving a call
* Sign in to Firefox Account (blue icon)
* Verify entering available mode changes the button appearance and resumes the ability to receive a call
* View account information via gear icon
* Verify the conversation window can be popped out and in without affecting the call
* Sign out via gear icon
* Verify the conversation window can be minimized and maximized without affecting the call
* Verify you can view the Terms of Service via the link in the panel on first run
* Verify you can view the Privacy Policy via the link in the panel on first run
* Verify you can sign in to a Firefox Account via the link and/or the gear menu, username should appear in the panel and the icon should turn blue momentarily
* Verify you can view your account information via the gear icon
* Verify you can sign out of your account via the gear icon
* Verify navigating away from the call page should be treated as a disconnect
* Verify you can submit various types of feedback when the call ends
* Verify you see an error notification when the network is disconnected
* Verify you can generate a call URL and have a call when the network is reconnected


Standalone Page
==== Platforms ====
* Tests
* Firefox 34 en-US on Windows XP on ethernet
** URL displayed on page should match the URL in the location bar
* Firefox 34 de on Windows Vista on wifi
** Start and conduct a video call
* Firefox 34 es-ES on Windows 7 on ethernet
** Start and conduct a voice call
* Firefox 34 zh-TW on Windows 8 on wifi
** Mute/unmute video during a call
* Firefox 34 ru on Windows 10 on ethernet
** Mute/unmute audio during a call
* Firefox 34 en-US on Mac OS X 10.9 on wifi
** Submit feedback
* Firefox 34 ja-JP on Mac OS X 10.10 on ethernet
* Call from Firefox (Ethernet, WiFi)
* Firefox 34 en-US on Ubuntu 14.04 on wifi
* Call from Chrome (Ethernet, WiFi)
* Firefox 34 he on Ubuntu 12.04 on ethernet
* Call from Internet Explorer (Ethernet, WiFi)
* Call from Safari (Ethernet, WiFi)
* Call from Opera (Ethernet, WiFi)
* Call from Firefox for Android (3G, 4G, WiFi)
* Call from Chrome for Android (3G, 4G, WiFi)
* Call from Android browser (3G, 4G, WiFi)
* Call from Firefox OS browser (3G, WiFi)


=== Standalone Page ===
=== Standalone Page ===
Line 47: Line 49:
** If the build is localized, so too should the page
** If the build is localized, so too should the page


==== Callers ====
==== Coverage ====
Firefox
Firefox
* Windows XP en-US on ethernet
* Firefox 32 en-US on Windows XP on ethernet
* Windows 8 de on wifi
* Firefox 33 de on Windows 8 on wifi
* Mac OS X 10.9 ja-JP on ethernet
* Firefox 34 ja-JP Mac OS X 10.9 on ethernet
* Ubuntu 14.04 zh-TW on wifi
* Firefox 35 zh-TW Ubuntu 14.04 on wifi
* Android 4.4 en-US on 3g
* Firefox 32 en-US on Android 4.4 on 3g
* Android 4.4 en-US on wifi
* Firefox 35 en-US on Android 4.3 on wifi
* B2G 2.0 en-US on wifi
* B2G 2.0 en-US on wifi
* B2G 2.0 en-US on 3g
* B2G 2.0 en-US on 3g
Line 88: Line 90:
* Android 4.4 on 3g
* Android 4.4 on 3g


=== Smoketesting ===
=== Exploratory Testing ===
* Client functionality testing across all platforms
The following should be tested on all platforms (Windows, Mac, and Linux):
* Standalone UI testing to include Firefox, Chrome, Opera, Safari, and Internet Explorer
* Try crashing the browser during a call and see if you can restart the call using the same URL
* Basic testing to include Desktop -> B2G call
* Try moving the call tab to another browser window
* Server-side testing to include FHR, error handling
* Try moving the call window to another screen
* Platforms: ALL
* Try changing the screen resolution during a call
* Locales: en-US, de, ...
* Try switching between speakers and headphones during a call
* Try switching between an integrated camera to a USB camera during a call
* Try testing in networks with different firewall applications installed


Exploratory Testing
=== End-to-End Automation ===
* Load testing the servers
* Different network configurations
 
End-to-end Test
* {{ok|}} Automated test is running locally (2014-09-29: ewong)
* {{ok|}} Automated test is running locally (2014-09-29: ewong)


Fix Verifications
=== Fix Verifications ===
* 0 fixed bugs without a qe-verifyme flag
* 0 fixed bugs without a qe-verifyme flag
* 0 qe-verifyme+ flagged bugs exist as RESOLVED FIXED
* 0 qe-verifyme+ flagged bugs exist as RESOLVED FIXED
Line 114: Line 114:
* Server
* Server
* Services
* Services
{| class="wikitable"
! Component
! QA Contact
! Tracking Bug
! Health
! Details
|-
| [[QA/Loop/MSISDN|MSISDN]]
| Martijn Wargers
| {{bug|988469}}
| Aurora: ''health''
| ''detailed notes, blocking bugs, etc''
|-
|}
Confirmed users
14,525

edits