QA/Desktop Firefox/Features/Windows 10/June29-July3-QA-Status
From MozillaWiki
< QA | Desktop Firefox | Features | Windows 10
Contents
June29-July3 Windows 10 QA Status
QA Contacts
- Andrei Vaida (:avaida on irc, #qa), andrei.vaida@softvision.ro
- Cornel Ionce (:cornel_ionce, #qa), cornel.ionce@softvision.ro
Overall QA Health
| Date | Firefox (build) | Windows 10 (build) | Status |
|---|---|---|---|
| 2015-07-02 | 40.0a2 (2015-06-29) | Build 10158 (Pro, x64) | YELLOW (report) |
- YELLOW because
- The Tablet Mode issues are affecting the user experience on Windows 10 and several UI changes are still needed in order to ensure an overall compliance with the proposed theme.
- We didn't yet manage to test Tablet Mode/Continuum on our device.
- We do have a Dell ultrabook running on Win 10 and we plan to test on it next week
- We also have a Surface Pro 2 Tablet and we'll work with our IT to get Win 10 preview running on it so we can include it in our testing next week
- Very few issues were found affecting Windows 10 in particular:
Status ID Summary Severity VERIFIED 1179752 Location bar bottom border shouldn't be displayed next to the autocomplete pop-up normal RESOLVED 1179761 [Windows 10] Pinning and unpinning Firefox often results in a tile missing its icon normal RESOLVED 1179768 Increase the URL/search bar text size further on Windows 10 normal 3 Total; 0 Open (0%); 2 Resolved (66.67%); 1 Verified (33.33%);
- In terms of performance, the results displayed by the benchmarks we used are pretty close to those displayed by Windows 8.1 x64.
Risks & Issues
- [HIGH RISK] The issues related to Continuum / Tablet Mode are currently severely affecting eligible devices.
- [MEDIUM RISK] Another quality risk we've identified for Firefox 40 is the relatively large amount of bug fixes that are going to get uplifted there, periodically - though, based on the verification already performed on Firefox 41, we shouldn't see any major issues.
New bugs
| ID | Severity | Summary | Status | Resolution |
|---|---|---|---|---|
| 1179739 | normal | Errors are thrown in the Browser Console each time the user enters Customize | RESOLVED | DUPLICATE |
| 1179752 | normal | Location bar bottom border shouldn't be displayed next to the autocomplete pop-up | VERIFIED | FIXED |
| 1179754 | normal | [Windows] Unable to access window controls after entering full screen | RESOLVED | WORKSFORME |
| 1179761 | normal | [Windows 10] Pinning and unpinning Firefox often results in a tile missing its icon | RESOLVED | INVALID |
| 1179763 | S4 | [Windows] Both buttons from the plug-in doorhanger can be displayed as selected at the same time | RESOLVED | INVALID |
| 1179768 | normal | Increase the URL/search bar text size further on Windows 10 | RESOLVED | WONTFIX |
6 Total; 0 Open (0%); 5 Resolved (83.33%); 1 Verified (16.67%);
Known bugs
11 Total; 2 Open (18.18%); 6 Resolved (54.55%); 3 Verified (27.27%);
Accomplished This Week
Exploratory Testing
- Ran the UI/UX Acceptance Suite on Aurora 40.0a2 (2015-06-29), using Windows 10 Pro x64 Insider Preview (Build 10158) - results
General Performance
- Benchmarked Aurora 40.0a2 (2015-06-29) along with Edge and Chrome using Windows 10 Pro x64 Insider Preview (Build 10158) and compared the results with those from Windows 8.1 Pro x64 - detailed results.
Bug Fix Verification
- Verified the following bug fixes:
11 Total; 0 Open (0%); 0 Resolved (0%); 11 Verified (100%);
- We're currently tracking all the Windows 10-related uplifts and fixes in this etherpad.
Testing Activities Planned for the Upcoming Period
- Test Tablet Mode/Continuum using Beta 40.
- Triage the new bugs affecting Windows 10, in terms of testability/priority.
- Verify the new fixes landed/uplifted on Beta 40, for bugs affecting Windows 10.
- Run the Acceptance Test Suite on newer Windows 10 builds, i.e. 10162.
- Benchmark Firefox 40 using Dromaeo and make a comparison with Edge and Chrome in terms of performance.
Important Links and References
- Test Plan: ---
- QA Page: https://wiki.mozilla.org/QA/Desktop_Firefox/Features/Windows_10/
- Firefox UI proposed for Windows 10: http://people.mozilla.org/~shorlander/mockups/Windows-10/Windows-10.html
