QA/MergeCompatibilityTesting: Difference between revisions

Jump to navigation Jump to search
no edit summary
No edit summary
Line 14: Line 14:
The merge compatibility testing will be conducted on each release channel (nightly, aurora and beta) 3-4 weeks following a channel software merge event. The compatibility testing is broken down into two distinct focus areas. The first area is web compatibility testing using a crowd-sourced approach.   
The merge compatibility testing will be conducted on each release channel (nightly, aurora and beta) 3-4 weeks following a channel software merge event. The compatibility testing is broken down into two distinct focus areas. The first area is web compatibility testing using a crowd-sourced approach.   


=== Web Compatibility Testing ===
== Web Compatibility Testing ==
;Desktop Firefox Web Compatibility 2011-08-16
;Desktop Firefox Web Compatibility 2011-08-16
* [https://docs.google.com/spreadsheet/ccc?key=0AvdU4bzekK2qdDRyRTBIWGtJNTFuNm1sd2FjYi01RXc&hl=en_US#gid=30 results spreadsheet]
* [https://docs.google.com/spreadsheet/ccc?key=0AvdU4bzekK2qdDRyRTBIWGtJNTFuNm1sd2FjYi01RXc&hl=en_US#gid=30 results spreadsheet]
Line 23: Line 23:
* [https://docs.google.com/spreadsheet/ccc?key=0AvdU4bzekK2qdFJCQ2VOY0V4WGhnZ2gyZ1MwLW9lTXc&authkey=CICAkvcH&pli=1#gid=29 results spreadsheet]
* [https://docs.google.com/spreadsheet/ccc?key=0AvdU4bzekK2qdFJCQ2VOY0V4WGhnZ2gyZ1MwLW9lTXc&authkey=CICAkvcH&pli=1#gid=29 results spreadsheet]


=== Platform Compatibility Testing ===
== Platform Compatibility Testing ==


Below is a configuration list of both core and graphics platforms that will be custom built and the tests run on them once the machines are created
=== 12-02-2011 Graphics Compatibility and Blocklist Testing ===


[https://docs.google.com/spreadsheet/ccc?key=0Aj-5ZZLSQ6mrdHZOSTl4ZE1tNkFfeThHUlNPckRrRHc&hl=en_US#gid=1 Machine Configuration Matrix]
Blocklist testing has been requested by Doug Sherk who did some change and code cleanup of the graphics blocklist feature.
<pre>
I've made some changes to driver blocklisting recently which hit every platform and enable a downloadable blocklist on them. There are tons of edge cases here which I don't have the hardware to test and I think this would benefit from a proper QA run; it would be pretty bad if there were mistakes here, since users could be blocked from features even if their drivers are fine, and others could be allowed to use features that are supposed to be blocked. This whole effort is done primarily to allow blocklisting Android devices, but as a side effect, other OS's can now use this system.
</pre>
 
* For reference here are the tickets relevant to this:
** https://bugzilla.mozilla.org/show_bug.cgi?id=668004
** https://bugzilla.mozilla.org/show_bug.cgi?id=699482
** https://bugzilla.mozilla.org/show_bug.cgi?id=704710
** https://bugzilla.mozilla.org/show_bug.cgi?id=689598
** https://bugzilla.mozilla.org/show_bug.cgi?id=700124


Below is a spreadsheet of the test cases that will be run on the configured machines.


[https://docs.google.com/spreadsheet/ccc?key=0Aj-5ZZLSQ6mrdEdBWUlvdkNGUU1kQTRNUUM3TWZWUEE&hl=en_US#gid=0 Merge Compatibility Test Definitions]


== Results ==
== Results ==


== Links and Resources ==
== Links and Resources ==
[https://wiki.mozilla.org/Blocklisting/Blocked_Graphics_Drivers https://wiki.mozilla.org/Blocklisting/Blocked_Graphics_Drivers]
[https://wiki.mozilla.org/Blocklisting/Testing https://wiki.mozilla.org/Blocklisting/Testing]
[https://docs.google.com/spreadsheet/ccc?key=0Aj-5ZZLSQ6mrdHZOSTl4ZE1tNkFfeThHUlNPckRrRHc&hl=en_US#gid=1 Machine Configuration Matrix]
Below is a spreadsheet of the test cases that will be run on the configured machines.
[https://docs.google.com/spreadsheet/ccc?key=0Aj-5ZZLSQ6mrdEdBWUlvdkNGUU1kQTRNUUM3TWZWUEE&hl=en_US#gid=0 Merge Compatibility Test Definitions]
1,285

edits

Navigation menu