Confirmed users
3,337
edits
(→Documentation: Link to new spreadsheet for Quantum performance metrics) |
(→Automation Review: Add Milan's email comment about testing accelerated Windows 8 and unaccelerated Windows 7) |
||
Line 105: | Line 105: | ||
== Automation Review == | == Automation Review == | ||
; Status | ; Status | ||
* Currently there are 138 failing reftests as of 2017-03-01 with WebRenderer enabled ([https://docs.google.com/spreadsheets/d/1DcqaMvt3I38HIl3-RDS_6aiX67nQWItNcwmVt5utbDk/edit#gid=0 tracking] - [https://bugzilla.mozilla.org/show_bug.cgi?id=1322815 metabug] - [https://wiki.mozilla.org/Platform/GFX/Quantum_Render#On_reftests wiki] - [https://treeherder.mozilla.org/#/jobs?repo=graphics treeherder]). Once these are fixed we'll want to run all reftests with WebRenderer enabled and with WebRenderer disabled which, since WebRenderer depends on e10s, we'll need to run the reftests 3x (non-e10s, e10s+WR, e10s-WR). | * Currently there are 138 failing reftests as of 2017-03-01 with WebRenderer enabled ([https://docs.google.com/spreadsheets/d/1DcqaMvt3I38HIl3-RDS_6aiX67nQWItNcwmVt5utbDk/edit#gid=0 tracking] - [https://bugzilla.mozilla.org/show_bug.cgi?id=1322815 metabug] - [https://wiki.mozilla.org/Platform/GFX/Quantum_Render#On_reftests wiki] - [https://treeherder.mozilla.org/#/jobs?repo=graphics treeherder]). | ||
** Once these are fixed we'll want to run all reftests with WebRenderer enabled and with WebRenderer disabled which, since WebRenderer depends on e10s, we'll need to run the reftests 3x (non-e10s, e10s+WR, e10s-WR). | |||
** During the transition, we need to test accelerated WebRender (Windows 8), accelerated DX11 (Windows 8) and unaccelerated (Windows 7). So, it isn't really doubling overall, just doubling the accelerated testing. | |||
* From a platform perspective we will only be concerned with Windows 7 Platform Update and later with D3D11 enabled. This means that, at least for now, we will not need to double-up tests on Mac, Linux, Android, and older Windows environments. However, this also means that we'll have to support doubling-up reftests until such time as we drop support for non-WebRenderer supported hardware/platforms. | * From a platform perspective we will only be concerned with Windows 7 Platform Update and later with D3D11 enabled. This means that, at least for now, we will not need to double-up tests on Mac, Linux, Android, and older Windows environments. However, this also means that we'll have to support doubling-up reftests until such time as we drop support for non-WebRenderer supported hardware/platforms. | ||