QA/Platform/Graphics/Features/GPU Process: Difference between revisions

Jump to navigation Jump to search

QA/Platform/Graphics/Features/GPU Process (view source)

Revision as of 23:18, 13 April 2017

1,548 bytes removed ,  13 April 2017
→‎Beta
Line 702: Line 702:
|-
|-
| style="vertical-align:top" | Manual Test Coverage
| style="vertical-align:top" | Manual Test Coverage
| style="text-align:center; vertical-align:top" |  
| style="text-align:center; vertical-align:top" | {{done|}}
|
|
* Softvision mid-Beta sign-off via Testrail
* Softvision mid-Beta sign-off via Testrail
Line 709: Line 709:
|-
|-
| style="vertical-align:top" | Automated Test Coverage
| style="vertical-align:top" | Automated Test Coverage
| style="text-align:center; vertical-align:top" |  
| style="text-align:center; vertical-align:top" | {{done|}}
| Coverage limited to process instantiation. Risks to be mitigated via manual testing.
| Coverage limited to process instantiation. Risks to be mitigated via manual testing.
|-
|-
| Performance Test Coverage
| Performance Test Coverage
| style="text-align:center; vertical-align:top" |  
| style="text-align:center; vertical-align:top" | {{done|}}
|  
|  
* Passmark benchmark completed by Softvision
* Passmark benchmark completed by Softvision
Line 722: Line 722:
|-
|-
| style="vertical-align:top" | [https://mzl.la/2mGuyaD No unresolved blocker bugs] <br /> [https://mzl.la/2mGmR4k No untriaged bugs blocking Fx53]
| style="vertical-align:top" | [https://mzl.la/2mGuyaD No unresolved blocker bugs] <br /> [https://mzl.la/2mGmR4k No untriaged bugs blocking Fx53]
| style="text-align:center; vertical-align:top" |
| style="text-align:center; vertical-align:top" | {{done|}}
| <u>Bugs pending Firefox 53 status review:</u><br />
| <u>Bugs pending Firefox 53 status review:</u><br />
<bugzilla display="list">
<bugzilla display="list">
Line 735: Line 735:
|-
|-
| style="vertical-align:top" | [https://mzl.la/2lA94Lt No unverified fixed bugs]
| style="vertical-align:top" | [https://mzl.la/2lA94Lt No unverified fixed bugs]
| style="text-align:center; vertical-align:top" |
| style="text-align:center; vertical-align:top" | {{done|}}
|<u>Bugs pending Firefox 53 status review:</u><br />
|<u>Bugs pending Firefox 53 status review:</u><br />
<bugzilla display="list">
<bugzilla display="list">
Line 754: Line 754:
|-   
|-   
| style="vertical-align:top" | [https://mzl.la/2lY5Jdt GPU_PROCESS_LAUNCH_TIME_MS_2 distribution <= 3s]
| style="vertical-align:top" | [https://mzl.la/2lY5Jdt GPU_PROCESS_LAUNCH_TIME_MS_2 distribution <= 3s]
| style="vertical-align:top; text-align:center" |
| style="text-align:center; vertical-align:top" | {{done|}}
| ''Note: A value larger than 3s likely represents users failing to get GPU Process''
| ''Note: A value larger than 3s likely represents users failing to get GPU Process''
{| class="wikitable"
* 5th Percentile: 0.213s
! Percentile || 2017-03-13 || 2017-03-20 || 2017-03-27 || Net
* 25th Percentile: 0.342s
|-
* 50th Percentile: 0.605s
| 5th || 0.221s || 0.223s || 0.225s || +0.004s (+1.81%)
* 75th Percentile: 1.250s
|-
* 95th Percentile: 4.620s
| 25th || 0.343s || 0.351s || 0.354s || +0.009s (+2.62%)
* Thresholds: 90.67% @ 3s, 68.17% @ 1s
|-
| 50th || 0.574s || 0.651s || 0.617s || +0.043s (+7.49%)
|-
| 75th || 1.140s || 1.220s || 1.260s || +0.120s (+10.53%)
|-
| 95th || 4.020s || 4.430s || 4.560s || +0.540s (+13.43%)
|-
! 3s Threshold || 92.14% || 91.10% || 90.74% || -1.40%
|-
! 1s Threshold || 70.70% || 68.58% || 67.74% || -2.96%
|}
|-
|-
| style="vertical-align:top" | [https://mzl.la/2lXWWIA GPU_PROCESS_LAUNCH_TIME_MS_2 evolution doesn't regress]
| style="vertical-align:top" | [https://mzl.la/2lXWWIA GPU_PROCESS_LAUNCH_TIME_MS_2 evolution doesn't regress]
| style="vertical-align:top; text-align:center" |
| style="text-align:center; vertical-align:top" | {{done|}}
| ''Note: A value larger than 3s likely represents users failing to get GPU Process''
| ''Note: A value larger than 3s likely represents users failing to get GPU Process''
{| class="wikitable"
* 5th Percentile: 0.219s
! Percentile || 2017-03-13 || 2017-03-20 || Net
* 25th Percentile: 0.325s
|-
* 50th Percentile: 0.496s
| 5th || 0.225s || 0.225s || ---
* 75th Percentile: 0.936s
|-
* 95th Percentile: 3.210s
| 25th || 0.349s || 0.355s || +0.006s (+1.72%)
|-
| 50th || 0.603s || 0.625s || +0.022s (+3.65%)
|-
| 75th || 1.240s || 1.290s || +0.050s (+4.03%)
|-
| 95th || 4.470s || 4.600s || +0.130s (+2.91%)
|-
|}
|-
|-
| style="vertical-align:top" | [https://sql.telemetry.mozilla.org/dashboard/gfx-gpu-process-crashes Telemetry graphics crash count/rate largely unchanged]
| style="vertical-align:top" | [https://sql.telemetry.mozilla.org/dashboard/gfx-gpu-process-crashes Telemetry graphics crash count/rate largely unchanged]
| style="text-align:center; vertical-align:top" |
| style="text-align:center; vertical-align:top" | {{done|}}
|
|
{| class="wikitable"
* Crash Rate Average: 0.067 crashes per 1,000 usage hours
! || 2017-03-13 || 2017-03-20 || 2017-03-27 || Net
* Crash Count Average: 603 crashes / day
|-
* Crash Count Percent: 0.389%
| Crash Rate Average || 0.130 || 0.099 || 0.091 || -30.0%
|-
| Crash Count Average || 536 || 647 || 714 || +33.2%
|-
| Crash Count Percent || --- || 0.55% || 0.47% || -0.07%
|}
|-
|-
| style="vertical-align:top" | [https://crash-stats.mozilla.com/topcrashers/?product=Firefox&version=53.0b&days=28&process_type=gpu No unresolved topcrashes correlated to GPU Process]
| style="vertical-align:top" | [https://crash-stats.mozilla.com/topcrashers/?product=Firefox&version=53.0b&days=28&process_type=gpu No unresolved topcrashes correlated to GPU Process]
| style="text-align:center; vertical-align:top" |  
| style="text-align:center; vertical-align:top" | {{done|}}
|  
|  
<u>GPU crashes rank 13th overall @ 0.34% with a combined 2,295 reports</u><br />
<u>GPU crashes rank 13th overall @ 0.34% with a combined 2,295 reports</u><br />
Line 816: Line 790:
|-
|-
| style="vertical-align:top" | Telemetry Experiment reveals no regressions in A/B testing
| style="vertical-align:top" | Telemetry Experiment reveals no regressions in A/B testing
| style="text-align:center; vertical-align:top" |  
| style="text-align:center; vertical-align:top" | {{done|}}
| DONE - https://ashughes.com/?p=426
| DONE - https://ashughes.com/?p=426
* [https://bsmedberg.github.io/telemetry-experiments-dashboard/ Experiment stats]
* [https://bsmedberg.github.io/telemetry-experiments-dashboard/ Experiment stats]
Line 825: Line 799:
|-
|-
| style="vertical-align:top" | [https://people-mozilla.org/~danderson/moz-gfx-telemetry/www/#view=windows-features Insignificant change in hardware acceleration distribution]
| style="vertical-align:top" | [https://people-mozilla.org/~danderson/moz-gfx-telemetry/www/#view=windows-features Insignificant change in hardware acceleration distribution]
| style="text-align:center; vertical-align:top" |
| style="text-align:center; vertical-align:top" | {{done|}}
|  
|  
GPU Process Status:<br />
GPU Process Status:
<pre>
* 47.3% Unavailable
Date        Available  Unavailable   Failed  Blocked
* 33.2% Unused
2017-03-13      39.1%        60.7%    0.2%     0.0%
* 19.4% Available
2017-03-20      35.4%         64.4%    0.1%      0.0%
D3D11 Status:
2017-03-27      34.3%        65.5%    0.1%      0.0%
* 71.7% D3D11
======================================================
* 26.7% Basic (software)
Net            -4.8%        +4.8%    -0.1%      ---         
* 1.60% D3D9
</pre>
Media Decoder Status:
D3D11 Status:<br />
* 56.7% WMF (software)
<pre>
* 25.6% D3D9
Date        Available  Unavailable  Failed  Blocked  Blacklisted
* 17.7% D3D11
2017-03-13      51.5%        10.7%     4.5%      1.3%        14.6%
2017-03-20      50.2%          9.3%    4.5%      1.4%        14.6%
2017-03-27      48.9%          7.4%    4.7%      1.3%         14.9%
====================================================================
Net            +2.6%        -3.3%    +0.2%      ---          +0.3%
</pre>
Media Decoder Status:<br />
<pre>
Date        DXVA D3D9  DXVA D3D11  WMF Software
2017-03-13      24.8%        14.4%          60.8%
2017-03-20      24.1%        15.6%         60.3%
2017-03-27      24.8%       18.4%          56.8%
==================================================
Net              ----%        +4.0%          -4.0%   
</pre>
|-
|-
| style="vertical-align:top" | [https://mzl.la/2neFmgk SIMPLE_MEASURES_FIRSTPAINT does not regress more than 5%]
| style="vertical-align:top" | [https://mzl.la/2neFmgk SIMPLE_MEASURES_FIRSTPAINT does not regress more than 5%]
| style="text-align:center; vertical-align:top" |
| style="text-align:center; vertical-align:top" | {{done|}}
|  
|  
<pre>
* Median: 2.926s
Median   Change
* 15.9% improvement vs Firefox 52
Beta 53        3.190s    ----   
* 18.4% improvement vs Firefox 51
Beta 52        3.480s    8.33% Improvement
* 2.46% improvement vs Firefox 50
Beta 51        3.630s    12.12% Improvement
Beta 50        3.000s    6.33% Regression
</pre>
''Note: even if it does regress it'll be hard to prove that it's GPU Process related and not some other change(s)''
''Note: even if it does regress it'll be hard to prove that it's GPU Process related and not some other change(s)''
|-
|-
Line 870: Line 826:
|-
|-
| Okay to Merge to Release
| Okay to Merge to Release
| style="text-align:center; vertical-align:top" |  
| style="text-align:center; vertical-align:top" | {{done|}}
| DONE
| DONE
|-
|-
| Release migration signed-off
| Release migration signed-off
| style="text-align:center; vertical-align:top" |
| style="text-align:center; vertical-align:top" | {{done|}}
| DONE
| DONE
|-
|-
| Release notes signed-off
| Release notes signed-off
| style="text-align:center; vertical-align:top" |  
| style="text-align:center; vertical-align:top" | {{done|}}
| DONE
| DONE
|-
|-
Ashughes
Confirmed users
14,525

edits

Retrieved from "https://wiki.mozilla.org/Special:MobileDiff/1168318"

Navigation menu