Platform/Games/GameFocusedBenchmarking: Difference between revisions

Line 17: Line 17:
View [https://metrics.mozilla.com/bugzilla-analysis/Perfy-Overview.html Perfy-Overview.html] (requires LDAP) and click to drill down to details.
View [https://metrics.mozilla.com/bugzilla-analysis/Perfy-Overview.html Perfy-Overview.html] (requires LDAP) and click to drill down to details.


The charts show average score over the 20 test runs performed.  We believe average is a fair aggregate for the sub-test results given the characteristics we see:
The charts show average score over the 30 test runs performed.  We believe average is a fair aggregate for the sub-test results given the characteristics we see:


: ''Many of the sub-tests have bimodal behavior ([https://metrics.mozilla.com/bugzilla-analysis/Perfy-Details.html#benchmark=Benchmark.octane-2.0.Mandreel&platform=Platform.Linux&date=2013-12-12 example]).  We highly suspect garbage collection is being triggered during some of the test runs, and is the cause of the two modes.  The plan is to add more tooling to count the number and duration of GC events to confirm this suspicion.
: ''Many of the sub-tests have bimodal behavior ([https://metrics.mozilla.com/bugzilla-analysis/Perfy-Details.html#benchmark=Benchmark.octane-2.0.Mandreel&platform=Platform.Linux&date=2013-12-12 example]).  We highly suspect garbage collection is being triggered during some of the test runs, and is the cause of the two modes.  The plan is to add more tooling to count the number and duration of GC events to confirm this suspicion.
Confirmed users
137

edits