Confirmed users
42
edits
Project Dory: Difference between revisions
m
Add more test summary
m (Add test result of javascript.options.ion.threshold) |
m (Add more test summary) |
||
| Line 74: | Line 74: | ||
| network.buffer.cache.count || https://gist.github.com/7c8b2ca0d987f0ed6897695c35a55095 | | network.buffer.cache.count || https://gist.github.com/7c8b2ca0d987f0ed6897695c35a55095 | ||
|} | |} | ||
The tests are conducted using default values of the prefs along with 2 extreme values in 2 directions (larger and smaller). The extra 2 values may not be semantically valid for each prefs, but we test these extreme values to see whether twiddling with the pref values makes observable differences in user interactions as tested by Hasal test framework. More (semantically valid) test values will be added if necessary. | |||
* Test result summary | * Test result summary | ||
** javascript.options.baselinejit.threshold: for most test cases that completes quickly (< 100 ms), the default value performs similarly to the other values. Setting it to 50 is likely to have a smaller variation. For test cases that take longer time (> 200 ms) Setting the pref to 50 almost outperforms the default value. The only exception is test 'test_firefox_gslide_ail_pagedown_0', but the difference is marginal (within 1 frame). | ** javascript.options.baselinejit.threshold: for most test cases that completes quickly (< 100 ms), the default value performs similarly to the other values. Setting it to 50 is likely to have a smaller variation. For test cases that take longer time (> 200 ms) Setting the pref to 50 almost outperforms the default value. The only exception is test 'test_firefox_gslide_ail_pagedown_0', but the difference is marginal (within 1 frame). | ||
** javascript.options.ion.threshold: for test cases that completes under 100 ms, the default value (1000) or a larger value almost always perform better than 1. For some test cases (< 100 ms), the default value performs worse than 1, but the difference is marginal: test 'test_firefox_gsearch_ail_select_search_suggestion' completes in 15 ms in average using threshold 1, which is about 1 frame faster than the default. For larger test cases that completes > 300 ms, the default is almost always better than 1, showing that the performance gain is offset by the cost of compilation, and 10000 performs slightly better than the default for gmail and Facebook. One test that is of interest is 'test_firefox_outlook_ail_composemail_0', in which using 1 for eager compilation performs significantly better then default (about 100ms in difference). This is worthy of further look. | ** javascript.options.ion.threshold: for test cases that completes under 100 ms, the default value (1000) or a larger value almost always perform better than 1. For some test cases (< 100 ms), the default value performs worse than 1, but the difference is marginal: test 'test_firefox_gsearch_ail_select_search_suggestion' completes in 15 ms in average using threshold 1, which is about 1 frame faster than the default. For larger test cases that completes > 300 ms, the default is almost always better than 1, showing that the performance gain is offset by the cost of compilation, and 10000 performs slightly better than the default for gmail and Facebook. One test that is of interest is 'test_firefox_outlook_ail_composemail_0', in which using 1 for eager compilation performs significantly better then default (about 100ms in difference). This is worthy of further look. | ||
* dom.idle_period.throttled_length: the default (10000) value performs similarly to the other 2 test values. Some test cases are noteworthy: in 'test_firefox_gsheet_ail_clicktab_0', 65536 performs better than default. | |||
== External Links == | == External Links == | ||