Confirmed users
603
edits
Sheriffing/How To/Updating test expectations: Difference between revisions
Jump to navigation
Jump to search
Sheriffing/How To/Updating test expectations (view source)
Revision as of 10:55, 27 January 2022
, 27 January 2022→web-platform-tests: highlight to not copy the job symbol with the job name
(add wpt expectation update) |
(→web-platform-tests: highlight to not copy the job symbol with the job name) |
||
| Line 12: | Line 12: | ||
# Switch to the folder with newly downloaded source code:<br><code>cd fetchlogs</code> | # Switch to the folder with newly downloaded source code:<br><code>cd fetchlogs</code> | ||
# In Treeherder, identify the tasks whose unexpected test results should be used to update test expectations. | # In Treeherder, identify the tasks whose unexpected test results should be used to update test expectations. | ||
# In the console, download the logs which a command similar to the following one:<br><code>cargo run mozilla-central e40a136dc8760f3fdd8a29fad47581d16d646c80 --out-dir ../logs/ --filter-jobs test-linux1804-32-shippable-qr/opt-web-platform-tests-e10s-10</code><br>Replace <code>mozilla-central</code> with the name of the tree and <code>e40a136dc8760f3fdd8a29fad47581d16d646c80</code> with the revision of the push from which the logs shall be downloaded.<br><code>--filter-jobs</code> expects the name of the task as parameter (found at the bottom left in Treeherder) - or a regular expression to match multiple task names. If omitted, the log for every wpt task for that push will be downloaded.<br>This depends on the Rust programming language which should be installed since <code>./mach bootstrap</code> had been run in <code>mozilla-unified</code> | # In the console, download the logs which a command similar to the following one:<br><code>cargo run mozilla-central e40a136dc8760f3fdd8a29fad47581d16d646c80 --out-dir ../logs/ --filter-jobs test-linux1804-32-shippable-qr/opt-web-platform-tests-e10s-10</code><br>Replace <code>mozilla-central</code> with the name of the tree and <code>e40a136dc8760f3fdd8a29fad47581d16d646c80</code> with the revision of the push from which the logs shall be downloaded.<br><code>--filter-jobs</code> expects the name of the task as parameter (found at the bottom left in Treeherder) - or a regular expression to match multiple task names. If omitted, the log for every wpt task for that push will be downloaded. Don't copy the job symbol mentioned at the end.<br>This depends on the Rust programming language which should be installed since <code>./mach bootstrap</code> had been run in <code>mozilla-unified</code> | ||
# Switch to <code>mozilla-unified</code><br><code>cd ../mozilla-unified/</code> | # Switch to <code>mozilla-unified</code><br><code>cd ../mozilla-unified/</code> | ||
# Update the files with the test expectations:<br><code> ./mach wpt-update ../logs/* --update-intermittent</code><br>The log output should be similar to:<br><code>0:00.03 INFO Skipping manifest download because existing file is recent<br>Processing log 1/3<br>Processing log 2/3<br>Processing log 3/3</code> | # Update the files with the test expectations:<br><code> ./mach wpt-update ../logs/* --update-intermittent</code><br>The log output should be similar to:<br><code>0:00.03 INFO Skipping manifest download because existing file is recent<br>Processing log 1/3<br>Processing log 2/3<br>Processing log 3/3</code> | ||