ReleaseEngineering/Buildduty/SVMeetings/Oct3-Oct7

Meeting Details

• Room Link: https://v.mozilla.com/flex.html?roomdirect.html&key=RSAkZHawz3ED

• Meetings every Wednesday
• Meeting notes archive:
  • https://wiki.mozilla.org/ReleaseEngineering/Buildduty/SVMeetings

Upcoming vacation/PTO:

• Alin: Oct 21
• Andrei:
• Florin: November 1-10
• Coop:
• Ihsiao:
• Ashiue:
• Kmoir:

Holidays:

• Canada:
  • Thanksgiving October 10
• Romania:
  • November 30
  • December 1 (National Day)
• Taiwan:
  • National Day, 10/10

Possible bugs

• Write a tool to update bugzilla bugs for outstanding machine loans and ask if the loaner is still needed on say, a weekly basis: https://bugzilla.mozilla.org/show_bug.cgi?id=1171165
• Long Inter-Job Timing on t-yosemite-r7 https://bugzilla.mozilla.org/show_bug.cgi?id=1258480
• Create new script to setup a buildbot master for development: https://bugzil.la/1275135

From coop:

• Server alerts: finishing up work on fwunit and ssl cert changes
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1307757
• Prep for catlee’s visit
• Prep for Hawaii

From kmoir:

• Revert changes to https://bugzilla.mozilla.org/show_bug.cgi?id=1302578 g2.2xlarge price spike and add more capacity to the pool in other regions https://bugzilla.mozilla.org/show_bug.cgi?id=1302549. (Done and I think ondemand instances were also added by rail/catlee)
• How are preparations for the mercurial upgrades going for build/test machines? (to support bug 1298976)
• Other possible bugs:
  • Schedule win10vm test jobs on try https://bugzilla.mozilla.org/show_bug.cgi?id=1304065
  • watch_pending should send an alert when we're outbid for spot instances https://bugzilla.mozilla.org/show_bug.cgi?id=1302567
  • Create alerts for t-w732 and g-w732 pending https://bugzilla.mozilla.org/show_bug.cgi?id=1304158
• There is a postmortem doc for the hg ssl cert change. Please add content if you have input https://docs.google.com/document/d/1dW3BqIzhQZr2SfeLnNvvJOPAi0Brh1CZKe3Jb7WuX4I/edit#heading=h.1h9m3jk2snsr

Taipei: 2016/10/03 - 2016/10/07

• Loan request: bug 1306518, bug1300657
• Check failures on trees and mark failures/file new bugs
• Backout changesets if any failures or bustage: bug 1306248, bug 1287671
• Triage perf alerts
• Investigate perf regression issues: bug 1286041, bug 1304363, bug 1306459, bug 1307336, bug 1307365

SV: 2016/10/03 - 2016/10/07

• https://bugzilla.mozilla.org/show_bug.cgi?id=1093196
  • reschedule HSTS and HPKP automatic updates to run daily, and be visible on treeherder
• Need to have logs in Treeherder job,currently these jobs can be seen on slavehealth,how do we make them visible in Treeherder? /
  • For example a periodic update was done on 01.10.2016
  • Bellow are the logs from archive: https://archive.mozilla.org/pub/firefox/tinderbox-builds/mozilla-aurora-linux64/mozilla-aurora-linux64-periodicupdate-bm72-build1-build0.txt.gz
  • The job is visible here: http://buildbot-master72.bb.releng.usw2.mozilla.com:8001/builders/Linux%20x86-64%20mozilla-aurora%20periodic%20file%20update/builds/0 , but doesn’t show the revision number:

http://buildbot-master72.bb.releng.usw2.mozilla.com:8001/builders/Linux%20x86-64%20mozilla-aurora%20periodic%20file%20update

• • But does not appear in treeherder in mozilla-aurora
• Bug 1299421 - Switch to running restart_masters.sh on the buildduty-tools machine
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1299421
  • Requested need info from nthomas
• Bug 1304065 - Schedule win10vm test jobs on try
  • https://bugzilla.mozilla.org/show_bug.cgi?id=1304065
  • Created a patch with all changes
  • also don’t have rights to push the the previous patch in git,the previous patch make sure to spin up the new w10 instances when there are jobs to run
    • I got feedback + from Kim but also need to be pushed

• Working on the following tasks:
  • bug 1303006 - ensure win7-ix jobs are not run on try for unittests which are running on AWS vm
  • create rpms for Python 2.7.12 - encountered some issues, debugging
  • bug 1305133 - output from all cruncher cron jobs should go to syslog
    • must update the patch