Be sure to take notes on manual steps and any problems you encounter.

Checklist

Notes

tracking bug: bug 758762
buildbot master: 30

Build 1

• l10n changesets
  • forgot to push "ship" button, so milestone is "missing" (was renamed for 14.0 ga)
• reserved slaves:

   $ ssh buildbot-master34 bash -c "'echo 8 > /builds/buildbot/build1/master/reserved_slaves'"
   0 [Hal@Hals-MacBook-Air mozilla]
   $ ssh buildbot-master34 cat /builds/buildbot/build1/master/reserved_slaves
   8
   0 [Hal@Hals-MacBook-Air mozilla]

• clobbered comm-beta
• created candidates dir:

   [cltbld@buildbot-master30 build1]$ ssh -l tbirdbld -i ~/.ssh/tbirdbld_dsa stage.mozilla.org
   Last login: Mon Jul  9 12:13:16 2012 from zlb1.dmz.scl3.mozilla.com
   [tbirdbld@upload1.dmz.scl3 ~]$ version=14.0b5
   [tbirdbld@upload1.dmz.scl3 ~]$ product=thunderbird
   [tbirdbld@upload1.dmz.scl3 ~]$ cd /pub/mozilla.org/$product/nightly/
   [tbirdbld@upload1.dmz.scl3 nightly]$ mkdir ../candidates/$version-candidates
   [tbirdbld@upload1.dmz.scl3 nightly]$ ln -s ../candidates/$version-candidates $version-candidates
   [tbirdbld@upload1.dmz.scl3 nightly]$ 

• updated & tagged:

   cd /builds/buildbot/build1
   for d in buildbot-configs buildbotcustom tools ; do hg --cwd $d pull --update ; done
   for d in buildbot-configs buildbotcustom tools ; do hg --config ui.username='Hal Wine <hwine@mozilla.com>' --cwd $d tag  THUNDERBIRD_14_0b5_{RELEASE,BUILD1} ; done
   for d in buildbot-configs buildbotcustom tools ; do hg --config ui.username='Hal Wine <hwine@mozilla.com>' --cwd $d push -e 'ssh -l hwine@mozilla.com' ssh://hg.mozilla.org/build/$d ; done

• reconfig

   [cltbld@buildbot-master30 build1]$ source bin/activate
   (build1)[cltbld@buildbot-master30 build1]$ make update && make reconfig
   (cd buildbotcustom && /usr/bin/hg pull && /usr/bin/hg update -C)
   pulling from http://hg.mozilla.org/build/buildbotcustom
   searching for changes
   no changes found
   0 files updated, 0 files merged, 0 files removed, 0 files unresolved
   (cd buildbot-configs && /usr/bin/hg pull && /usr/bin/hg update -C)
   pulling from http://hg.mozilla.org/build/buildbot-configs
   searching for changes
   no changes found
   0 files updated, 0 files merged, 0 files removed, 0 files unresolved
   (cd tools && /usr/bin/hg pull && /usr/bin/hg update -C)
   pulling from http://hg.mozilla.org/build/tools
   searching for changes
   no changes found
   0 files updated, 0 files merged, 0 files removed, 0 files unresolved
   (python buildbot-configs/update-master-json.py tools/buildfarm/maintenance/production-masters.json master/master_config.json)
   writing new master_config.json file to master/master_config.json
   cd master && /builds/buildbot/build1/bin/buildbot reconfig $PWD
   sending SIGHUP to process 20790
   2012-07-11 18:56:36-0700 [-] loading configuration from /builds/buildbot/build1/master/master.cfg
   Never saw reconfiguration finish.

• release sanity:

   PYTHONPATH=. python ../tools/buildbot-helpers/release_sanity.py -u hwine 
       -V 14.0b5 --build-number 1 --branch comm-beta \
       --release-config release-thunderbird-comm-beta.py --product thunderbird \
       --dryrun localhost:9001

• reset reserved:

   [cltbld@buildbot-master30 master]$ pwd -P
   /builds/buildbot/build1/master
   [cltbld@buildbot-master30 master]$ echo 0 >reserved_slaves 
   [cltbld@buildbot-master30 master]$ cat reserved_slaves
   0

• push snippets:

   $ ssh aus3-staging.mozilla.org
   Last login: Wed Jul 11 13:45:06 2012 from vpn1.dmz.releng.scl3.mozilla.com
   [hwine@dp-ausstage01 ~]$ sudo su - tbirdbld
   [tbirdbld@dp-ausstage01 ~]$ cd /opt/aus2/snippets/staging
   [tbirdbld@dp-ausstage01 staging]$ ~/bin/pushsnip Thunderbird-14.0b5-build1
   ---------------------------------------------------------------------------
   Updating PHX1:

lines skipped

   sent 6419349 bytes  received 232410 bytes  20126.35 bytes/sec
   total size is 5275931  speedup is 0.79
   
   Touching /opt/aus2/incoming/3/Thunderbird
   [tbirdbld@dp-ausstage01 staging]$ exit

• manually start final verifications (due to bug 773283) via waterfall gui. All passed
• skipped "ready for releastest" & "ready for release" builders as moot. Manually verified in bouncer sufficient uptake for beta release. (more fallout from uptake monitoring failure)

Problems Encountered

• buildbot-master30 had never been used for a release build before, so extra setup needed. (reopened bug 770879)
  • Makefile had wrong path to hg
  • Missing symlinks for thunderbird configs/l10n from master/ (caught by release-sanity ftw)
• Final verifications didn't fire bug 773283
  • worked with bhearsum via irc to confirm okay to push to beta channel before resolution
  • twistd.log files saved off