Checklist

~~Ship the l10n milestone ^DESKTOP ^MOBILE ^RELEASE ^BETA~~
~~Set reserved_slaves ^DESKTOP ^MOBILE ^RELEASE ^BETA ^ESR~~
~~Check to make sure you have all of the different types of slaves that you need ^DESKTOP ^MOBILE ^RELEASE ^BETA ^ESR~~
~~Start the automation ^DESKTOP ^MOBILE ^RELEASE ^BETA ^ESR~~
~~Sign Android builds ^MOBILE ^RELEASE ^BETA~~
~~Reset reserved_slaves and unlock slaves ^DESKTOP ^MOBILE ^RELEASE ^BETA ^ESR~~
~~Push to mirrors ^DESKTOP ^RELEASE~~ (see notes)
~~Publish Fennec ^MOBILE ^RELEASE ^BETA~~
~~Run pushsnip ^DESKTOP ^RELEASE ^BETA ^ESR~~
~~Update bouncer links ^DESKTOP ^RELEASE ^BETA~~
~~Apply Throttling ^DESKTOP ^RELEASE~~
~~Verify throttling ^DESKTOP ^RELEASE~~
~~Update XULRunner wiki pages ^DESKTOP ^RELEASE~~
~~Desktop post-release tasks ^DESKTOP ^RELEASE~~
~~Get the Browser Choice website updated ^DESKTOP ^RELEASE~~

Bugs hit

bug 785965 - failed on copy of new index.html
bug 799654 - symbol upload should retry upon name resolution failure

Notes

Tracking bug: bug 782990
Release engineer: kmoir
Buildbot master: ~~bm13~~ bm12

Build 1

Starting the automation

Set reserved_slaves to 8 and locked slaves on bm13
Created milestones for Fennec and Firefox using the l10n dashboard & downloaded changesets (still need to ship them)
- Fennec
  - Clicked "Ship", then "Ship it" (to confirm that I wanted to ship even though there were pending signoffs - verified with Pike that was okay).
  - Clicked "Shipping Tools"
  - Made sure "android" was the only platform listed, and "android-multilocale" was listed for multi-locale file, then clicked "Add"
  - Made sure "releases/mozilla-beta", "default", "mobile/android/locales/maemo-locales" were in the new fields, then clicked "l10n-changesets.json"
  - Downloaded the changesets from the resulting link
- Firefox
  - Clicked "Ship", then "Ship it".
  - Clicked "Shipping Tools"
  - Clicked "l10n-changesets" and downloaded the resulting file
  - Removed mn and sw from the l10n file for Firefox as per bug 797387 Remove mn, sw during beta-release migration for Firefox 16
Landed config updates, transplanted to the production branch
Tagged buildbot-configs, buildbotcustom, tools with {FIREFOX,FENNEC}_16_0_{RELEASE,BUILD1}
Updated and reconfiged bm13
Was talking to bhearsum in irc and he said that release builds should be run from bm12. So: set reserved_slaves to 0 on bm13 and unlocked slaves on bm13, set reserved slaves to 8 on bm13 and locked appropriate slaves.
Ran release sanity:

cd /builds/buildbot/build1/master
source ../bin/activate
PYTHONPATH=. python ../tools/buildbot-helpers/release_sanity.py -u kmoir \
   -V 16.0 --branch mozilla-release --build-number 1 \
   --release-config release-firefox-mozilla-release.py \
   --release-config release-fennec-mozilla-release.py --products firefox,fennec  \
   --dryrun localhost:9001

Had the following errors

2012-10-05 15:18:48,179 : INFO : Comparing fennec mozconfigs to nightly mozconfigs...
2012-10-05 15:18:49,689 : ERROR : found in mobile/android/config/mozconfigs/android-armv6/release but not in mobile/android/config/mozconfigs/android-armv6/nightly: ac_add_options --enable-updater
2012-10-05 15:18:49,690 : ERROR : found in mobile/android/config/mozconfigs/android-armv6/release but not in mobile/android/config/mozconfigs/android-armv6/nightly: ac_add_options --with-branding=mobile/android/branding/official
2012-10-05 15:18:49,690 : WARNING : ac_add_options --with-branding=mobile/android/branding/beta not in android-armv6 ['ac_add_options --enable-update-channel=nightly', 'ac_add_options --enable-update-channel=${MOZ_UPDATE_CHANNEL}', 'ac_add_options --enable-warnings-as-errors', 'ac_add_options --with-ccache=/usr/bin/ccache']!
2012-10-05 15:18:49,690 : ERROR : found in mobile/android/config/mozconfigs/android-armv6/nightly but not in mobile/android/config/mozconfigs/android-armv6/release: ac_add_options --with-branding=mobile/android/branding/beta
2012-10-05 15:18:50,887 : ERROR : Error verifying mozconfigs

 bhearsum i see the problem
 bhearsum	https://hg.mozilla.org/releases/mozilla-release/file/ddb22ac6c03b/mobile/android/config/mozconfigs/android-armv6/nightly has beta  branding
 bhearsum	and the mozconfig comparison expcets nightly & release to be thesame
 bhearsum	so, we can ignore this error too, because release branding is correct
 bhearsum	i'll file a bug for lsblakk to fix the nightly branding

Ran build with bypass-check to override errors:

cd /builds/buildbot/build1/master
source ../bin/activate
PYTHONPATH=. python ../tools/buildbot-helpers/release_sanity.py -u kmoir \
   -V 16.0 --branch mozilla-release --build-number 1 \
   --release-config release-firefox-mozilla-release.py \
   --release-config release-fennec-mozilla-release.py --products firefox,fennec  \
   --bypass-check localhost:9001

release-mozilla-release-xulrunner_linux_build and release-mozilla-release-xulrunner_linux64_build

failed with ssh: symbols1.dmz.phx1.mozilla.com: Temporary failure in name resolution
reran those builds and the completed successfully

release-mozilla-release-xulrunner_push_to_mirrors failed the first time, reran it sucessfully after bug 785965 was fixed

Traceback (most recent call last):
  File "/builds/slave/rel-m-rel-xr-psh-mrrrs/scripts/scripts/release/stage-tasks.py", line 244, in <module>
    buildNumber=buildNumber)
  File "/builds/slave/rel-m-rel-xr-psh-mrrrs/scripts/scripts/release/stage-tasks.py", line 159, in makeIndexFiles
    scp(indexFile.name, '%s@%s:%s/index.html' % (stageUsername, stageServer, candidates_dir))
  File "/builds/slave/rel-m-rel-xr-psh-mrrrs/scripts/scripts/release/../../lib/python/util/transfer.py", line 8, in scp
    return run_cmd(cmd)
  File "/builds/slave/rel-m-rel-xr-psh-mrrrs/scripts/scripts/release/../../lib/python/util/commands.py", line 42, in run_cmd
    return subprocess.check_call(cmd, **kwargs)
  File "/tools/python-2.7.2/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 511, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['scp', '-o', 'BatchMode=yes', '/var/folders/30/yq_p3wk15yb9wdsv6sm_m0v00000gn/T/tmp8mETcm', 'xrbld@stage.mozilla.org:/pub/mozilla.org/xulrunner/nightly/16.0-candidates/build1//index.html']' returned non-zero exit status 1

Sign Android Builds

Ran the following as cltsign@signing1:

cd ~/signing-work/mozharness
hg pull -u && hg up -C
cd ..
python2.6 mozharness/scripts/sign_android.py --config-file signing/android_mozilla-release.py

r-d was mailed automatically.

Push to mirrors

Failed first time - bug 785965 on copy of index.html to server (hwine).

Reset reserved slaves

Reset to 0 on bm12.

Publish Fennec

Google Play

Published through the Google Play store per docs.

Push the files

Edited ~ffxbld/push_fennec.sh on stage to point at 16.0 build1 and android/androidv6, ran it.

Apply throttling

bhearsum landed patch for https://bugzilla.mozilla.org/show_bug.cgi?id=797429
Opened bug with IT to enable the throttling https://bugzilla.mozilla.org/show_bug.cgi?id=799473

Run pushsnip

# ffxbld@aus3-staging.mozilla.org
cd /opt/aus2/snippets/staging
~/bin/pushsnip Firefox-16.0-build1

Ran before IT applied to patch to enable throttling. Ben noticed that this happened and changed the permissions on the directory to hide the updates.

After the patched was applied, I chmod /opt/aus2/incoming/3/Firefox back to 755 on aus3-staging.

Update bouncer links

I didn't have rights to bouncer admin, bhearsum added them for me. Updated /firefox/releases/15.0.1/win32/:lang/Firefox%20Setup%2015.0.1.exe to /firefox/releases/16.0/win32/:lang/Firefox%20Setup%2016.0.exe

Verify throttling

https://aus3.mozilla.org/update/1/Firefox/10.0.2/20120215223356/Darwin_x86_64-gcc3-u-i386-x86_64/ta/release/update.xml  should be empty          
https://aus3.mozilla.org/update/1/Firefox/10.0.2/20120215223356/Darwin_x86_64-gcc3-u-i386-x86_64/ta/release/update.xml?force=1 should have the update

Update XULRunner wiki pages

Delayed due to bug 785965, bhearsum removed index.html files manually and I updated the pages.

Post Release tasks

Started "post release" builder with "force build"

Update browser choice website

Opened bug 799556

Releases/Firefox 16.0/BuildNotes

Contents

Checklist

Bugs hit

Notes

Build 1

Starting the automation

Sign Android Builds

Push to mirrors

Reset reserved slaves

Publish Fennec

Google Play

Push the files

Apply throttling

Run pushsnip

Update bouncer links

Verify throttling

Update XULRunner wiki pages

Post Release tasks

Update browser choice website

Navigation menu

Personal tools

Namespaces

Variants

Views

More

Search

Navigation

How to Contribute

MozillaWiki

Around Mozilla

Tools