Notes About Releasing

Please update the Notes Template and the Release:Primer for future releases (bug fixes, changes to automation) as needed

Bugs hit

Enter any bugs pre-existing or newly discovered and filed during the release:

Build Engineers

rail - Tracking bug: bug 712490

Signed-off Revision(s)

Build 1: b78fe362789b

L10N changesets

Instructions on how to get them

• Firefox: chemspill
• Fennec: chemspill

Tags

Build #	Branch, Tags	Changeset
1	GECKO901_2011122016_RELBRANCH, FIREFOX_9_0_1_BUILD1 FIREFOX_9_0_1_RELEASE	adf149a51eff

Build data

Firefox

Build #	Type	Build ID	Build machine	Time to build
1	Linux	20111220165912	mv-moz2-linux-ix-slave11	2 hrs, 16 mins, 28 secs
	Linux64		moz2-linux64-slave01	2 hrs, 33 mins, 46 secs
	Mac		moz2-darwin10-slave17	4 hrs, 42 mins, 30 secs
	Windows		mw32-ix-slave20	3 hrs, 12 mins, 46 secs

Fennec

N/A

Notes

Build 1

Syncing repos

N/A

Diff mozconfigs

N/A

Preparing to start Automation

• Set clobbers for the appropriate masters.
• Reserve slaves

echo "10" > reserved_slaves_bm07-build1

• Land automation configs
• Tag buildbot-configs, buildbotcustom, & tools with build & release tags
• update and reconfigure the master
• start automation

source ../bin/activate
PYTHONPATH=. ../bin/python ../tools/buildbot-helpers/release_sanity.py -u rail \
 -V 9.0.1 --branch mozilla-release --build-number 1 -c release-firefox-mozilla-release.py \
 --dryrun --products firefox localhost:9001

• it failed trying to fetch l10n dashboard (9.0.1 vs 9). bug 711796
• Start automation:

PYTHONPATH=. ../bin/python ../tools/buildbot-helpers/release_sanity.py -u rail \
 -V 9.0.1 --branch mozilla-release --build-number 1 -c release-firefox-mozilla-release.py \
 -b --products firefox localhost:9001

E-mail Metrics

And for 9.0 final it's

Firefox,firefox,firefox,9.0.1,9.0.1

E-mail mirrors@mozilla.org

Not necessary for rapid release betas, files only go as far as the 'internal mirrors'.

They want to know approximately what time push to external mirrors will occur. Ideally this is a 24hr notice to them, with the estimated time.

Subject: Firefox 9.0.1 coming to mirrors Dec 21
Body:
Hi,

We're planning on pushing our Firefox 9.0.1 release to mirrors sometime tomorrow, December 21.

If you believe these releases or these dates will cause any problems, please notify release at mozilla.com.

If you have any problems with mirror status/weights/etc, please notify mirror-submissions at mozilla.org.

Tag

No problems.

Bouncer Submitter

No problems.

Source

No problems.

Start autosign

NOTE: use new signcode keys from d:/2011-keys

# created in ~/tmp/sign_9.0.1.sh
PRODUCT=firefox
VERSION=9.0.1
BUILD=1
TAG=FIREFOX_9_0_1_RELEASE
REPO='releases/mozilla-release'
EMAIL=release@mozilla.com
KEYDIR=d:/2011-keys
RELCONFIG=mozilla/release-firefox-mozilla-release.py

cd ${HOME}/hg-tools/
hg pull && hg up -r ${TAG}
mkdir -p ~/signing-work/${PRODUCT}-${VERSION}/lib/python
cd ~/signing-work/${PRODUCT}-${VERSION}
cp ~/hg-tools/release/signing/* .
rsync -av ~/hg-tools/lib/python/ ./lib/python/
make autosign PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} RELCONFIG=${RELCONFIG}

Instructions are in CombinedSigning

Build

Firefox

No problems.

Firefox repacks

One of the repacks for linux64 failed due to low disk space (VM). Moved 3 IX machines over to bm07 and retriggered the build.

Fennec

Android

N/A

Desktop Builds

N/A

Mobile Desktop repacks

N/A

Unittests / Talos

1. Look to see that they ran
2. Document any oranges (per platform) for unittests - if possible, try to confirm it's known/random
3. Make sure there's no red/failures that we need to have a dev look at

XULRunner

Source

No problems

Build

No problems.

Signing

NOTE: use new signcode keys from d:/2011-keys

Used this script

Partner Repack

Firefox

No problems.

Fennec

N/A

Firefox Signing

No problems.

Android Signing

N/A

Android Signature Verification

N/A

L10N verify

No problems.

Updates

No problems.

Update verify

No problems.

8.0-9.0.1 partial updates

# cltbld@mv-moz2-linux-ix-slave17 (the slave which ran the updates builder)
cd /builds/slave/rel-m-rel-updates/build
# Download the custom patcher config
wget -O patcher-configs/mozRelease-branch-patcher2-8.0.cfg https://bugzilla.mozilla.org/attachment.cgi?id=583359

# Download 8.0 complete MARs
perl patcher2.pl --download --app=firefox --brand=Firefox --config=patcher-configs/mozRelease-branch-patcher2-8.0.cfg

# Generate 8.0->9.0.1 partial mars and snippets
perl patcher2.pl --create-patches --partial-patchlist-file=patchlist.cfg --app=firefox --brand=Firefox --config=patcher-configs/mozRelease-branch-patcher2-8.0.cfg
# Fix permissions
find temp/firefox/8.0-9.0.1/ftp/firefox/nightly/9.0.1-candidates/build1 -type f -exec chmod 644 '{}' ';'
find temp/firefox/8.0-9.0.1/ftp/firefox/nightly/9.0.1-candidates/build1 -type d -exec chmod 755 '{}' ';'

# Upload 8.0-9.0.1 complete MARs
rsync -av -e 'ssh -oIdentityFile=~/.ssh/ffxbld_dsa' '--exclude=*complete.mar' temp/firefox/8.0-9.0.1/ftp/firefox/nightly/9.0.1-candidates/build1/update ffxbld@stage-old.mozilla.org:/pub/mozilla.org/firefox/nightly/9.0.1-candidates/build1/

# rsync 8.0-9.0.1 *partial* snippets  to aus2-staging (excluding complete.txt snippets)
rsync -av --exclude=complete.txt -e 'ssh -oIdentityFile=~/.ssh/cltbld_dsa' temp/firefox/8.0-9.0.1/aus2.test/ cltbld@aus2-staging.mozilla.org:/opt/aus2/snippets/staging/Firefox-9.0.1-8.0-build1-test
rsync -av --exclude=complete.txt -e 'ssh -oIdentityFile=~/.ssh/cltbld_dsa' temp/firefox/8.0-9.0.1/aus2/ cltbld@aus2-staging.mozilla.org:/opt/aus2/snippets/staging/Firefox-9.0.1-8.0-build1

Merge new snippets with the automatically generated ones on aus2-staging:

# cltbld@aus2-staging
cd /opt/aus2/snippets/staging/
# backup the original snippets
rsync -av Firefox-9.0.1-build1/ Firefox-9.0.1-build1.orig/

# snippets should be without win32
rsync -av --exclude='**WINNT_x86-msvc**' Firefox-9.0.1-8.0-build1-test/ Firefox-9.0.1-8.0-build1-test-mac+linux/
rsync -av --exclude='**WINNT_x86-msvc**' Firefox-9.0.1-8.0-build1/ Firefox-9.0.1-8.0-build1-mac+linux/

# remove win32 snippets and merge 8.0 partial snippets into the automatically generated ones
rm -rf Firefox-9.0.1-build1/Firefox/*/WINNT_x86-msvc
rsync -av Firefox-9.0.1-8.0-build1-mac+linux/ Firefox-9.0.1-build1/

# backupsnip and pushsnip 8.0 partial snippets for test channels
~/bin/backupsnip  Firefox-9.0.1-8.0-build1-test-mac+linux

• Added Firefox-9.0.1-Partial-8.0 product to Bouncer with the similar to Firefox-9.0-Partial-8.0 locations (not for contrib platforms)

Update verify for 8.0 partial updates

• Landed a patch which forces update verify to use partial updates for 8.0
• tagged tools with FIREFOX_9_0_1_BUILD1_RUNTIME and FIREFOX_9_0_1_RELEASE_RUNTIME

# On my local machine, to kick off update verify
for p in linux linux64 macosx64 win32; do
  for i in 1 2 3 4 5 6 7 8 9 10; do
    curl "http://buildbot-master07.build.sjc1.mozilla.com:8001/builders/release-mozilla-release-${p}_update_verify_${i}%2F10/force" >/dev/null
    sleep 5
  done
done

• Some of win32 update verify builders failed trying to get partial update for 8.0 which wasn't the case for this release. "Backed out" win32 update verify config change here and tagged with FIREFOX_9_0_1_BUILD1_RUNTIME and FIREFOX_9_0_1_RELEASE_RUNTIME

Major Update

N/A

Update verify

N/A

Socorro Product Data Updates

N/A

Reset reserved slaves

echo "0" >reserved_slaves_bm07-build1

Run backupsnip

~/bin/backupsnip  Firefox-9.0.1-build1

Check permissions / AV scan

No problems

Push files to internal mirrors

Mirrors Policy

Final verification

No problems

• reverted the patch and move FIREFOX_9_0_1_BUILD1_RUNTIME and FIREFOX_9_0_1_RELEASE_RUNTIME tags back to f100082ceee5 after final verification.

Push to beta

N/A

Push index file to mirrors

N/A (chemspill)

Publish Fennec to the Android Market

N/A

Push the files

N/A

Android Market

N/A

Push XULRunner to Mirrors

ssh -i ~/.ssh/xrbld_dsa xrbld@stage
rsync -avn --exclude=*.txt --exclude=*unsigned* --exclude=*-symbols.zip --exclude=*.checksums \
 --exclude 'jsshell-*' \
 /pub/mozilla.org/xulrunner/nightly/9.0.1-candidates/build1/ /pub/mozilla.org/xulrunner/releases/9.0.1/
rsync -av --exclude=*.txt --exclude=*unsigned* --exclude=*-symbols.zip --exclude=*.checksums \
 --exclude 'jsshell-*' \
 /pub/mozilla.org/xulrunner/nightly/9.0.1-candidates/build1/ /pub/mozilla.org/xulrunner/releases/9.0.1/

Update XULRunner wiki page

Updated Gecko SDK wiki page

Create full set of snippets with Windows included

Up until this point, we've been working on the assumption that we were going to ship 9.0.1 as a Mac/Linux-only release. Because of that, we don't yet have a single snippet directory with all of the snippets we need. To create it, did the following:

# cltbld@aus2-staging
cd /opt/aus2/snippets/staging
rsync -av Firefox-9.0.1-build1.orig/ Firefox-9.0.1-build1-with-8.0-partials-all-platforms/
rsync -av Firefox-9.0.1-8.0-build1/ Firefox-9.0.1-build1-with-8.0-partials-all-platforms/

No need to re-run backupsnip, the prior one is still valid.

Push to Release Channel

We weren't on external mirrors by the time this push happened, so we had to turn on the CDN. This was done by through the mirror page on Bouncer, by marking it as 'active' and changing the rating to 45,000.

~/bin/pushsnip Firefox-9.0.1-build1-with-8.0-partials-all-platforms

Push to external mirrors

• Updated rsyncd-mozilla-current.exclude with s/9.0/9.0.1/g
• Removed '- firefox/releases/9.0.1' line from rsyncd-mozilla-releases.exclude

Turn down the CDN

Reset the CDN mirror to be inactive, and have a rating of 1.

Update symlinks

# ffxbld@stage
rm latest-9.0 && ln -s 9.0.1 latest-9.0

Remove index.html files

N/A (chemspill)

Update browser choice website

Filed bug 712852