Notes About Releasing

Please update the Notes Template and the Release:Primer for future releases (bug fixes, changes to automation) as needed

Bugs hit

Enter any bugs pre-existing or newly discovered and filed during the release:

bug 678467 - maemo partner repacks need to be kicked off manually

Build Engineers

aki - Tracking bug: bug 682939

Signed-off Revision(s)

Build 1: 791d19e33b2a

L10N changesets

Unchanged from 6.0 due to chemspill.

Build data

Firefox

Build #	Type	Build ID	Build machine	Time to build
1	Linux	20110830092941	mv-moz2-linux-ix-slave09	2 hrs, 14 mins, 26 secs
	Linux64		moz2-linux64-slave01	2 hrs, 26 mins, 27 secs
	Mac		moz2-darwin10-slave06	4 hrs, 10 mins, 44 secs
	Windows		mw32-ix-slave10	2 hrs, 42 mins, 15 secs

Fennec

Build #	Type	Build ID	Build machine	Time to build
1	android	20110830102437	mv-moz2-linux-ix-slave16	1 hrs, 38 mins, 56 secs
	maemo5-gtk	20110830100432	mv-moz2-linux-ix-slave06	1 hrs, 35 mins, 32 secs
	linux	20110830100141	mv-moz2-linux-ix-slave19	1 hrs, 13 mins, 24 secs
	macosx	20110830110357	bm-xserve16	1 hrs, 54 mins, 46 secs
	win32	20110830104432	mw32-ix-slave13	1 hrs, 10 mins, 28 secs

Notes

buildbot-master07

Build 1

landed mozharness patch
got r+ for configs patch with 'tbd'.
set clobberer for any master, mozilla-release, any builder
reserved 10 slaves

echo "10" > master/reserved_slaves_bm07-build1

no new l10n changesets for chemspill
landed patcher-configs patch to not send 6.0.1 to the beta channel

waiting for 'go'
got go - 791d19e33b2a
dual landed configs
landed on production buildbot-configs, tagged buildbot-configs (production), mozharness, tools, buildbotcustom (production-0.8)
updated master

make update

release_sanity noop

cd master
. ../bin/activate
PYTHONPATH=. ../bin/python ../tools/buildbot-helpers/release_sanity.py -u aki -V 6.0.1 \
--branch mozilla-release --build-number 1 -c release-firefox-mozilla-release.py -c release-fennec-mozilla-release.py \
--dryrun --products firefox,fennec localhost:9001 2>&1 | tee aki.out

that died on l10n-changesets_mobile-release.json [!]

ls -l l10n*json # nothing !
ln -s /builds/buildbot/build1/buildbot-configs/mozilla/l10n*json .
ls -l *json

rerun:

PYTHONPATH=. ../bin/python ../tools/buildbot-helpers/release_sanity.py -u aki -V 6.0.1 \
--branch mozilla-release --build-number 1 -c release-firefox-mozilla-release.py -c release-fennec-mozilla-release.py \
--dryrun --products firefox,fennec localhost:9001 2>&1 | tee aki.out

passed. looked at aki.out, |rm aki.out|

start automation:

PYTHONPATH=. ../bin/python ../tools/buildbot-helpers/release_sanity.py -u aki -V 6.0.1 \
--branch mozilla-release --build-number 1 -c release-firefox-mozilla-release.py -c release-fennec-mozilla-release.py \
--products firefox,fennec localhost:9001

E-mail Metrics

Emailed with

Firefox,firefox,firefox,6.0.1,6.0.1

Tag

No problems

Bouncer Submitter

No problems.

Source

No problems.

Start autosign

Saved the following as ~/tmp/sign_6.0.1.sh

PRODUCT=firefox
VERSION=6.0.1
BUILD=1
TAG=FIREFOX_6_0_1_RELEASE
REPO='releases/mozilla-release'
EMAIL=release@mozilla.com
KEYDIR=d:/2010-keys
RELCONFIG=mozilla/release-firefox-mozilla-release.py

cd ${HOME}/hg-tools/
hg pull && hg up -r ${TAG}

mkdir -p ~/signing-work/${PRODUCT}-${VERSION}/lib/python
cd ~/signing-work/${PRODUCT}-${VERSION}
cp ~/hg-tools/release/signing/* .
rsync -av ~/hg-tools/lib/python/ ./lib/python/
make autosign PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} RELCONFIG=${RELCONFIG}

bash -xe sign_6.0.1.sh 2>&1 | tee sign_6.0.1.log

Build

Firefox

No problems.

Fennec

Android

No problems.

Maemo5-GTK

No problems.

Desktop Builds

No problems.

Desktop repacks

Unittests / Talos

XULRunner

Source

No problems.

Build

No problems.

Signing

Repacks

Firefox

No problems.

Fennec

No problems.

Partner Repack

Firefox

No problems.

Fennec

Kicked off manually. bug 678467

Firefox Signing

Lots of problems that I thought were related to 3.6.21, and perhaps were, but were most likely due to not running signcodepwd ?

Moved the signed-build1 away and restarted signing, since it had already downloaded everything correctly.

Turns out we didn't get GPG sigs for non-Windows files - bug 684434. Fix:

PRODUCT=firefox
VERSION=6.0.1
BUILD=1
TAG=FIREFOX_6_0_1_RELEASE
REPO='releases/mozilla-release'
EMAIL=release@mozilla.com
KEYDIR=d:/2010-keys
RELCONFIG=mozilla/release-firefox-mozilla-release.py

cd ${HOME}/hg-tools/
hg pull && hg up -r ${TAG}

mkdir -p ~/signing-work/${PRODUCT}-${VERSION}/lib/python
cd ~/signing-work/${PRODUCT}-${VERSION}
cp ~/hg-tools/release/signing/* .
rsync -av ~/hg-tools/lib/python/ ./lib/python/

# tweak the exlcusions, we want signed win32 but not unsigned, and not partner-repacks
grep -v win ~/hg-tools/release/signing/download-exclude.list > download-exclude.list2
echo "- /unsigned/" >> download-exclude.list2
echo "- /partner-repacks/" >> download-exclude.list2
mv download-exclude.list2 download-exclude.list

rsync -av --exclude-from download-exclude.list -e "ssh -i $HOME/.ssh/ffxbld_dsa" \
 ffxbld@stage.mozilla.org:/home/ftp/pub/firefox/nightly/${VERSION}-candidates/build${BUILD}/ \
 signed-build${BUILD}

make setup checksum-files create-sigs verify-sigs verify-asc fake-upload PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} RELCONFIG=${RELCONFIG}

# double check upload
rsync -n -e "ssh -i /home/cltsign/.ssh/ffxbld_dsa" -avO \
 /home/cltsign/signing-work/firefox-6.0.1/signed-build1/ \
 ffxbld@stage.mozilla.org:/home/ftp/pub/firefox/nightly/6.0.1-candidates/build1/

# upload
make upload PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} RELCONFIG=${RELCONFIG}

Push to mirrors

# ffxbld@stage
rsync -av --exclude=*tests* --exclude=*crashreporter* --exclude=*.log --exclude=*.txt --exclude=*unsigned* --exclude=*update-backup* --exclude=*partner-repacks* --exclude=*.checksums --exclude=logs --exclude=jsshell* /pub/mozilla.org/firefox/nightly/6.0.1-candidates/build1/ /pub/mozilla.org/firefox/releases/6.0.1/

There were some errors regarding contrib/solaris_*, due to those files/dirs not being owned by ffxbld, which we can ignore.

Android Signing

Followed instructions

Android Signature Verification

No problems.

Maemo5-GTK repos

Accidentally triggered mozilla-beta first. No worries.

No problems.

L10N verify

No problems.

Updates

Failed to upload aus2.beta. We reverted the patcher config but not the flag in the release config.

Complete builder by doing this on mv-moz2-linux-ix-slave17

cd /builds/slave/rel-m-rel-updates/build/temp/firefox/6.0-6.0.1

No output means no errors.

Update verify

Had to force builders

# On my local machine, to kick off update verify
for p in linux linux64 macosx64 win32; do
  for i in 1 2 3 4 5 6 7 8 9 10; do
    curl "http://buildbot-master07.build.sjc1.mozilla.com:8001/builders/release-mozilla-release-${p}_update_verify_${i}%2F10/force" >/dev/null
  done
done

Major Update

Update verify

linux64 failed update verify; rekicking fixed it.

Socorro Product Data Updates

Check permissions / AV scan

Forced both with properties:

release_config: mozilla/release-firefox-mozilla-release.py
script_repo_revision: FIREFOX_6_0_1_RELEASE

Permission were OK. AV is going to fail after the scan because mirror push created ../firefox/releases/6.0.1/ already.

Reset reserved slaves

Push files to internal mirrors

Just like the Betas, this is only going to internal mirrors (at first), so we add the following line to stage:/pub/mozilla.org/zz/rsyncd-mozilla-releases.exclude:

- firefox/releases/6.0.1

Turns out we went straight to external mirrors and undid this.

Push to beta

N/A - not pushing this build to beta channel.

Push XULRunner to Mirrors

Update XULRunner wiki page

Publish Fennec

Not pushing mobile due to 6.0.2.

Create bouncer entry for maemo

Push the files

Publish to the Android Market

IMPORTANT - Make sure to follow instructions! See 6.0b6's push to Market.

Push index file to mirrors

N/A

Push to external mirrors

Forced with properties:

release_config: mozilla/release-firefox-mozilla-release.py
script_repo_revision: FIREFOX_6_0_1_RELEASE

Removed

- firefox/releases/6.0.1

from stage:/pub/mozilla.org/zz/rsyncd-mozilla-releases.exclude, and updated stage:/pub/mozilla.org/zz/rsyncd-mozilla-current.exclude to have 6.0.1 instead of 6.0.

Final verification

Linux failed final verification; rekicking fixed it.

Push to Release Channel

Skip backupsnip (50min).

~/bin/pushsnip Firefox-6.0.1-build1

Update symlinks

cd /pub/mozilla.org/firefox/releases
rm latest-6.0 && ln -s 6.0.1 latest-6.0

Build #	Branch, Tags	Changeset
	MOBILE60_2011083008_RELBRANCH, FENNEC_6_0_1_RELEASE, FENNEC_6_0_1_BUILD1	f13f3f7c028e
	GECKO60_2011083006_RELBRANCH, FIREFOX_6_0_1_BUILD1 FIREFOX_6_0_1_RELEASE	41ea1b3fb0a9

Releases/Firefox 6.0.1/BuildNotes

Notes About Releasing

Bugs hit

Build Engineers

Signed-off Revision(s)

L10N changesets

Tags

Build data

Firefox

Fennec

Notes

Build 1

E-mail Metrics

Tag

Bouncer Submitter

Source

Start autosign

Build

Firefox

Fennec

Android

Maemo5-GTK

Desktop Builds

Desktop repacks

Unittests / Talos

XULRunner

Source

Build

Signing

Repacks

Firefox

Fennec

Partner Repack

Firefox

Fennec

Firefox Signing

Android Signing

Android Signature Verification

Maemo5-GTK repos

L10N verify

Updates

Update verify

Major Update

Update verify

Socorro Product Data Updates

Check permissions / AV scan

Reset reserved slaves

Push files to internal mirrors

Push to beta

Push XULRunner to Mirrors

Update XULRunner wiki page

Publish Fennec

Create bouncer entry for maemo

Push the files

Publish to the Android Market

Push index file to mirrors

Push to external mirrors

Final verification

Push to Release Channel

Update symlinks

Update browser choice website

Navigation menu

Search