Notes About Releasing

Please update the Notes Template and the Release:Primer for future releases (bug fixes, changes to automation) as needed

Bugs hit

Enter any bugs pre-existing or newly discovered and filed during the release:

bug 729516 and bug 725300 made the release_sanity.py output say a lot of "ERROR"
- this gets by-passed with "-b"
TODO - DOCUMENT: "land configs on default as well"
TODO - DOCUMENT: "adjust auto-sign section since it is not needed for betas"
bug 719260 - got two jobs per update verify builder
bug 729998 - Check permissions failed because setgid
The files ended up in firefox/nightly/11.0b4-candidates, a real directory rather than a symlink to firefox/candidates/11.0b4-candidates (nthomas didn't document creating the symlink or resolve bug 725839 yet). This ended up causing a lot of load on stage.m.o, because it hassles the same netapp as all the development traffic. Cancelled the antivirus and moved the files to the correct location. Forced the antivirus again, running ...
Two jobs per builder scheduled, commented on bug 719260 and that was reopened. Some pending jobs were cancelled.

Build Engineers

armenzg - Tracking bug: bug 718783, jhford

Signed-off Revision(s)

Build 1: 52cf2b0c8439

L10N changesets

Instructions on how to get them

Firefox: l10n-changesets
Fennec: No signed off revisions

Build data

Firefox

Build #	Type	Build ID	Build machine	Time to build
1	Linux	20120222074758	mv-moz2-linux-ix-slave10	1 hrs, 4 mins, 49 secs
	Linux64		moz2-linux64-slave01	2 hrs, 48 mins, 31 secs
	Mac		moz2-darwin10-slave08	3 hrs, 43 mins, 7 secs
	Windows		mw32-ix-slave14	3 hrs, 42 mins, 14 secs

Fennec

Build #	Type	Build ID	Build machine	Time to build
1	android-xul	20120222074758	mv-moz2-linux-ix-slave08	53 mins, 56 secs

Notes

Build 1

Preparing to start Automation

Set clobbers for the appropriate masters. Doing this 24-48 hours in advance should speedup the build.
Reserve slaves
Update l10n changesets for desktop, ~~mobile~~ (no L10n for mobile)
Land automation configs
Tag buildbot-configs, buildbotcustom, & tools with build & release tags
update and reconfigure the master
start automation

cd master . ../bin/activate

PYTHONPATH=. python ../tools/buildbot-helpers/release_sanity.py -u armenzg -pfirefox,fennec \
 -V 11.0b4 --branch mozilla-beta --build-number 1 -c release-firefox-mozilla-beta.py -c release-fennec-mozilla-beta.py \
 --dryrun  localhost:9001 2>&1 | tee armenzg.out

See ERROR output section below for more information on why I am using "-b" to skip the errors:

PYTHONPATH=. python ../tools/buildbot-helpers/release_sanity.py -u armenzg -pfirefox,fennec \
 -V 11.0b4 --branch mozilla-beta --build-number 1 -c release-firefox-mozilla-beta.py -c release-fennec-mozilla-beta.py \
 -b  localhost:9001 2>&1 | tee armenzg.out

reconfigure other masters (or ask the buildduty person to do this) if you have done a merge (and not double-land) to production

ERROR output

It seems that these ERRORS are expected or have to be fixed.

I filed bug 729516 and bug 725300 was already filed.

2012-02-22 06:57:40,483 : INFO : Comparing fennec mozconfigs to nightly mozconfigs...
2012-02-22 06:57:46,910 : ERROR : MISSING: http://hg.mozilla.org/releases/mozilla-beta/raw-file/52cf2b0c8439/mobile/android/config/mozconfigs/android/release - ERROR: Not Found
2012-02-22 06:57:52,971 : INFO : Missing mozconfigs to compare for android
2012-02-22 06:57:59,573 : ERROR : MISSING: http://hg.mozilla.org/releases/mozilla-beta/raw-file/52cf2b0c8439/mobile/xul/config/mozconfigs/android/release - ERROR: Not Found
2012-02-22 06:58:05,424 : INFO : Missing mozconfigs to compare for android-xul
2012-02-22 06:58:05,555 : INFO : Comparing tagged revision http://hg.mozilla.org/build/buildbot-configs/raw-file/FENNEC_11_0b4_BUILD1/mozilla/release-fennec-mozilla-beta.py to on-disk release-fennec-mozilla-beta.py ...
2012-02-22 06:58:05,755 : INFO : Comparing tagged revision http://hg.mozilla.org/build/buildbot-configs/raw-file/FENNEC_11_0b4_BUILD1/mozilla/l10n-changesets_mobile-beta.json to on-disk l10n-changesets_mobile-beta.json ...
2012-02-22 06:58:05,765 : INFO : Comparing l10n changesets on dashboard https://l10n-stage-sj.mozilla.org/shipping/l10n-changesets?ms=fennec11_beta_b4 to on-disk l10n-changesets_mobile-beta.json ...
2012-02-22 06:58:05,809 : INFO : Checking for existence of http://hg.mozilla.org/releases/mozilla-beta/rev/52cf2b0c8439...
2012-02-22 06:58:11,663 : INFO : Got: http://hg.mozilla.org/releases/mozilla-beta/rev/52cf2b0c8439 !
2012-02-22 06:58:11,666 : INFO : Comparing firefox mozconfigs to nightly mozconfigs...
2012-02-22 06:58:23,947 : ERROR : not in release mozconfig's whitelist (releases/mozilla-beta/macosx64/nightly) : ac_add_options --enable-official-branding
2012-02-22 06:58:23,947 : ERROR : not in nightly mozconfig's whitelist (releases/mozilla-beta/macosx64/release) : ac_add_options --with-macbundlename-prefix=Firefox
2012-02-22 06:58:23,947 : ERROR : not in release mozconfig's whitelist (releases/mozilla-beta/macosx64/nightly) : mk_add_options MOZ_MAKE_FLAGS="-j4"
2012-02-22 06:58:36,514 : ERROR : not in release mozconfig's whitelist (releases/mozilla-beta/win32/nightly) : mk_add_options MOZ_PGO=1
2012-02-22 06:58:36,514 : ERROR : not in release mozconfig's whitelist (releases/mozilla-beta/win32/nightly) : ac_add_options --enable-official-branding
2012-02-22 06:58:48,543 : ERROR : not in release mozconfig's whitelist (releases/mozilla-beta/linux64/nightly) : ac_add_options --enable-official-branding
2012-02-22 06:58:48,543 : ERROR : not in release mozconfig's whitelist (releases/mozilla-beta/linux64/nightly) : mk_add_options MOZ_PGO=1
2012-02-22 06:58:48,543 : ERROR : not in release mozconfig's whitelist (releases/mozilla-beta/linux64/nightly) : mk_add_options PROFILE_GEN_SCRIPT='$(PYTHON) @MOZ_OBJDIR@/_profile/pgo/profileserver.py 10'
2012-02-22 06:59:00,548 : ERROR : not in release mozconfig's whitelist (releases/mozilla-beta/linux/nightly) : ac_add_options --enable-official-branding
2012-02-22 06:59:00,548 : ERROR : not in release mozconfig's whitelist (releases/mozilla-beta/linux/nightly) : mk_add_options MOZ_PGO=1
2012-02-22 06:59:00,548 : ERROR : not in release mozconfig's whitelist (releases/mozilla-beta/linux/nightly) : mk_add_options PROFILE_GEN_SCRIPT='$(PYTHON) @MOZ_OBJDIR@/_profile/pgo/profileserver.py 10'
2012-02-22 06:59:00,548 : ERROR : Error verifying mozconfigs

E-mail Metrics

Use the address "metrics-alerts < AT > mozilla < PERIOD > org"

For 11.0b4 it would be

Firefox,firefox,firefox,11.0b4,11.0
Fennec,firefox-mobile,fennec,11.0b4,11.0

Tag

No problems.

Bouncer Submitter

No problems.

Source

No problems.

Build

Firefox

No problems.

Firefox repacks

No problems.

Fennec

No problems.

XULRunner

No problems.

Source

No problems.

Build

No problems.

Signing

NOTE: use new signcode keys from d:/2011-keys and QUIT SIGNCODE when you're done with keymaster

Follow instructions in XULRunner Signing (auth required).

No problems.

Android Signing

Instructions in MobileSigning

Now run on signing1.

No problems.

L10N verify

No problems.

Checksums

No problems.

Updates

No problems.

Update verify

Two jobs per builder scheduled, commented on bug 719260 and that was reopened. Some pending jobs were cancelled.

Reset reserved slaves

Done.

Check permissions / AV scan

The files ended up in firefox/nightly/11.0b4-candidates, a real directory rather than a symlink to firefox/candidates/11.0b4-candidates (nthomas didn't document creating the symlink or resolve bug 725839 yet). This ended up causing a lot of load on stage.m.o, because it hassles the same netapp as all the development traffic. Cancelled the antivirus and moved the files to the correct location. Forced the antivirus again, running ...

bug 729998 - Check permissions failed because setgid

rail run this to fix it:

find /pub/mozilla.org/firefox/nightly/11.0b4-candidates/build1/ -mindepth 1 -type d ! -perm 755 ! -path '*/contrib*' ! -path '*/partner-repacks*' -exec chmod 755 {} \;

the re-trigger worked
to fix releases/ we did this:

find /pub/mozilla.org/firefox/releases/11.0b4 -mindepth 1 -type d ! -perm 755 ! -path '*/contrib*' ! -path '*/partner-repacks*' -exec chmod 755 {} \;

Going to Beta

Run backupsnip

NOTE: Remember to do this at least an hour ahead of the expected "go to beta" email.

# cltbld@aus2-staging
cd /opt/aus2/snippets/staging
~/bin/backupsnip Firefox-11.0b4-build1

Push to beta

~/bin/pushsnip Firefox-11.0b4-build1

Final verification

Release Day

Publish Fennec to the Android Market

Push the files

Ran this script on ffxbld@stage with 11.0b4 build 1 values

Android Market

pushed

Push XULRunner to Mirrors

# xrbld@stage
rsync  -av --exclude=*.txt --exclude=*unsigned* --exclude=*-symbols.zip \
 --exclude=*.checksums --exclude=jsshell* \
 /pub/mozilla.org/xulrunner/nightly/11.0b4-candidates/build1/ \
 /pub/mozilla.org/xulrunner/releases/11.0b4/

Build #	Branch, Tags	Changeset
	MOBILE110_2012022207_RELBRANCH, FENNEC_11_0b4_RELEASE, FENNEC_11_0b4_BUILD1	0338a18c2bc8
	GECKO110_2012022207_RELBRANCH, FIREFOX_11_0b4_BUILD1 FIREFOX_11_0b4_RELEASE	0338a18c2bc8

Releases/Firefox 11.0b4/BuildNotes

Contents

Notes About Releasing

Bugs hit

Build Engineers

Signed-off Revision(s)

L10N changesets

Tags

Build data

Firefox

Fennec

Notes

Build 1

Preparing to start Automation

ERROR output

E-mail Metrics

Tag

Bouncer Submitter

Source

Build

Firefox

Firefox repacks

Fennec

XULRunner

Source

Build

Signing

Android Signing

L10N verify

Checksums

Updates

Update verify

Reset reserved slaves

Check permissions / AV scan

Going to Beta

Run backupsnip

Push to beta

Final verification

Release Day

Publish Fennec to the Android Market

Push the files

Android Market

Push XULRunner to Mirrors

Navigation menu

Search