Releases/Firefox 6.0b3/BuildNotes

From MozillaWiki
Jump to: navigation, search

Notes About Releasing

Please update the Release:Primer for future releases (bug fixes, changes to automation) as needed

Bugs hit

  • bug 673911 - until 8.0 releases it will still be named 'eabi-arm'
  • bug 673913 - to help avoid the issue that I hit which was having left BUILD=1 for activating build2 autosign, the script uses the config build # for somethings and the BUILD var for others
  • bug 673918 - to get tests to only run on test masters (not also on build masters as they did - failing - for this release)
  • bug 673303 - check key expiry dates
  • bug 674327 - bump the disk space for signing
  • bug 664539 - auto retry when update is not found at url (for update verify step)

Build Engineers

lsblakk - bug 672335

Signed-off Revision(s)

Build 1: 8d3fafa80d4b
Build 2: eaacac2007f4

L10N changesets

Tags

Build # Branch, Tags Changeset
1 MOBILE60_2011072110_RELBRANCH, FENNEC_6_0b3_RELEASE, FENNEC_6_0b3_BUILD1 97f63a5dd910
GECKO60_2011072110_RELBRANCH, FIREFOX_6_0b3_BUILD1 FIREFOX_6_0b3_RELEASE 1e49740f65a9
2 MOBILE60_2011072114_RELBRANCH, FENNEC_6_0b3_RELEASE, FENNEC_6_0b3_BUILD1 5735ffc7bed2
GECKO60_2011072114_RELBRANCH, FIREFOX_6_0b3_BUILD1 FIREFOX_6_0b3_RELEASE 7864cfd02969

Build data

Firefox

Build # Type Build ID Build machine Time to build
2 20110721152715
Linux mv-moz2-linux-ix-slave21 2 hrs, 23 mins
Linux64 moz2-linux64-slave12 4 hrs, 33 mins
Mac moz2-darwin10-slave53 4 hrs, 14 mins
Windows mw32-ix-slave04 2 hrs, 30 mins

Fennec

Build # Type Build ID Build machine Time to build
2 android 20110721142609 mv-moz2-linux-ix-slave04 1 hrs, 21 mins
maemo5-gtk 20110721153035 mv-moz2-linux-ix-slave15 59 mins
linux 20110721162236 linux-ix-slave15 58 mins
macosx 20110721165637 bm-xserve11 1 hrs, 49 mins
win32 20110721163344 mw32-ix-slave09 1 hrs, 23 mins

Notes

Build 1

  • commited mozharness Fennec debsign config bumps
  • tagged mozharness using
hg tag FIREFOX_6_0b3_BUILD1 FIREFOX_6_0b3_RELEASE FENNEC_6_0b3_BUILD1 FENNEC_6_0b3_RELEASE
  • hit ship for Firefox 6 beta build 3 and Fennec 6 beta build 3 https://l10n-stage-sj.mozilla.org/shipping/milestones
    • In Fennec configs, generated a json for linux,macosx,win32, maemo-multilocale, android-multilocale
  • buildbot-configs
  • buildbotcustom was already in sync on production-0.8 so just tagged tip FIREFOX_6_0b3_BUILD1 FIREFOX_6_0b3_RELEASE FENNEC_6_0b3_BUILD1 FENNEC_6_0b3_RELEASE
  • tagged tools using FIREFOX_6_0b3_BUILD1 FIREFOX_6_0b3_RELEASE FENNEC_6_0b3_BUILD1 FENNEC_6_0b3_RELEASE
  • reserved 10 slaves on bm08
# in /builds/buildbot/build1/master
echo 10 > reserved_slaves_bm08-build1
  • Marked "Any master", "mozilla-beta", "Any builder" for a clobber
# in /builds/buildbot/build1
make update
  • release sanity noop:
PYTHONPATH=. ../bin/python ../tools/buildbot-helpers/release_sanity.py -u lsblakk \
-V 6.0b3 --branch mozilla-beta --build-number 1 -c release-firefox-mozilla-beta.py \
--dryrun --products firefox,fennec localhost:9001
  • start automation:
# buildbot should in in $PATH, source ve env
source ../bin/activate
PYTHONPATH=. ../bin/python ../tools/buildbot-helpers/release_sanity.py -u lsblakk \
-V 6.0b3 --branch mozilla-beta --build-number 1 -c release-firefox-mozilla-beta.py \
--products firefox,fennec localhost:9001

Tag

No problems

Bouncer Submitter

No problems All stop email went out because of a startup crash causing patch that was backed out

Build 2

  • buildbotcustom tagged production-0.8 tip FIREFOX_6_0b3_BUILD2 FIREFOX_6_0b3_RELEASE FENNEC_6_0b3_BUILD2 FENNEC_6_0b3_RELEASE
  • tagged tools using FIREFOX_6_0b3_BUILD2 FIREFOX_6_0b3_RELEASE FENNEC_6_0b3_BUILD2 FENNEC_6_0b3_RELEASE
  • committed mozharness Fennec debsign bumps
  • tagged mozharness using
hg tag -f FIREFOX_6_0b3_BUILD2 FIREFOX_6_0b3_RELEASE FENNEC_6_0b3_BUILD2 FENNEC_6_0b3_RELEASE
  • committed Firefox/Fennec configs with revision and build number bumps (on production branch)
hg tag -f FIREFOX_6_0b3_BUILD2 FIREFOX_6_0b3_RELEASE FENNEC_6_0b3_BUILD2 FENNEC_6_0b3_RELEASE
  • Marked "Any master", "mozilla-beta", "Any builder" for a clobber
# in /builds/buildbot/build1
make update
  • release sanity noop:
PYTHONPATH=. ../bin/python ../tools/buildbot-helpers/release_sanity.py -u lsblakk \
-V 6.0b3 --branch mozilla-beta --build-number 2 -c release-firefox-mozilla-beta.py \
--dryrun --products firefox,fennec localhost:9001
  • start automation:
# buildbot should in in $PATH, source ve env
source ../bin/activate
PYTHONPATH=. ../bin/python ../tools/buildbot-helpers/release_sanity.py -u lsblakk \
-V 6.0b3 --branch mozilla-beta --build-number 2 -c release-firefox-mozilla-beta.py \
--products firefox,fennec localhost:9001

Tag

No problems.

Bouncer Submitter

already done in the first build

Source

First build failed because my clobber hadn't happened due to slow page loading and getting distracted elsewhere. So I forced build on it after completing the clobber and the second run was fine.

Start autosign

Trying to start autosign and unable to get the gpg key to work, turns out it expired on July 20, 2011 as shown with:

gpg --list-keys

I (bhearsum) logged onto the machine after finding it was taking a long time to finish signing. It had run out of space, so I cleared it out and it proceeded. After that, it refused to start signing, citing missing source packages. They were there, and I couldn't figure out why it was complaining, so I killed the process to see how it was invoked. Turns out that this command was used:

make autosign PRODUCT=firefox VERSION=6.0b3 BUILD=1 REPO=releases/mozilla-beta EMAIL=release@mozilla.com KEYDIR=d:/2010-keys RELCONFIG=mozilla/release-firefox-mozilla-beta.py

Note the BUILD=1 when it should be BUILD=2.

This got me paranoid about what was actually in signed-build2 and unsigned-build2, so I moved them and restarted signing:

mv signed-build2 signed-build2-unknown-contents
mv unsigned-build2 unsigned-build2-unknown-contents
PRODUCT=firefox
VERSION=6.0b3
BUILD=2
TAG=FIREFOX_6_0b3_RELEASE
REPO='releases/mozilla-beta'
EMAIL=release@mozilla.com
KEYDIR=d:/2010-keys
RELCONFIG=mozilla/release-firefox-mozilla-beta.py
make autosign PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} RELCONFIG=${RELCONFIG}

Had to start signcodepwd.exe and enter passphrase, too. Not sure how original signing attempt got around that.

Build

Firefox

No problems

Fennec

No problems

= Android

No problems

Maemo5-GTK

No problems

Desktop Builds

No problems

Desktop repacks

No problems

XulRunner

No problems

Repacks

Firefox

No problems

Fennec

No problems

Firefox Signing

Android Signing

  • followed instructions (now updated to 0.8) with no problems

Android Signature Verification

  • did signature verification as per instructions
  • locked linux-ix-slave12 to pm02-bb07 master to pick up the jobs
  • failing - need to figure out why - turns out android_signature_verifcation was ported to 0.8, it wasn't triggered by the automation but ran fine when forced with 'who' set to the apk (once for en-US, once for multi)
  • filed bug 673911

Maemo5-GTK repos

L10N verify

  • other than l10n metadiff failures (string changes), there was nothing unusual or alarming

Updates

No problems

Update verify

Retriggered release-mozilla-beta-win32_update_verify_7/10 builder because first one failed on trying to get the update (which on checking the url was in fact available):

FAIL: no complete update found for https://aus2.mozilla.org/update/1/Firefox/4.0b12/20110222210221/WINNT_x86-msvc/he/betatest/update.xml?force=1
FAIL: download_mars returned non-zero exit code: 1
Using  https://aus2.mozilla.org/update/1/Firefox/4.0b12/20110222210221/WINNT_x86-msvc/hi-IN/betatest/update.xml?force=1

Check permissions / AV scan

No problems

Push files to internal mirrors

Edit /pub/mozilla.org/zz/rsyncd-mozilla-releases.exclude on stage (as cltbld), add 6.0b3 to list of directories to exclude.

After waiting 10 minutes, forced the "release-mozilla-beta-push_to_mirrors" with the following property:

script_repo_revision: FIREFOX_6_0b3_RELEASE

Push to beta

For the love of all that is good in the world use screen. Did this backupsnip while working remotely from the hotel in Toronto and lost connection to build VPN during, no screen session in place. Fortunately it came back to life and the backupsnip completed in due time.

ssh cltbld@aus2-staging
cd /opt/aus2/snippets/staging
~/bin/backupsnip Firefox-6.0b3-build2
~/bin/pushsnip Firefox-6.0b3-build2

Publish Fennec

Create bouncer entry for maemo

  • added Firefox-Mobile-6.0b3 product
  • added location for maemo: /mobile/releases/maemo/:lang/firefox-beta.install

Push the files

Copied Rail's script to push_fennec.sh on ffxbld@stage's ~ dir, adjusted VERSION and BUILDNUM, then ran

./push_fennec.sh

Checked the dirs and symlinks created and all looked good.

Publish to the Android Market

d8af9451d68af4833d54fe2a1aafda7f  fennec-6.0b3.multi.eabi-arm.apk

Push to external mirrors

nothing to do here, this is a beta