Releases/Firefox 6.0.2/BuildNotes

From MozillaWiki
Jump to: navigation, search

Contents

Notes About Releasing

Please update the Notes Template and the Release:Primer for future releases (bug fixes, changes to automation) as needed

Bugs hit

Enter any bugs pre-existing or newly discovered and filed during the release:

  • bug 684406 - mobile tagging should bump browser/version.txt
  • bug 678467 - Mobile partner repacks should be triggered automatically
  • bug 684434 - Some GPG detached signatures (asc) missing for Firefox 6.0.1, 7.0b3, & 6.0.2 build2
    • bug 634270 - separate stage -> signing machine download from unsigned-buildN -> signed-buildN rsync
    • bug 559091 - Add handling to release/signing/sign-files for when you're re-signing a build
  • bug 684911 - create_buildN_snippets fails when useBetaChannel is 0 in point releases

Build Engineers

aki - Tracking bug: bug 683543

Signed-off Revision(s)

Build 1: 80716c319d2a

L10N changesets

No locales for chemspill.

Tags

Build # Branch, Tags Changeset
1 MOBILE60_2011083111_RELBRANCH, FENNEC_6_0_2_RELEASE, FENNEC_6_0_2_BUILD1 5958db6c9d8b
GECKO60_2011083109_RELBRANCH, FIREFOX_6_0_2_BUILD1 FIREFOX_6_0_2_RELEASE 344ad0250728
2 FENNEC_6_0_2_RELEASE, FENNEC_6_0_2_BUILD2 14452010e012
FIREFOX_6_0_2_BUILD2 FIREFOX_6_0_2_RELEASE 5b6c2f8ff6da

Build data

Firefox

Build # Type Build ID Build machine Time to build
1 Linux 20110831121648 mv-moz2-linux-ix-slave09 2 hrs, 19 mins, 23 secs
Linux64 moz2-linux64-slave03
Mac moz2-darwin10-slave06 4 hrs, 14 mins, 14 secs
Windows mw32-ix-slave07 2 hrs, 37 mins, 32 secs
2 Linux 20110902133214 mv-moz2-linux-ix-slave09 2 hrs, 11 mins, 25 secs
Linux64 linux64-ix-slave15 1 hrs, 53 mins, 36 secs
Mac moz2-darwin10-slave28 4 hrs, 10 mins, 12 secs
Windows mw32-ix-slave11 2 hrs, 36 mins, 16 secs

Fennec

Build # Type Build ID Build machine Time to build
1 android 20110831131148 mv-moz2-linux-ix-slave16 1 hrs, 35 mins, 53 secs
maemo5-gtk 20110831121354 mv-moz2-linux-ix-slave06 54 mins, 54 secs
linux 20110831124717 mv-moz2-linux-ix-slave19 1 hrs, 8 mins, 26 secs
macosx 20110831135125 bm-xserve16 1 hrs, 51 mins, 49 secs
win32 20110831140347 mw32-ix-slave09 1 hrs, 16 mins, 54 secs
2 android 20110902142238 mv-moz2-linux-ix-slave16 1 hrs, 31 mins, 0 secs
maemo5-gtk 20110902140213 mv-moz2-linux-ix-slave06 1 hrs, 27 mins, 35 secs
linux 20110902135750 mv-moz2-linux-ix-slave19 1 hrs, 3 mins, 21 secs
macosx 20110902150308 bm-xserve16 1 hrs, 47 mins, 33 secs
win32 20110902145608 mw32-ix-slave10 1 hrs, 16 mins, 46 secs

Notes

buildbot-master07

Build 1

echo "10" > master/reserved_slaves_bm07-build1
  • no new l10n changesets for chemspill
  • waiting for 'go'
  • got go: 80716c319d2a
  • double landed configs
  • landed on production buildbot-configs, tagged buildbot-configs (production), mozharness, tools, buildbotcustom (production-0.8)
  • updated master
make update
  • release_sanity noop
. ../bin/activate
PYTHONPATH=. ../bin/python ../tools/buildbot-helpers/release_sanity.py -u aki -V 6.0.2 \
--branch mozilla-release --build-number 1 -c release-firefox-mozilla-release.py -c release-fennec-mozilla-release.py \
--dryrun --products firefox,fennec localhost:9001 2>&1 | tee aki.out
  • Failed on missing l10n milestone, but that's it.
rm aki.out
cd ..
make reconfig
tail -n1000 -F master/twistd.log | grep configuration
# wait til complete, then ^C
# sendchange without check
PYTHONPATH=. ../bin/python ../tools/buildbot-helpers/release_sanity.py -u aki -V 6.0.2 \
--branch mozilla-release --build-number 1 -c release-firefox-mozilla-release.py -c release-fennec-mozilla-release.py \
--bypass-check --products firefox,fennec localhost:9001

E-mail Metrics

Emailed metrics with

Firefox,firefox,firefox,6.0.2,6.0.2

Tag

No problems.

Bouncer Submitter

No problems.

Source

No problems.

Start autosign

Saved the following as ~/tmp/sign_6.0.2.sh

PRODUCT=firefox
VERSION=6.0.2
BUILD=1
TAG=FIREFOX_6_0_2_RELEASE
REPO='releases/mozilla-release'
EMAIL=release@mozilla.com
KEYDIR=d:/2010-keys
RELCONFIG=mozilla/release-firefox-mozilla-release.py

cd ${HOME}/hg-tools/
hg pull && hg up -r ${TAG}

mkdir -p ~/signing-work/${PRODUCT}-${VERSION}/lib/python
cd ~/signing-work/${PRODUCT}-${VERSION}
cp ~/hg-tools/release/signing/* .
rsync -av ~/hg-tools/lib/python/ ./lib/python/
make autosign PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} RELCONFIG=${RELCONFIG}

bash -xe sign_6.0.2.sh 2>&1 | tee sign_6.0.2.log

Build

Firefox

Fennec

Android

No problems.

Maemo5-GTK

No problems.

Desktop Builds

No problems.

Desktop repacks

No problems.

Unittests / Talos

XULRunner

Source

No problems.

Build

Signing

Repacks

Firefox

No problems.

Fennec

No problems.

Partner Repack

Firefox

Fennec

Kicked off manually.

Firefox Signing

Android Signing

Followed instructions

Android Signature Verification

No problems.

Maemo5-GTK repos

Force build on pmm:8011. No problems.

L10N verify

Updates

Update verify

Major Update

Update verify

Socorro Product Data Updates

Check permissions / AV scan

Reset reserved slaves

echo 0 > reserved_slaves_bm07

when all stop was declared.

Build 2

  • Grabbed linux64-ix-slave05, linux64-ix-slave15 in slavealloc to speed up linux64 builds.
  • Landed mozharness config
  • set clobberer for any master, mozilla-release, any builder
  • reserved 10 slaves

echo "10" > master/reserved_slaves_bm07-build1

  • no new l10n changesets for chemspill
  • waiting for 'go'
  • unreserved slaves b/c go won't be til Friday at earliest.
  • reserved 10 slaves again on friday
  • got go: 5b6c2f8ff6da (desktop), 14452010e012 (mobile)
  • double landed configs
  • updated master
make update
  • release_sanity noop
cd master
. ../bin/activate
PYTHONPATH=. ../bin/python ../tools/buildbot-helpers/release_sanity.py -u aki -V 6.0.2 \
--branch mozilla-release --build-number 2 -c release-firefox-mozilla-release.py -c release-fennec-mozilla-release.py \
--dryrun --products firefox,fennec localhost:9001 2>&1 | tee aki.out
  • verified
vi aki.out
rm aki.out
  • Started automation:
PYTHONPATH=. ../bin/python ../tools/buildbot-helpers/release_sanity.py -u aki -V 6.0.2 \
--branch mozilla-release --build-number 2 -c release-firefox-mozilla-release.py -c release-fennec-mozilla-release.py \
--products firefox,fennec localhost:9001

E-mail Metrics

Not needed.

Tag

No problems.

Bouncer Submitter

n/a

Source

No problems.

Start autosign

Saved the following as ~/tmp/sign_6.0.2.sh

PRODUCT=firefox
VERSION=6.0.2
BUILD=2
TAG=FIREFOX_6_0_2_RELEASE
REPO='releases/mozilla-release'
EMAIL=release@mozilla.com
KEYDIR=d:/2010-keys
RELCONFIG=mozilla/release-firefox-mozilla-release.py

cd ${HOME}/hg-tools/
hg pull && hg up -r ${TAG}

mkdir -p ~/signing-work/${PRODUCT}-${VERSION}/lib/python
cd ~/signing-work/${PRODUCT}-${VERSION}
cp ~/hg-tools/release/signing/* .
rsync -av ~/hg-tools/lib/python/ ./lib/python/
make autosign PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} RELCONFIG=${RELCONFIG}
bash -xe sign_6.0.2.sh 2>&1 | tee sign_6.0.2.log

Build

Firefox

No problems.

Fennec

Android

No problems.

Maemo5-GTK

No problems.

Desktop Builds

No problems.

Desktop repacks

No problems.

Unittests / Talos

XULRunner

Source

No problems.

Build

No problems.

Signing

PRODUCT=xulrunner
VERSION=6.0.2
BUILD=2
TAG=FIREFOX_6_0_2_RELEASE
REPO="releases/mozilla-release"
EMAIL=release@mozilla.com
KEYDIR=d:/2010-keys

cd ~/hg-tools
hg pull
hg up -r ${TAG}

mkdir -p ~/signing-work/${PRODUCT}-${VERSION}
cd ~/signing-work/${PRODUCT}-${VERSION}
cp ~/hg-tools/release/signing/* .

make setup PRODUCT=${PRODUCT} VERSION=${VERSION} \
  BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1
rsync -av -e "ssh -i /home/cltsign/.ssh/xrbld_dsa" \
  --exclude=*.txt --exclude=*-symbols.zip \
  xrbld@stage.mozilla.org:/home/ftp/pub/${PRODUCT}/nightly/${VERSION}-candidates/build${BUILD}/ \
 unsigned-build${BUILD}
rsync -av --exclude=unsigned unsigned-build${BUILD}/ \
 signed-build${BUILD}/
rsync -av unsigned-build${BUILD}/unsigned/ \
 signed-build${BUILD}/

make checksum-files create-sigs stage verify-sigs \
  PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} \
  REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1

rmdir signed-build${BUILD}/contrib{,-localized}

rsync -av -e "ssh -i /home/cltsign/.ssh/xrbld_dsa" \
  signed-build${BUILD}/ \
  xrbld@stage.mozilla.org:/home/ftp/pub/${PRODUCT}/nightly/${VERSION}-candidates/build${BUILD}/

Repacks

Firefox

No problems.

Fennec

No problems.

Partner Repack

Firefox

No problems.

Fennec

Kicked off manually. No problems.

Firefox Signing

Ran out of disk :(

  • nuked [un]signed-build1 and had 27gb; reran signing.
  • Failed again; moved signed-build2 to broken-signed-build2 and reran signing.
  • that worked!

Except not: bug 684434.

Saved the following as ~/tmp/fix_6.0.2.sh

PRODUCT=firefox
VERSION=6.0.2
BUILD=2
TAG=FIREFOX_6_0_2_RELEASE
REPO='releases/mozilla-release'
EMAIL=release@mozilla.com
KEYDIR=d:/2010-keys
RELCONFIG=mozilla/release-firefox-mozilla-release.py

cd ~/signing-work/${PRODUCT}-${VERSION}
make download PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} RELCONFIG=${RELCONFIG}
make verify-download PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} RELCONFIG=${RELCONFIG}
make checksum-files PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} RELCONFIG=${RELCONFIG}
make create-sigs PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} RELCONFIG=${RELCONFIG}
make verify-sigs PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} RELCONFIG=${RELCONFIG}
make fake-upload PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} RELCONFIG=${RELCONFIG}

I commented out every make line except download, and ran

bash -xe fix_6.0.2.sh 2>&1 | tee -a fix_6.0.2.log

Then proceeded down the list.

create-sigs didn't re-create the MD5SUMS.asc and SHA1SUMS.asc files; perhaps it should do make timestamp checks? bug 559091

Blew away those two asc files and reran create-sigs and verify-sigs.

Android Signing

Followed instructions.

Android Signature Verification

No problems.

Maemo5-GTK repos

Force built pmm:8011. No problems.

L10N verify

No problems.

Updates

Burned because create_buildN_snippets failed (probably because useBetaChannel was set to 0, and that flag in that state doesn't work quite right for point releases. Need to file & fix this.

Manually sent mail to release-drivers announcing updates on betatest, used force build to trigger all update verify builders, antivirus, and permissions check

(Aki filed bug 684911)

Update verify

No problems.

Major Update

Update verify

Socorro Product Data Updates

Check permissions / AV scan

No problems.

Reset reserved slaves

Set to 0. Also reset linux64-ix-slave05, linux64-ix-slave15 in slavealloc.

Push files to internal mirrors

  • already added exclude for 6.0.2 to rsyncd-mozilla-releases.exclude:
- firefox/releases/6.0.2


~/bin/backupsnip Firefox-6.0.2-build2 2>&1 | tee aki.out

Push to beta

Skipped.

Push XULRunner to Mirrors

from a slave:

ssh -l xrbld -i ~/.ssh/xrbld_dsa stage.mozilla.org
# DRYRUN
rsync -n -av --exclude=*.txt --exclude=*unsigned*  --exclude=*-symbols.zip --exclude=*.checksums \
/pub/mozilla.org/xulrunner/nightly/6.0.2-candidates/build2/ /pub/mozilla.org/xulrunner/releases/6.0.2/
# FOR REAL
rsync -av --exclude=*.txt --exclude=*unsigned*  --exclude=*-symbols.zip --exclude=*.checksums \
/pub/mozilla.org/xulrunner/nightly/6.0.2-candidates/build2/ /pub/mozilla.org/xulrunner/releases/6.0.2/

Update XULRunner wiki page

Updated https://developer.mozilla.org/en/Gecko_SDK .

Publish Fennec

Create bouncer entry for maemo

Added /mobile/releases/maemo/:lang/firefox.install for Firefox-Mobile-6.0.2

Push the files

Used the following script (~ffxbld/push_fennec_release.sh on stage):

export VERSION=6.0.2
export BUILDNUM=2
export RD=/home/ftp/pub/mozilla.org/mobile/releases
export CD=/home/ftp/pub/mozilla.org/mobile/candidates

mkdir $RD/$VERSION
cd $RD/$VERSION

rsync -av --exclude=unsigned --exclude=*.txt --exclude=*crashreporter* \
 --exclude=*tests* --exclude=*unaligned* --exclude=*old* --exclude=*install* \
 --exclude=*logs* \
 $CD/$VERSION-candidates/build$BUILDNUM/ $RD/$VERSION/

for p in linux macosx win32; do
    locales=`cd $CD/$VERSION-candidates/build$BUILDNUM/$p/; ls -1 --hide=en-US`
    for i in $locales; do
        cp -a $CD/$VERSION-candidates/build$BUILDNUM/$p/$i/install/*.xpi \
          $RD/$VERSION/$p/$i
    done
done

# repos
mkdir $RD/$VERSION/repos
rsync -av --exclude=*.install $CD/$VERSION-candidates/repos/ $RD/$VERSION/repos/

# symlink repos
rm -f maemo
ln -s repos maemo

# link fremantle to chinook for multi deb repo
cd $RD/$VERSION/maemo/multi/dists
ln -s fremantle chinook

cd $RD
rm -f latest
ln -s $VERSION latest

Publish to the Android Market

IMPORTANT - Make sure to follow instructions! See 6.0b6's push to Market.

Push index file to mirrors

Push to external mirrors

Removed 6.0.2 from stage:/pub/mozilla.org/zz/rsyncd-mozilla-releases.exclude

Final verification

Force built; had to rekick a couple of them to get them to go green.

Push to Release Channel

time ~/bin/pushsnip Firefox-6.0.2-build2
# 7m for mpt
# 2m for phx
# 9m total

Update symlinks

rm latest-6.0; ln -s 6.0.2 latest-6.0

Update browser choice website

Filed bug 684905 - Please update browserchoice website and download links for EUballot for Fx 6.0.2