Releases/Firefox 10.0.1/BuildNotes

From MozillaWiki
Jump to: navigation, search

Notes About Releasing

Please update the Notes Template and the Release:Primer for future releases (bug fixes, changes to automation) as needed

Bugs hit

Enter any bugs pre-existing or newly discovered and filed during the release:

  • bug 725889 - start_uptake_monitoring triggers both ready-for-{release,releasetest} (and probably shouldn't when we've only gone to internal mirrors)
  • bug 718385 -- we had mobile repack failures due to the changes in this bug, no big deal

Lots of release_sanity/mozconfig verification stuff (I took these):

Build Engineers

lsblakk - Tracking bug: bug 725106

Signed-off Revision(s)

Build 1: 18ce5e304e97

L10N changesets

Re-using 10.0 release's l10n changesets

Tags

Build # Branch, Tags Changeset
1 MOBILE1001_2012020805_RELBRANCH, FENNEC_10_0_1_RELEASE, FENNEC_10_0_1_BUILD1 50deb2848ccb
GECKO1001_2012020805_RELBRANCH, FIREFOX_10_0_1_BUILD1 FIREFOX_10_0_1_RELEASE 0fde76e493ac

Build data

Firefox

Build # Type Build ID Build machine Time to build
1 Linux 20120208060813 mv-moz2-linux-ix-slave11 1 hrs, 11 mins, 31 secs
Linux64 moz2-linux64-slave03 3 hrs, 54 mins, 7 secs
Mac moz2-darwin10-slave24 3 hrs, 43 mins, 47 secs
Windows mw32-ix-slave03 3 hrs, 8 mins, 4 secs

Fennec

Build # Type Build ID Build machine Time to build
1 android 20120208061104 mv-moz2-linux-ix-slave06 1 hrs, 47 mins, 10 secs
linux mv-moz2-linux-ix-slave12 1 hrs, 7 mins, 27 secs
macosx bm-xserve15 2 hrs, 9 mins, 14 secs
win32 mw32-ix-slave02 1 hrs, 26 mins, 43 secs

Notes

Build 1

Preparing to start Automation

  • set clobbers for "any master", "mozilla-release", "any builder"
  • set reserved_slaves to 16 (8 for this, 8 for 10.0.1esr)
  • landed release config update
  • tagged buildbot-configs, buildbotcustom, tools with FIREFOX_10_0_1_{BUILD1,RELEASE}
  • updated and reconfiged bm07 (at the same time as the reconfig for 10.0.1esr)
  • ran release_sanity.py dry-run:
source ../bin/activate
cd /builds/buildbot/build1/master
PYTHONPATH=. ../bin/python ../tools/buildbot-helpers/release_sanity.py -u bhearsum -V 10.0.1 --branch mozilla-release --build-number 1 -c release-firefox-mozilla-release.py -c release-fennec-mozilla-release.py --dryrun --products firefox,fennec localhost:9001
    • Complained about missing mozconfigs for mobile bug 725294
      • This probably never worked, ignored it.
    • Complained about FENNEC_10_0_1_BUILD1 tag being missing (but only in the mozconfig comparison... bug 725297)
      • Tagged configs, custom, and tools with FENNEC_10_0_1_{BUILD1,RELEASE}
    • Complained about dashboard entries for both produts being missing
      • Ignorable
    • Complained about a bunch of desktop mozconfig differences:
2012-02-08 05:30:44,782 : ERROR : not in release mozconfig's whitelist (releases/mozilla-release/macosx64/nightly) : ac_add_options --enable-official-branding
2012-02-08 05:30:44,783 : ERROR : not in nightly mozconfig's whitelist (releases/mozilla-release/macosx64/release) : ac_add_options --with-macbundlename-prefix=Firefox
2012-02-08 05:30:44,783 : ERROR : not in release mozconfig's whitelist (releases/mozilla-release/macosx64/nightly) : mk_add_options MOZ_MAKE_FLAGS="-j4"
2012-02-08 05:31:05,487 : ERROR : not in release mozconfig's whitelist (releases/mozilla-release/win32/nightly) : mk_add_options MOZ_PGO=1
2012-02-08 05:31:05,488 : ERROR : not in release mozconfig's whitelist (releases/mozilla-release/win32/nightly) : ac_add_options --enable-official-branding
2012-02-08 05:31:23,229 : ERROR : not in release mozconfig's whitelist (releases/mozilla-release/linux64/nightly) : ac_add_options --enable-official-branding
2012-02-08 05:31:23,229 : ERROR : not in release mozconfig's whitelist (releases/mozilla-release/linux64/nightly) : mk_add_options MOZ_PGO=1
2012-02-08 05:31:23,229 : ERROR : not in release mozconfig's whitelist (releases/mozilla-release/linux64/nightly) : mk_add_options PROFILE_GEN_SCRIPT='$(PYTHON) @MOZ_OBJDIR@/_profile/pgo/profileserver.py 10'
2012-02-08 05:31:37,827 : ERROR : not in release mozconfig's whitelist (releases/mozilla-release/linux/nightly) : ac_add_options --enable-official-branding
2012-02-08 05:31:37,827 : ERROR : not in release mozconfig's whitelist (releases/mozilla-release/linux/nightly) : mk_add_options MOZ_PGO=1
2012-02-08 05:31:37,827 : ERROR : not in release mozconfig's whitelist (releases/mozilla-release/linux/nightly) : mk_add_options PROFILE_GEN_SCRIPT='$(PYTHON) @MOZ_OBJDIR@/_profile/pgo/profileserver.py 10'
2012-02-08 05:31:37,827 : ERROR : Error verifying mozconfigs
      • Output is really hard to read. Eg, the first line means "this was found in the release config but not the nightly one" bug 725300
      • Path to mozconfigs is wrong. bug 725302
      • Some output is wrong: both nightly and release mac mozconfigs have the same MOZ_MAKE_FLAGS line, just in different places bug 725309
      • --with-macbundle-name-prefix shouldn't be set in mozilla-release nightly mozconfig, probably got accidentally inherited bug 717824
      • --enable-official-branding needs to be added to whitelist bug 725303
      • MOZ_PGO/PROFILE_GEN_SCRIPT is set in release mozconfig but not nightly one. either needs to be added to whitelist or turned on in nightly mozconfigs bug 725307
  • With all errors being accounted for, ran release_sanity.py again with --bypass-check to get things going:
PYTHONPATH=. ../bin/python ../tools/buildbot-helpers/release_sanity.py -u bhearsum -V 10.0.1 --branch mozilla-release --build-number 1 -c release-firefox-mozilla-release.py -c release-fennec-mozilla-release.py --bypass-check --products firefox,fennec localhost:9001

E-mail Metrics

Sent the following mail to metrics-alerts@mozilla.org: 

Firefox,firefox,firefox,10.0.1,10.0
Fennec,firefox-mobile,fennec,10.0.1,10.0

E-mail mirrors@mozilla.org

Sent the following mail to mirrors@mozilla.org: 

Subject: Firefox 10.0.1 coming to mirrors sometime late February 8th or February 9th PST
Body:
We're planning on pushing our Firefox 10.0.1 release to mirrors 24 as soon as it's ready and planning to release it to users on February 10th.

If you believe these releases or these dates will cause any problems,
please notify release at mozilla.com. If you have any problems with mirror
status/weights/etc, please notify mirror-submissions at mozilla.org.

Tag

No problems

Bouncer Submitter

No problems

Source

No problems

Start autosign

PRODUCT=firefox
VERSION=10.0.1
BUILD=1
TAG=FIREFOX_10_0_1_RELEASE
REPO='releases/mozilla-release'
EMAIL=release@mozilla.com
KEYDIR=d:/2011-keys
RELCONFIG=mozilla/release-firefox-mozilla-release.py

cd ${HOME}/hg-tools/ # if it exists, otherwise create a fresh clone
hg pull && hg up -r ${TAG}

mkdir -p ~/signing-work/${PRODUCT}-${VERSION}/lib/python
cd ~/signing-work/${PRODUCT}-${VERSION}
cp ~/hg-tools/release/signing/* .
rsync -av ~/hg-tools/lib/python/ ./lib/python/
make autosign PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} RELCONFIG=${RELCONFIG}

Build

Firefox

No problems.

Firefox repacks

Fennec

Android

No problems

Desktop Builds

No problems

Mobile Desktop repacks
  • linux-mobile repack builders blew out with:
IOError: Can't find single_locale/release_mozilla-release_linux-mobile.py in ['.', '/builds/slave/rel-m-rel-lnx-mb-rpk-2/scripts/scripts/../configs', '/builds/slave/rel-m-rel-lnx-mb-rpk-2/scripts/scripts/../../configs']!
    • I think this is a problem with the work from bug 718385

Unittests / Talos

XULRunner

Source

No problems

Build

No problems

Signing

No problems

Partner Repack

Firefox

No problems

Fennec

N/A

Firefox Signing

No problems

Android Signing

No problems, updated and ran sign_android-0.8.sh

Android Signature Verification

No problems

L10N verify

Had to kick the win32 a second time cause first attempt timed out, second run was fine and other platforms had no problems.

Updates

  • Updates died on connection failure, had to comment out the bumpVerifyConfigs in factory, reconfig, rebuild, then uncommented and reconfiged again.
  • Next attempt generated updates fine, but kept timing out when running backupsnip.
    • Killed the job, and did the following by hand to finish it up:
# cltbld@aus2-staging
cd /opt/aus2/snippets/staging
~/bin/pushsnip Firefox-10.0.1-build1-test

# cltbld@mv-moz2-linux-ix-slave17
cd /builds/slave/rel-m-rel-updates/build/temp/firefox/10.0-10.0.1
rsync -av -e 'ssh -oIdentityFile=~/.ssh/cltbld_dsa' aus2/ cltbld@aus2-staging.mozilla.org:/opt/aus2/snippets/staging/Firefox-10.0.1-build1/
  • Manually forced the "check permissions" builder
  • Manually forced the update verify builders after the pushsnip completed

Update verify

Major Update

double-landed patch to major update configs, reconfig'd bm08 and kicked off the 1.9.2 MU builder

Major Update verify

Reset reserved slaves

cd /builds/buildbot/build1
echo 0 > master/reserved_slaves_bm07-build1

Check permissions / AV scan

  • No permissions problems

Before Release Day

Run backupsnip for release snippets

Shared a backupsnip with 11.0b2. (This is OK because 11.0b2 backs up all versions from 4 through 11, including all of the release channel snippets. Since 11.0b2 and this release will be overwriting different snippets, there's no reason to run a separate backup here.)

Push files to internal mirrors

updated stage:/pub/mozilla.org/zz/rsyncd-mozilla-releases.exclude in advance to add

- firefox/releases/10.0.1

Waited 10 minutes, then forced the "push to mirrors" builder

Final verification

Push to external mirrors

Removed "- firefox/releases/10.0.1" line from /pub/mozilla.org/zz/rsyncd-mozilla-releases.exclude on surf as cltbld.

Release Day

Publish Fennec to the Android Market

Push the files
Android Market

IMPORTANT - Make sure to follow instructions!

Push XULRunner to Mirrors

rsync -avn --exclude=*.txt --exclude=*unsigned* --exclude=*-symbols.zip --exclude=*.checksums \
--exclude 'jsshell-*' /pub/mozilla.org/xulrunner/nightly/10.0.1-candidates/build1/ \
 /pub/mozilla.org/xulrunner/releases/10.0.1/

rsync -av --exclude=*.txt --exclude=*unsigned* --exclude=*-symbols.zip --exclude=*.checksums \
--exclude 'jsshell-*' /pub/mozilla.org/xulrunner/nightly/10.0.1-candidates/build1/ \
/pub/mozilla.org/xulrunner/releases/10.0.1/

Update XULRunner wiki page

For major releases or chemspills, update the links on:

Push to Release Channel

# cltbld@aus2-staging
cd /opt/aus2/snippets/staging
~/bin/pushsnip Firefox-10.0.1-build1

Unthrottle 4.0 through 9.0.1

Per release drivers request, we unthrottled these releases in bug 726159.

Update symlinks

# ffxbld@stage
cd /pub/mozilla.org/firefox/releases
rm latest-10.0 && ln -s 10.0.1 latest-10.0

Update browser choice website

Filed bug 726164

Push 3.6.26 -> 10.0.1 Major Update

We pushed this unthrottled from the get go, tracked in bug 722399.

Snippet push: 

# cltbld@aus2-staging
cd /opt/aus2/snippets/staging
~/bin/backupsnip Firefox-3.6.26-build2-10.0.1-build1-MU
~/bin/pushsnip Firefox-3.6.26-build2-10.0.1-build1-MU

After the push, landed the patch to bump the throttling and filed bug 727173 to have it made live.

Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_10.0.1/BuildNotes&oldid=397323"