Releases/Firefox 3.6.25/BuildNotes

From MozillaWiki
Jump to: navigation, search

Notes About Releasing

Please update the Notes Template and the Release:Primer for future releases (bug fixes, changes to automation) as needed

Bugs hit

Build Engineers

{bhearsum} - Tracking bug: bug 702763

Signed-off Revision(s)

Build 1: eefedeec832e

L10N changesets

Instructions on how to get them

  • Firefox: link to the l10n-changesets

Tags

Build # Branch, Tags Changeset
GECKO80_#_RELBRANCH, FIREFOX_VERSION_BUILD1 FIREFOX_VERSION_RELEASE eefedeec832e

Build data

Firefox

Build # Type Build ID Build machine Time to build
1 Linux 20111212142243 mv-moz2-linux-ix-slave04 43 mins, 16 secs
Mac bm-xserve11 2 hrs, 10 mins, 40 secs
Windows mw32-ix-slave14 1 hrs, 6 mins, 9 secs

Notes

Build 1

Preparing to start Automation

  • Marked "any master", "mozilla-1.9.2", "any builder" for a clobber
  • Landed release config update
  • Tagged buildbot-configs, buildbotcustom, and build/tools with FIREFOX_3_6_25_{RELEASE,BUILD1}
  • Set reserved_slaves_bm08 to 16 (after it had already been set to 10 for 9.0b6)
  • Ran release_sanity's dry-run:
cd /builds/buildbot/build1/master
source ../bin/activate
PYTHONPATH=. python ../tools/buildbot-helpers/release_sanity.py -u bhearsum -p firefox -V 3.6.25 --branch mozilla-1.9.2 --build-number 1 -c release-firefox-mozilla-1.9.2.py --dryrun localhost:9001
    • Failed because the 3.6.25 milestone didn't exist.
  • Started the release:
PYTHONPATH=. python ../tools/buildbot-helpers/release_sanity.py -u bhearsum -p firefox -V 3.6.25 --branch mozilla-1.9.2 --build-number 1 -c release-firefox-mozilla-1.9.2.py --bypass-check localhost:9001

E-mail Metrics

Sent the following mail to metrics@mozilla.com:

Firefox,firefox,firefox,3.6.25,3.6
Firefox,firefox,firefox,3.6.26pre,3.6

E-mail mirrors@mozilla.org

Didn't send it because e-mail about 9.0 will be sent to the list soon.

Tag

No problems

Bouncer Submitter

No problems

Source

No problems

Start autosign

PRODUCT=firefox
VERSION=3.6.25
BUILD=1
TAG=FIREFOX_3_6_25_RELEASE
REPO='releases/mozilla-1.9.2'
EMAIL=release@mozilla.com
KEYDIR=d:/2011-keys
RELCONFIG=mozilla/release-firefox-mozilla-1.9.2.py

cd ${HOME}/hg-tools/ # if it exists, otherwise create a fresh clone
hg pull && hg up -r ${TAG}

mkdir -p ~/signing-work/${PRODUCT}-${VERSION}/lib/python
cd ~/signing-work/${PRODUCT}-${VERSION}
cp ~/hg-tools/release/signing/* .
rsync -av ~/hg-tools/lib/python/ ./lib/python/
make autosign PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} RELCONFIG=${RELCONFIG}

Build

Firefox

No problems

Firefox repacks

No problems

Unittests / Talos

  • old_chrome burnt on Fedora
    • been permared on release and non-release builds on this branch for months. meh.
  • All unittests green except mac mochitests, which failed:
41649 ERROR TEST-UNEXPECTED-FAIL | /tests/content/media/test/test_reactivate.html | Test timed out.

XULRunner

No problems

Source

No problems

Build

No problems

Signing

Signed with:

PRODUCT=xulrunner
VERSION=3.6.25
BUILD=1
TAG=FIREFOX_3_6_25_RELEASE
REPO="releases/mozilla-1.9.2"
EMAIL=release@mozilla.com
KEYDIR=d:/2011-keys

cd ~/hg-tools
hg pull
hg up -r ${TAG}

mkdir -p ~/signing-work/${PRODUCT}-${VERSION}
cd ~/signing-work/${PRODUCT}-${VERSION}
cp ~/hg-tools/release/signing/* .

make setup PRODUCT=${PRODUCT} VERSION=${VERSION} \
BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1
rsync -av -e "ssh -i /home/cltsign/.ssh/xrbld_dsa" \
--exclude=*.txt --exclude=*-symbols.zip \
xrbld@stage.mozilla.org:/home/ftp/pub/${PRODUCT}/nightly/${VERSION}-candidates/build${BUILD}/ \
unsigned-build${BUILD}
rsync -av --exclude=unsigned unsigned-build${BUILD}/ \
signed-build${BUILD}/
rsync -av unsigned-build${BUILD}/unsigned/ \
signed-build${BUILD}/

make checksum-files create-sigs stage verify-sigs \
PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} \
REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1

rmdir signed-build${BUILD}/contrib{,-localized}

rsync -av -e "ssh -i /home/cltsign/.ssh/xrbld_dsa" \
signed-build${BUILD}/ \
xrbld@stage.mozilla.org:/home/ftp/pub/${PRODUCT}/nightly/${VERSION}-candidates/build${BUILD}/

Firefox Signing

Failed with "Failed to sign zh-TW". Possibly caused by someone logging onto the signing machine while it was signing.

cd ~/signing-work/firefox-3.6.25
rm -rf signed-build1
# removed any random file to make the download script copy the files to signed-build1 again
rm -rf unsigned-build1/update/mac/sr/firefox-3.6.25.complete.mar
make autosign PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} RELCONFIG=${RELCONFIG}

Worked fine this time. Got "signature verification succeeded" mail.

L10N verify

All green.

Updates

No problems

Update verify

Results were very slow coming due to 1-2 min d/l times for mar files, instead of a few seconds. bug 710427 filed, and traced to the mtv1-sjc1 network link failing over to the 100Mb/s backup. Once we were back on the 1Gb/s link they finished quickly, but not before we were delayed in pushing to the beta channel. Windows 9/10 is still running because we had to swap back to the 100 link.

Filed bug 710461 to make update verify do less duplicated work.

Major Update

Used "Force build" to start the major update builder.

Update verify

All green

Socorro Product Data Updates

Reset reserved slaves

  • Lowered reserved slaves to 8, because 9.0b6 was still running.

Run backupsnip

# cltbld@aus2-staging
cd /opt/aus2/snippets/staging
~/bin/backupsnip Firefox-3.6.25-build1-beta

Check permissions / AV scan

  • No permissions problems
  • Virus scan failed with:

command: START
command: ssh -l ffxbld -i /Users/cltbld/.ssh/ffxbld_dsa stage.mozilla.org extract_and_run_command.py -j2 clamdscan -m --no-summary -- /pub/mozilla.org/firefox/nightly/3.6.25-candidates/build1/
command: cwd: /builds/slave/rel-m-192-av
command: output:
Traceback (most recent call last):
  File "/usr/local/bin/extract_and_run_command.py", line 28, in ?
    from mar import BZ2MarFile
  File "/data/ffxbld/checkouts/hg-build-tools/stage/../buildfarm/utils/mar.py", line 5, in ?
    import struct, os, bz2, hashlib, tempfile
ImportError: No module named hashlib
command: END (0.90s elapsed)
  • Updated the tools checkout on surf to 233227ca07af to make *this* virus scan work. Filed bug 710299 on the root issue.
  • Didn't revert the tools checkout to the tip of default afterwards, because 9.0b6 still has to do its scan.
  • Second virus scan worked fine, no viruses found.

Push to beta

cd /opt/aus2/snippets/staging
~/bin/pushsnip Firefox-3.6.25-build1-beta

Push to internal mirrors

As cltbld@surf, added the following line to /pub/mozilla.org/zz/rsyncd-mozilla-releases.exclude:

- firefox/releases/3.6.25

After waiting 10 minutes to make sure the change was picked up, used "force build" to start the push to mirrors, no properties required.

Push to external mirrors

  • Removed the "- firefox/releases/3.6.25" line from rsyncd-mozilla-releases.exclude.
  • Updated "rsyncd-mozilla-current.exclude" to point at 3.6.25.

Final verification

Push XULRunner to Mirrors

# xrbld@stage
rsync -av --exclude=*.txt --exclude=*unsigned* --exclude=*-symbols.zip \
/pub/mozilla.org/xulrunner/nightly/3.6.25-candidates/build1/ \
/pub/mozilla.org/xulrunner/releases/3.6.25/

No need to change the rsync files it light of bug 708249.

Update XULRunner wiki page

Updated XULRunner wiki pages: https://developer.mozilla.org/en/XULRunner_1.9.2_Release_Notes
https://developer.mozilla.org/en/Gecko_SDK

Push to Release Channel

# cltbld@aus2-staging
cd /opt/aus2/snippets/staging
~/bin/backupsnip Firefox-3.6.25-build1

real    256m57.728s
user    0m12.344s
sys     1m5.200s
  • Filed bug 711174 on getting backupsnip/pushsnip to record timing information to a file. Filed bug 711176 on the NFS share being slow.
  • Pushed with:
# cltbld@aus2-staging
cd /opt/aus2/snippets/staging
~/bin/pushsnip Firefox-3.6.25-build1

Update symlinks

# ffxbld@stage
cd /pub/mozilla.org/firefox/releases
rm latest-3.6 && ln -s 3.6.25 latest-3.6

Update MU snippets to point at 9.0.1

  • Landed release config update and reconfiged bm08.
  • Used "Force build" to start the major update builder
  • Ran the following to separate out the Linux and Mac snippets, because 9.0.1 is a Linux/Mac-only release (desktop-wise):
# cltbld@aus2-staging
cd /opt/aus2/snippets/staging
rsync -av --exclude='**WINNT_x86-msvc**' Firefox-3.6.25-build1-9.0.1-build1-MU/ Firefox-3.6.25-build1-9.0.1-build1-MU-mac+linux/
rsync -av --exclude='**WINNT_x86-msvc**' Firefox-3.6.25-build1-9.0.1-build1-MU-beta/ Firefox-3.6.25-build1-9.0.1-build1-MU-beta-mac+linux/
  • Ran backupsnip:
~/bin/backupsnip Firefox-3.6.25-build1-9.0.1-build1-MU-mac+linux

Push MU

In the end, we didn't end up shipping 9.0.1, so this is the pushsnip we used:

~/bin/pushsnip  Firefox-3.6.25-build1-9.0.1-build1
~/bin/pushsnip  Firefox-3.6.25-build1-9.0.1-build1-beta