Releases/Firefox 3.6.23/BuildNotes

From MozillaWiki
Jump to: navigation, search

Notes About Releasing

Please update the Notes Template and the Release:Primer for future releases (bug fixes, changes to automation) as needed

Bugs hit

Enter any bugs pre-existing or newly discovered and filed during the release:

Build Engineers

armenzg - Tracking bug: bug 686888

Signed-off Revision(s)

Build 1: 398ffaf81015

L10N changesets

Tags

Build # Branch, Tags Changeset
1 GECKO19220_2011092007_RELBRANCH, FIREFOX_3_6_23_BUILD1 FIREFOX_3_6_23_RELEASE 398ffaf81015

Build data

Firefox

Build # Type Build ID Build machine Time to build
1 Linux 20110920075126
 linux-ix-slave15
Mac bm-xserve11

Windows mw32-ix-slave08

Notes

Done on bm08

Build 1

  • Set reserved slaves:
# cltbld@buildbot-master08
# 8 for 3.6.23, 8 for 7.0b4
echo 16 > /builds/buildbot/build1/master/reserved_slaves_bm08-build1
  • Requested a clobber for any master, any release, any builder - to cover all branches.
  • Landed release config changes
  • Tagged buildbot-configs, buildbotcustom, and tools with FIREFOX_3_6_22_{BUILD1,RELEASE}
  • Ran release_sanity.py:
cd /builds/buildbot/build1 && make update
cd /builds/buildbot/build1/master
source ../bin/activate
PYTHONPATH=. python ../tools/buildbot-helpers/release_sanity.py -u bhearsum -p firefox -V 3.6.22 --branch mozilla-1.9.2 --build-number 1 -c release-firefox-mozilla-1.9.2.py --dryrun localhost:9001
  • Started the release:
PYTHONPATH=. python ../tools/buildbot-helpers/release_sanity.py -u bhearsum -p firefox -V 3.6.22 --branch mozilla-1.9.2 --build-number 1 -c release-firefox-mozilla-1.9.2.py localhost:9001

E-mail Metrics

Sent the following mail to metrics@mozilla.com: 

Firefox,firefox,firefox,3.6.23,3.6
Firefox,firefox,firefox,3.6.24pre,3.6

Tag

No problems

Bouncer Submitter

No problems

Source

No problems

Start autosign

Started autosign on keymaster with the following commands: 

PRODUCT=firefox
VERSION=3.6.23
BUILD=1
TAG=FIREFOX_3_6_23_RELEASE
REPO='releases/mozilla-1.9.2'
EMAIL=release@mozilla.com
KEYDIR=d:/2010-keys
RELCONFIG=mozilla/release-firefox-mozilla-1.9.2.py
cd ${HOME}/hg-tools/ # if it exists, otherwise create a fresh clone
hg pull && hg up -r ${TAG}
mkdir -p ~/signing-work/${PRODUCT}-${VERSION}/lib/python
cd ~/signing-work/${PRODUCT}-${VERSION}
cp ~/hg-tools/release/signing/* .
rsync -av ~/hg-tools/lib/python/ ./lib/python/
make autosign PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} RELCONFIG=${RELCONFIG}

Build

Firefox

No problems

Unittests / Talos

  • test mochitest-other failed for Firefox 3.6.23 build1 on win32

http://buildbot-master08.build.sjc1.mozilla.com:8001/builders/release-mozilla-1.9.2-win32_test%20mochitest-other/builds/5

  • This got re-triggered and went green

XULRunner

Source

No problems

Build

No problems

Signing

Signed with: 

#!/bin/bash
set -x
set -e

PRODUCT=xulrunner
VERSION=3.6.23
BUILD=1
TAG=FIREFOX_3_6_23_RELEASE
REPO="releases/mozilla-1.9.2"
EMAIL=armenzg@mozilla.com
KEYDIR=d:/2010-keys

cd ~/hg-tools
hg pull
hg up -r ${TAG}

mkdir -p ~/signing-work/${PRODUCT}-${VERSION}
cd ~/signing-work/${PRODUCT}-${VERSION}
cp ~/hg-tools/release/signing/* .

make setup PRODUCT=${PRODUCT} VERSION=${VERSION} \
BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1
rsync -av -e "ssh -i /home/cltsign/.ssh/xrbld_dsa" \
--exclude=*.txt --exclude=*-symbols.zip \
xrbld@stage.mozilla.org:/home/ftp/pub/${PRODUCT}/nightly/${VERSION}-candidates/build${BUILD}/ \
unsigned-build${BUILD}
rsync -av --exclude=unsigned unsigned-build${BUILD}/ \
signed-build${BUILD}/
rsync -av unsigned-build${BUILD}/unsigned/ \
signed-build${BUILD}/

make checksum-files create-sigs stage verify-sigs \
PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} \
REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1

rmdir signed-build${BUILD}/contrib{,-localized}

rsync -av -e "ssh -i /home/cltsign/.ssh/xrbld_dsa" \
signed-build${BUILD}/ \
xrbld@stage.mozilla.org:/home/ftp/pub/${PRODUCT}/nightly/${VERSION}-candidates/build${BUILD}/

Repacks

Firefox

No problems

Firefox Signing

No problems

L10N verify

No problems

Updates

Done

Update verify

No issues, though Aki wants to know why we need to manually vet update verify.

  • Aki I (armenzg) thought that is what bhearsum mentioned this on the call but I probably misundertood

Linux 1/10 & Mac 9/10

Push to beta

POSTMORTEM: I have moved this section from after checking permissions to before major update. I believe the BuildNotesTemplate has to be modified for this. More discussion needed.

Since today we are going directly to beta before QA qualifies we do this section first.

  • Ran backupsnip.
# cltbld@aus2-staging
~/bin/backupsnip Firefox-3.6.23-build1-beta
  • As soon as LegNeato gives go to beta run this and remove the italics:
# cltbld@aus2-staging
~/bin/pushsnip Firefox-3.6.23-build1-beta

As soon as we push the snippets finishes we have to land the AUS change and do the following:

  • land the change (done)
  • tag with AUS2_PRODUCTION (done)
  • filed a Server:Operations bug bug 688084 as a "blocker"

You also have to verify the output of update verify manually -- how&why? this is a bug.

  • Aki I (armenzg) thought that is what bhearsum mentioned this on the call but I probably misundertood

Major Update

"force build" it.

  • No problems

Update verify

  • No problems

Check permissions / AV scan

  • It got triggered automatically after updates where generated without issues
  • Triggered with:
   Property 1 name: script_repo_revision use FIREFOX_3_6_23_RELEASE 
  Property 2 name: release_config: mozilla/release-firefox-mozilla-1.9.2.py
  • No problems

Reset reserved slaves

As soon as I saw the Windows repacks be done I did this: 

echo 0 > /builds/buildbot/build1/master/reserved_slaves_bm08-build1

This slowed update verify a lot!

POSTMORTEM: Shouldn't this be managed by the automation?

Push files to internal mirrors

POSTMORTEM: Shouldn't this be managed by the automation?

Added 3.6.23 in advance to /pub/mozilla.org/mozilla.org/zz/rsyncd-mozilla-releases.exclude to prevent pushing to external mirrors: - firefox/releases/3.6.23

Email to push to internal/external mirrors came basically at the same time, so I updated /pub/mozilla.org/mozilla.org/zz/rsyncd-mozilla-current.exclude switching 3.6.22 to 3.6.23 and forced build on the push to mirrors 1.9.2 builder with the following properties: 

release_config: mozilla/release-firefox-mozilla-1.9.2.py
script_repo_revision: FIREFOX_3_6_23_RELEASE

no problems with the builder.

Push XULRunner to Mirrors

# xrbld@stage
rsync -av --exclude=*.txt --exclude=*unsigned* --exclude=*-symbols.zip \
/pub/mozilla.org/xulrunner/nightly/3.6.23-candidates/build1/ \
/pub/mozilla.org/xulrunner/releases/3.6.23/

Edited cltbld@stage:/pub/mozilla.org/zz/rsyncd-mozilla-releases.exclude and added 

- xulrunner/releases/3.6.22

...to exclude the previous release.

Update XULRunner wiki page

Updated XULRunner wiki pages: https://developer.mozilla.org/en/XULRunner_1.9.2_Release_Notes
https://developer.mozilla.org/en/Gecko_SDK

Push to external mirrors

Removed 3.6.23 from stage:/pub/mozilla.org/zz/rsyncd-mozilla-releases.exclude

Final verification

  • We had some failures and re-triggered few times until it went green

Push to Release Channel

 # cltbld@aus2-staging
cd /opt/aus2/snippets/staging/
time ~/bin/backupsnip Firefox-3.6.23-build1
# real    63m26.504s
  • Push request received at 09/27/11 8:25 AM PDT
#cltbld@aus2-staging
time ~/bin/pushsnip Firefox-3.6.23-build1 | tee 3.6.23.pushsnip.log
# mpt ??
# phx 18m

Update symlinks

# ffxbld@stage
cd /pub/mozilla.org/firefox/releases
rm latest-3.6 && ln -s 3.6.23 latest-3.6
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_3.6.23/BuildNotes&oldid=354885"