Releases/Firefox 9.0/BuildNotes: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
Line 293: Line 293:
done
done
</pre>
</pre>
Kicked {1,2}/10 on macosx64 again, failed network access to snippets
Second attempt at 2/10 went gree, 1/10 failed again - still wasn't reaching the snippet url even though I could in browser, rebuilt again.


=== Major Update ===
=== Major Update ===

Revision as of 13:43, 19 December 2011

Notes About Releasing

Please update the Notes Template and the Release:Primer for future releases (bug fixes, changes to automation) as needed

Bugs hit

Enter any bugs pre-existing or newly discovered and filed during the release:

  • bug 705403 - Sendchanges [on windows] from build steps are being done from old buildbot version
  • bug 711581 - Can't push to hg.mozilla.org/build/tools repo
  • bug 711796 - release sanity should use different l10n dashboard URL for final releases
  • bug 705297 - New Android Market Developer Distribution Agreement

Build Engineers

rail - Tracking bug: bug 701054

Signed-off Revision(s)

Build 1: 79d24e644fdd

L10N changesets

Instructions on how to get them

Tags

Build # Branch, Tags Changeset
1 MOBILE90_2011121612_RELBRANCH, FENNEC_9_0_RELEASE, FENNEC_9_0_BUILD1 55a89a2780e9
GECKO90_2011121613_RELBRANCH, FIREFOX_9_0_BUILD1 FIREFOX_9_0_RELEASE a633a888157b

Build data

Firefox

Build # Type Build ID Build machine Time to build
1 Linux 20111216140209 mv-moz2-linux-ix-slave11 2 hrs, 14 mins, 20 secs
Linux64 moz2-linux64-slave05 4 hrs, 26 mins, 51 secs
Mac moz2-darwin10-slave07 5 hrs, 7 mins, 12 secs
Windows mw32-ix-slave10 3 hrs, 12 mins, 32 secs

Fennec

Build # Type Build ID Build machine Time to build
1 android 20111216135618 mv-moz2-linux-ix-slave16 1 hrs, 44 mins, 32 secs
linux mv-moz2-linux-ix-slave19 1 hrs, 2 mins, 57 secs
macosx bm-xserve09 2 hrs, 16 mins, 22 secs
win32 mw32-ix-slave04 1 hrs, 30 mins, 36 secs

Notes

Build 1

Syncing repos

  • reserved linux64-ix-slave15 for this task
  • mozilla-beta -> mozilla-release was done by Christian Legnitto (as well as updating browser/locales/shipped_locales to eliminate non-release locales that were in beta releases mn,sw,csb)
  • Did l10n repo sync on reserved linux64-ix-slave15 as per instructions
  • It took 27m13.876s

Diff mozconfigs

Preparing to start Automation

  • Set clobbers for the appropriate masters.
  • Reserve slaves
echo "10" > reserved_slaves_bm07-build1
  • Had to land new android mozconfigs (default and production) ahead of time to get a green build on mozilla-release
  • Update l10n changesets for desktop, mobile
  • Land automation configs (are you or buildduty going to reconfig? great, merge. otherwise double-land only your configs)
  • Tag buildbot-configs, buildbotcustom, & tools with build & release tags
  • update and reconfigure the master
  • start automation
source ../bin/activate
PYTHONPATH=. ../bin/python ../tools/buildbot-helpers/release_sanity.py -u rail \
 -V 9.0 --branch mozilla-release --build-number 1 -c release-firefox-mozilla-release.py \
 -c release-fennec-mozilla-release.py --dryrun --products firefox,fennec localhost:9001
  • it failed trying to fetch l10n dashboard (9.0 vs 9). bug 711796
  • Start automation:
PYTHONPATH=. ../bin/python ../tools/buildbot-helpers/release_sanity.py -u rail \
 -V 9.0 --branch mozilla-release --build-number 1 -c release-firefox-mozilla-release.py \
 -c release-fennec-mozilla-release.py -b --products firefox,fennec localhost:9001

E-mail Metrics

And for 9.0 final it's 

Firefox,firefox,firefox,9.0,9.0
Fennec,firefox-mobile,fennec,9.0,9.0

E-mail mirrors@mozilla.org

Not necessary for rapid release betas, files only go as far as the 'internal mirrors'.

They want to know approximately what time push to external mirrors will occur. Ideally this is a 24hr notice to them, with the estimated time. 

Subject: Firefox 9.0 and 3.6.25 coming to mirrors Dec 19
Body:
Hi,

We're planning on pushing our Firefox 9.0 and 3.6.25 releases to mirrors sometime next Monday, December 19.

If you believe these releases or these dates will cause any problems, please notify release at mozilla.com.

If you have any problems with mirror status/weights/etc, please notify mirror-submissions at mozilla.org.

Tag

No problems.

Bouncer Submitter

No problems.

Source

No problems.

Start autosign

NOTE: use new signcode keys from d:/2011-keys 

# created in ~/tmp/sign_9.0.sh
PRODUCT=firefox
VERSION=9.0
BUILD=1
TAG=FIREFOX_9_0_RELEASE
REPO='releases/mozilla-release'
EMAIL=release@mozilla.com
KEYDIR=d:/2011-keys
RELCONFIG=mozilla/release-firefox-mozilla-release.py

cd ${HOME}/hg-tools/
hg pull && hg up -r ${TAG}
mkdir -p ~/signing-work/${PRODUCT}-${VERSION}/lib/python
cd ~/signing-work/${PRODUCT}-${VERSION}
cp ~/hg-tools/release/signing/* .
rsync -av ~/hg-tools/lib/python/ ./lib/python/
make autosign PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} RELCONFIG=${RELCONFIG}

Instructions are in CombinedSigning

Build

Firefox

No problems

Firefox repacks

No problems

Fennec

Android

No problems

Desktop Builds

No problems

Mobile Desktop repacks

(aki): win32-mobile repacks died on a unicode env var. Catlee noted this is because json loads a unicode string; simplejson loads a string.

I backed out http://hg.mozilla.org/build/buildbot-configs/rev/1d21e762cca7; if we re-tag and rerun the repacks, it should work.

(rail): I retagged buildotcustom and buildbot-configs, updated and recofigured the master, and retriggered the repacks.

Unittests / Talos

  1. Look to see that they ran
  2. Document any oranges (per platform) for unittests - if possible, try to confirm it's known/random
  3. Make sure there's no red/failures that we need to have a dev look at

XULRunner

Source

No problems

Build

No problems

Signing

NOTE: use new signcode keys from d:/2011-keys

Used this script

Partner Repack

Firefox

No problems

Fennec

N/A

Firefox Signing

No problems

Android Signing

Instructions in MobileSigning

NOTE: It can be started in a different Windows without having to wait for Firefox signing to finish.

Used this script

Android Signature Verification

No problems

L10N verify

No problems

Updates

No problems

Update verify

No problems

8.0-9.0 partial updates

Since 8.0.1 release was mac only I generated 8.0-9.0 parrtial updates: 

# cltbld@mv-moz2-linux-ix-slave17 (the slave which ran the updates builder)
cd /builds/slave/rel-m-rel-updates/build
# Download the custom patcher config
wget -O patcher-configs/mozRelease-branch-patcher2-8.0.cfg https://bugzilla.mozilla.org/attachment.cgi?id=581369

# The file edited, changed <9.0> section: build id set to 20111216140209, locales copied from 8.0

# Download 8.0 complete MARs
perl patcher2.pl --download --app=firefox --brand=Firefox --config=patcher-configs/mozRelease-branch-patcher2-8.0.cfg

# Generate 8.0->9.0 partial mars and snippets
perl patcher2.pl --create-patches --partial-patchlist-file=patchlist.cfg --app=firefox --brand=Firefox --config=patcher-configs/mozRelease-branch-patcher2-8.0.cfg

# Fix permissions
find temp/firefox/8.0-9.0/ftp/firefox/nightly/9.0-candidates/build1 -type f -exec chmod 644 '{}' ';'
find temp/firefox/8.0-9.0/ftp/firefox/nightly/9.0-candidates/build1 -type d -exec chmod 755 '{}' ';'

# Upload 8.0-9.0 complete MARs
rsync -av -e 'ssh -oIdentityFile=~/.ssh/ffxbld_dsa' '--exclude=*complete.mar' temp/firefox/8.0-9.0/ftp/firefox/nightly/9.0-candidates/build1/update ffxbld@stage-old.mozilla.org:/pub/mozilla.org/firefox/nightly/9.0-candidates/build1/

# rsync 8.0-9.0 *partial* snippets  to aus2-staging (excluding complete.txt snippets)
rsync -av --exclude=complete.txt -e 'ssh -oIdentityFile=~/.ssh/cltbld_dsa' temp/firefox/8.0-9.0/aus2.test/ cltbld@aus2-staging.mozilla.org:/opt/aus2/snippets/staging/Firefox-9.0-8.0-build1-test
rsync -av --exclude=complete.txt -e 'ssh -oIdentityFile=~/.ssh/cltbld_dsa' temp/firefox/8.0-9.0/aus2/ cltbld@aus2-staging.mozilla.org:/opt/aus2/snippets/staging/Firefox-9.0-8.0-build1

Merge new snippets with old ones on aus2-staging: 

# cltbld@aus2-staging
cd /opt/aus2/snippets/staging/
# backup the original snippets
rsync -av Firefox-9.0-build1/ Firefox-9.0-build1.orig/
# merge 8.0 partial snippets into the automatically generated ones
rsync -av Firefox-9.0-8.0-build1/ Firefox-9.0-build1/

# backupsnip and pushsnip 8.0 partial snippets for test channels
~/bin/backupsnip Firefox-9.0-8.0-build1-test
~/bin/pushsnip Firefox-9.0-8.0-build1-test
  • Sent an email to r-d about availability of 8.0-9.0 updates.
  • Added Firefox-9.0-Partial-8.0 product to Bouncer with the similar to Firefox-9.0-Partial-8.0.1 locations (not for contrib platforms)
Update verify for 8.0 partial updates
  • Landed a patch which forces update verify to use partial updates for 8.0
  • tagged tools with FIREFOX_9_0_BUILD1_RUNTIME and FIREFOX_9_0_RELEASE_RUNTIME
  • TODO: revert the patch and move FIREFOX_9_0_BUILD1_RUNTIME and FIREFOX_9_0_RELEASE_RUNTIME tags back to 04322bcb13b5 after final verification.
# On my local machine, to kick off update verify
for p in linux linux64 macosx64 win32; do
  for i in 1 2 3 4 5 6 7 8 9 10; do
    curl "http://buildbot-master07.build.sjc1.mozilla.com:8001/builders/release-mozilla-release-${p}_update_verify_${i}%2F10/force" >/dev/null
    sleep 5
  done
done

Major Update

N/A

Update verify

N/A

Socorro Product Data Updates

N/A

Reset reserved slaves

echo "0" > reserved_slaves_bm07-build1

Run backupsnip

~/bin/backupsnip Firefox-9.0-build1

Check permissions / AV scan

No problems

Push files to internal mirrors

Mirrors Policy

updated stage:/pub/mozilla.org/zz/rsyncd-mozilla-releases.exclude to add 

- firefox/releases/9.0

Final verification

Push to beta

N/A

Push index file to mirrors

Push to external mirrors

Publish Fennec to the Android Market

Push the files

Android Market

IMPORTANT - Make sure to follow instructions!

  • download multi apk (e.g. multi/fennec-9.0.multi.android-arm.apk)
  • visit https://market.android.com/publish
  • choose "Firefox Beta" or "Firefox"
  • select the "APK Files" tab and choose "Upload APK"
    • choose the multi apk that you downloaded and hit "upload"
      • NOTE: the progress bar does not seem to show progress (at least on Google Chrome)
    • when it finishes uploading, verify VersionCode is build date
    • hit "Save"
  • activate new apk (You should see an Error message since both apk's are active)
  • deactivate old apk (You should not see the Error message anymore)
  • hit "Save"
  • If this is a beta 1, go to "Product Details" tab -> Recent Changes, change the url to http://www.mozilla.com/en-US/mobile/{VERSION}/releasenotes/
    • and hit "Save"

Push XULRunner to Mirrors

Update XULRunner wiki page

Push to Release Channel

Update symlinks

Once we're signed off on the release channel.

Remove index.html files

Update browser choice website

Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_9.0/BuildNotes&oldid=379867"