Releases/Firefox 3.7a4/BuildNotes: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
 
(31 intermediate revisions by one other user not shown)
Line 59: Line 59:


====Source====
====Source====
'''mv-moz2-linux-ix-slave13'''
Had to manually rename to 'mozilladeveloperpreview-3.7a3.{source.tar.bz2,.bundle}' because source packages don't obey in-repo branding. Would be fixed with {{bug|510770}}:
# ffxbld@stage
cd /home/ftp/pub/firefox/nightly/3.7a3-candidates/build1/source
rename firefox mozilladeveloperpreview *
====Build====
'''moz2-linux-slave45, mw32-ix-slave22, moz2-darwin9-slave55'''
* Linux: no problems & passed all unittests
* Mac: no problems & passed all unittests
* Win32: no problems & passed all unittests
====Sign====
Tagged the {tools,buildbotcustom,buildbot-configs} repo
hg tag -r {revision} FIREFOX_3_7a4_BUILD1
hg tag -r {revision} FIREFOX_3_7a4_RELEASE
[https://intranet.mozilla.org/Build:CombinedSigning instructions]
Signing didn't work out-of-box - {{bug|545017}} - Did this instead of the 4th command of 'Run it':
make setup download stubs PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1
PRODUCT=mozilladeveloperpreview
# sign-files fails to copy non-existent xpi, no locales expected so that's fine
make sign-files PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1
make checksum-files create-sigs stage verify PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1
PRODUCT=firefox
make fake-upload PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1
make upload PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1
I had several false starts with signing.  Turns out I was using 'releases/mozilla-central' as the repo instead of just 'mozilla-central' and so the stubs weren't downloading and compressing properly.  I removed the 7z file from stage, cleared out the signing work directory and did it again from scratch. See [http://pastebin.mozilla.org/713659 pastebin]
When attempting to run postsign I got:
<pre>
Traceback (most recent call last):
  File "./verify-signature.py", line 139, in <module>
    result, msg = check_repack(uf, sf, options.fake, options.product)
  File "./verify-signature.py", line 61, in check_repack
    info = fileInfo(signed, product)
  File "/cygdrive/d/signing-work/firefox-3.7a4/signing.py", line 69, in fileInfo
    raise ValueError("Could not parse: %s" % filepath)
ValueError: Could not parse: signed-build1/update/win32/en-US/mozilladeveloperpreview-3.7a4.complete.mar
</pre>
Verified signatures manually:
./verify-signature.py --product=mozilladeveloperpreview unsigned-build1/ signed-build1/
Results:
<pre>
signed-build1/update/win32/en-US/mozilladeveloperpreview-3.7a4.complete.mar True OK
signed-build1/win32/en-US/MozillaDeveloperPreview Setup 3.7 Alpha 4.exe True OK
</pre>
====Updates====
'''moz2-linux-slave38, moz2-linux-slave47'''
* Dep scheduler updates builder failed on patcher bump, so did it manually
* Created configs manually ([https://bugzilla.mozilla.org/attachment.cgi?id=437619 update verify], [https://bugzilla.mozilla.org/attachment.cgi?id=437886 patcher])
* Had to use [https://bug551278.bugzilla.mozilla.org/attachment.cgi?id=432788 this modification] of ReleaseUpdatesFactory to avoid it overwriting the working patcher and update verify configs (FIXME)
* backupsnip step failed, did it on aus2-staging as cltbld
~/bin/backupsnip 20100408-Firefox-3.7a4-test
* pushsnip too
~/bin/backupsnip 20100408-Firefox-3.7a4-test
====Update Verify====
=====First Run=====
* Linux: FAIL
* Win32: PASS (but actually failed the same stuff as linux/mac - FILE BUG)
* Mac: FAIL
All three failed because I had left from URLs in the verify configs for 3.7a2 [http://hg.mozilla.org/build/tools/file/7552691c5adc/release/updates/moz193-firefox-win32.cfg (example)] and so the update_verify step applied the 3.7a4 mar to 3.7a2 and diffed against 3.7a3 instead of 3.7a4
Submitted fixed [https://bugzilla.mozilla.org/attachment.cgi?id=437946 patch] and triggered the update_verify steps again.
=====Second Run=====
* Mac: PASS
<pre>
diff -r source/MozillaDeveloperPreview.app/Contents/MacOS/removed-files target/MozillaDeveloperPreview.app/Contents/MacOS/removed-files
0a1
> .autoreg
581d581
< LICENSE
694d693
< components/microsummaries.xpt
772a772,773
> components/microsummaries.xpt
> LICENSE
</pre>
This is normal.
* Win32: PASS
<pre>
Files source/bin/freebl3.chk and target/bin/freebl3.chk differ
Files source/bin/nssdbm3.chk and target/bin/nssdbm3.chk differ
Only in source/bin: removed-files
Files source/bin/softokn3.chk and target/bin/softokn3.chk differ
</pre>
This is also normal.
* Linux: FAIL
<pre>
diff -r source/firefox/removed-files target/firefox/removed-files
0a1
> .autoreg
566a568,569
> components/microsummaries.xpt
> LICENSE
</pre>
<pre>
Using  https://aus2.mozilla.org/update/1/Firefox/3.7a2/20100228153229/Linux_x86-gcc3/en-US/betatest/update.xml?force=1
FAIL: no partial update found for https://aus2.mozilla.org/update/1/Firefox/3.7a2/20100228153229/Linux_x86-gcc3/en-US/betatest/update.xml?force=1
FAIL: download_mars returned non-zero exit code: 1
Using  https://aus2.mozilla.org/update/1/Firefox/3.7a2/20100228153229/Linux_x86-gcc3/en-US/betatest/update.xml?force=1
FAIL: no complete update found for https://aus2.mozilla.org/update/1/Firefox/3.7a2/20100228153229/Linux_x86-gcc3/en-US/betatest/update.xml?force=1
FAIL: download_mars returned non-zero exit code: 1
Using  https://aus2.mozilla.org/update/1/Firefox/3.7a1/20100208064801/Linux_x86-gcc3/en-US/betatest/update.xml?force=1
FAIL: no partial update found for https://aus2.mozilla.org/update/1/Firefox/3.7a1/20100208064801/Linux_x86-gcc3/en-US/betatest/update.xml?force=1
FAIL: download_mars returned non-zero exit code: 1
Using  https://aus2.mozilla.org/update/1/Firefox/3.7a1/20100208064801/Linux_x86-gcc3/en-US/betatest/update.xml?force=1
FAIL: no complete update found for https://aus2.mozilla.org/update/1/Firefox/3.7a1/20100208064801/Linux_x86-gcc3/en-US/betatest/update.xml?force=1
FAIL: download_mars returned non-zero exit code: 1
</pre>
This was probably a fluke, forced rebuild on linux only.
=====Third Run=====
* Linux: PASS
====Update Bouncer====
Bouncer buddy was being glitchy - didn't bump things properly so I did it manually. Added as 'devpreview-1.9.3a4'
==== Final checks before push ====
Each of the find calls should return no output.
cd /pub/mozilla.org/firefox/nightly/3.7a4-candidates/build1/
find . ! -user ffxbld
find . ! -group firefox
find . -type f ! -perm 644
find . -mindepth 1 -type d ! -perm 755 ! -name 'contrib*'
find . -mindepth 1 -type d ! -perm 755 ! -name 'contrib*'
Output about contrib/, but that's OK.
==== Push to mirrors ====
# ffxbld@stage
rsync -av --exclude=*tests* --exclude=*crashreporter* --exclude=*.log --exclude=*.txt --exclude=*unsigned* /pub/mozilla.org/firefox/nightly/3.7a4-candidates/build1/ /pub/mozilla.org/firefox/releases/devpreview/1.9.3a4
====Final verify====
'''mv-moz2-linux-ix-slave17'''
* on pm02 - no problems
==== Push snippets to beta channel ====
# cltbld@aus2-staging
~/bin/backupsnip 20100408-Firefox-3.7a4
~/bin/pushsnip 20100408-Firefox-3.7a4
====Release====
nothing to be done for an alpha

Latest revision as of 12:18, 14 June 2010

Build Engineers

  • lsblakk

Tracking bug

Signed-off Revision(s)

6bdb8153b671

Tags

On mozilla-central:

Build # Tag Changeset
1 GECKO193a4_20100407_RELBRANCH d26d9a47e3e0
FIREFOX_3_7a4_BUILD1, FIREFOX_3_7a4_RELEASE 231cc7025b6f

Build data

Type Build ID Build machine
[Windows installer/zip]
[Mac compressed]
[Linux compressed]

Notes

  • Done on pm02

Build 1

  • Used clobberer to clean up previous releases dirs for m-c
  • Landed config update (with symlink change in repo, not on master)
  • Deleted .pyc files on master
  • Closed mozilla-central
  • sendchange:
buildbot sendchange --username=lsblakk --master=localhost:9010 --branch=mozilla-central -m "Firefox 3.7a4build1" Go

Tag

mv-moz2-linux-ix-slave22

  • no problems
  • re-opened mozilla-central

Source

mv-moz2-linux-ix-slave13 Had to manually rename to 'mozilladeveloperpreview-3.7a3.{source.tar.bz2,.bundle}' because source packages don't obey in-repo branding. Would be fixed with bug 510770: 

# ffxbld@stage
cd /home/ftp/pub/firefox/nightly/3.7a3-candidates/build1/source
rename firefox mozilladeveloperpreview *

Build

moz2-linux-slave45, mw32-ix-slave22, moz2-darwin9-slave55

  • Linux: no problems & passed all unittests
  • Mac: no problems & passed all unittests
  • Win32: no problems & passed all unittests

Sign

Tagged the {tools,buildbotcustom,buildbot-configs} repo 

hg tag -r {revision} FIREFOX_3_7a4_BUILD1
hg tag -r {revision} FIREFOX_3_7a4_RELEASE

instructions Signing didn't work out-of-box - bug 545017 - Did this instead of the 4th command of 'Run it': 

make setup download stubs PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1
PRODUCT=mozilladeveloperpreview
# sign-files fails to copy non-existent xpi, no locales expected so that's fine
make sign-files PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1
make checksum-files create-sigs stage verify PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1
PRODUCT=firefox
make fake-upload PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1
make upload PRODUCT=${PRODUCT} VERSION=${VERSION} BUILD=${BUILD} REPO=${REPO} EMAIL=${EMAIL} KEYDIR=${KEYDIR} USE_NEW=1

I had several false starts with signing. Turns out I was using 'releases/mozilla-central' as the repo instead of just 'mozilla-central' and so the stubs weren't downloading and compressing properly. I removed the 7z file from stage, cleared out the signing work directory and did it again from scratch. See pastebin

When attempting to run postsign I got: 

Traceback (most recent call last):
  File "./verify-signature.py", line 139, in <module>
    result, msg = check_repack(uf, sf, options.fake, options.product)
  File "./verify-signature.py", line 61, in check_repack
    info = fileInfo(signed, product)
  File "/cygdrive/d/signing-work/firefox-3.7a4/signing.py", line 69, in fileInfo
    raise ValueError("Could not parse: %s" % filepath)
ValueError: Could not parse: signed-build1/update/win32/en-US/mozilladeveloperpreview-3.7a4.complete.mar

Verified signatures manually: 

./verify-signature.py --product=mozilladeveloperpreview unsigned-build1/ signed-build1/

Results: 

signed-build1/update/win32/en-US/mozilladeveloperpreview-3.7a4.complete.mar True OK
signed-build1/win32/en-US/MozillaDeveloperPreview Setup 3.7 Alpha 4.exe True OK

Updates

moz2-linux-slave38, moz2-linux-slave47

  • Dep scheduler updates builder failed on patcher bump, so did it manually
  • Created configs manually (update verify, patcher)
  • Had to use this modification of ReleaseUpdatesFactory to avoid it overwriting the working patcher and update verify configs (FIXME)
  • backupsnip step failed, did it on aus2-staging as cltbld
~/bin/backupsnip 20100408-Firefox-3.7a4-test
  • pushsnip too
~/bin/backupsnip 20100408-Firefox-3.7a4-test

Update Verify

First Run
  • Linux: FAIL
  • Win32: PASS (but actually failed the same stuff as linux/mac - FILE BUG)
  • Mac: FAIL

All three failed because I had left from URLs in the verify configs for 3.7a2 (example) and so the update_verify step applied the 3.7a4 mar to 3.7a2 and diffed against 3.7a3 instead of 3.7a4

Submitted fixed patch and triggered the update_verify steps again.

Second Run
  • Mac: PASS
diff -r source/MozillaDeveloperPreview.app/Contents/MacOS/removed-files target/MozillaDeveloperPreview.app/Contents/MacOS/removed-files
0a1
> .autoreg
581d581
< LICENSE
694d693
< components/microsummaries.xpt
772a772,773
> components/microsummaries.xpt
> LICENSE

This is normal.

  • Win32: PASS
Files source/bin/freebl3.chk and target/bin/freebl3.chk differ
Files source/bin/nssdbm3.chk and target/bin/nssdbm3.chk differ
Only in source/bin: removed-files
Files source/bin/softokn3.chk and target/bin/softokn3.chk differ

This is also normal.

  • Linux: FAIL
diff -r source/firefox/removed-files target/firefox/removed-files
0a1
> .autoreg
566a568,569
> components/microsummaries.xpt
> LICENSE

Using  https://aus2.mozilla.org/update/1/Firefox/3.7a2/20100228153229/Linux_x86-gcc3/en-US/betatest/update.xml?force=1
FAIL: no partial update found for https://aus2.mozilla.org/update/1/Firefox/3.7a2/20100228153229/Linux_x86-gcc3/en-US/betatest/update.xml?force=1
FAIL: download_mars returned non-zero exit code: 1
Using  https://aus2.mozilla.org/update/1/Firefox/3.7a2/20100228153229/Linux_x86-gcc3/en-US/betatest/update.xml?force=1
FAIL: no complete update found for https://aus2.mozilla.org/update/1/Firefox/3.7a2/20100228153229/Linux_x86-gcc3/en-US/betatest/update.xml?force=1
FAIL: download_mars returned non-zero exit code: 1
Using  https://aus2.mozilla.org/update/1/Firefox/3.7a1/20100208064801/Linux_x86-gcc3/en-US/betatest/update.xml?force=1
FAIL: no partial update found for https://aus2.mozilla.org/update/1/Firefox/3.7a1/20100208064801/Linux_x86-gcc3/en-US/betatest/update.xml?force=1
FAIL: download_mars returned non-zero exit code: 1
Using  https://aus2.mozilla.org/update/1/Firefox/3.7a1/20100208064801/Linux_x86-gcc3/en-US/betatest/update.xml?force=1
FAIL: no complete update found for https://aus2.mozilla.org/update/1/Firefox/3.7a1/20100208064801/Linux_x86-gcc3/en-US/betatest/update.xml?force=1
FAIL: download_mars returned non-zero exit code: 1

This was probably a fluke, forced rebuild on linux only.

Third Run
  • Linux: PASS

Update Bouncer

Bouncer buddy was being glitchy - didn't bump things properly so I did it manually. Added as 'devpreview-1.9.3a4'

Final checks before push

Each of the find calls should return no output. 

cd /pub/mozilla.org/firefox/nightly/3.7a4-candidates/build1/
find . ! -user ffxbld
find . ! -group firefox
find . -type f ! -perm 644
find . -mindepth 1 -type d ! -perm 755 ! -name 'contrib*'
find . -mindepth 1 -type d ! -perm 755 ! -name 'contrib*'

Output about contrib/, but that's OK.

Push to mirrors

# ffxbld@stage
rsync -av --exclude=*tests* --exclude=*crashreporter* --exclude=*.log --exclude=*.txt --exclude=*unsigned* /pub/mozilla.org/firefox/nightly/3.7a4-candidates/build1/ /pub/mozilla.org/firefox/releases/devpreview/1.9.3a4

Final verify

mv-moz2-linux-ix-slave17

  • on pm02 - no problems

Push snippets to beta channel

# cltbld@aus2-staging
~/bin/backupsnip 20100408-Firefox-3.7a4
~/bin/pushsnip 20100408-Firefox-3.7a4

Release

nothing to be done for an alpha

Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_3.7a4/BuildNotes&oldid=230352"