Releases/Firefox 3.5.10/BuildNotes: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
 
(18 intermediate revisions by 2 users not shown)
Line 145: Line 145:
* No problems
* No problems


===== Throttling =====
==== Unthrottle beta channel ====
* Unthrottle previous dot release on '''beta''' channel
* Unthrottle previous dot release on '''beta''' channel
** This will bring beta users to the current dot release. The day of the release we have to do the same for the "release" users.
** {{bug|567040}} - Unthrottle 3.5.9 -> 3.5.10build1 on beta channel (it was forgotten on beta day)
** {{bug|567040}} - Unthrottle 3.5.9 -> 3.5.10build1 on beta channel (it was forgotten on beta day)


Line 161: Line 162:


==== Major update generation and verification  ====
==== Major update generation and verification  ====
===== 3.5.10 -> 3.6.4 build1 =====
'''mv-moz2-linux-ix-slave24'''  
'''mv-moz2-linux-ix-slave24'''  
NOTE for next release: generate the MU the day before going live


* I forced "major_update"
* I forced "major_update"
Line 168: Line 172:
* Read [https://wiki.mozilla.org/Release:Release_Automation_on_Mercurial:Documentation#Major_Update_.26_Verify Major Update & Verification]
* Read [https://wiki.mozilla.org/Release:Release_Automation_on_Mercurial:Documentation#Major_Update_.26_Verify Major Update & Verification]


===== Major update verification =====
====== Verification ======
* Check the last 2 or 3 Build Notes if this is your first time verifying a major update generated in this new way. Carrying forward the known issues might be overkill.
* Check the last 2 or 3 Build Notes if this is your first time verifying a major update generated in this new way. Carrying forward the known issues might be overkill.
* '''TODO''' Filed {{bug|}} to improve how we do it


* Do this to check for the test failures:
* Do this to check for the test failures:
Line 214: Line 217:
  WARN: check_updates returned warning for WINNT_x86-msvc downloads/Firefox Setup 3.5.10.exe vs. downloads/Firefox Setup 3.6.4.exe: 2
  WARN: check_updates returned warning for WINNT_x86-msvc downloads/Firefox Setup 3.5.10.exe vs. downloads/Firefox Setup 3.6.4.exe: 2


==== Major update generation and verification (3.5.10 -> 3.6.3) ====
===== 3.5.10 -> 3.6.3 =====
'''mv-moz2-linux-ix-slave24'''  
'''mv-moz2-linux-ix-slave24'''  
* It seems that after all we are waiting for 3.6.4 to release. Nevertheless, I generated the MU for 3.5.10->3.6.3 just in case the plans change again
* It seems that after all we are waiting for 3.6.4 to release. Nevertheless, I generated the MU for 3.5.10->3.6.3 just in case the plans change again
Line 222: Line 225:
* I have not spent time on checking the verification logs
* I have not spent time on checking the verification logs


==== Major update generation and verification (3.5.10 -> 3.6.4 build7) ====
===== 3.5.10 -> 3.6.4 build7 =====
* Unfortunately there is a regression somewhere and I don't have the wonderful "major_update" builder anymore. I have to generate the MU manually based on [[Releases/Firefox_3.5.8/BuildNotes#Major_update_.283.5.8_to_3.6.0.29 this notes]]
NOTE for post-mortem:
 
* pm02 was pointing to release-mozilla-central.py instead of release-mozilla-1.9.1.py. Therefore I did not see any "major_update" builder. After a while I realized about this.
===== Snippet generation =====
* pm was turned off so I turned it on. I got a slave and started doing "final_verification".
* Slave fx-linux-1.9-slave2
* I landed a change for changing release_config1.py to point at release-mozilla-1.9.1.py. Unfortunately I had landed it on the buildbot-0.8.0 branch and therefore I was not able to see any "major_update" builder.
* Based off [[Releases/Firefox_3.6/BuildNotes#Snippet_generation|snippet generation notes for 3.6]]
* I started preparing the patches for manual generation of the MU until catlee noticed that the "major_update" builder was there (There was too much going and I probably missed it).
mkdir -p /builds/3.5.10-3.6.4-major-update
* I made sure that now my patches were correctly landed on default and reconfigured.
cd /builds/3.5.10-3.6.4-major-update
* I have now "force build" the builder
export CVSROOT=:ext:cltbld@cvs.mozilla.org:/cvsroot
cvs co -d patcher-configs mozilla/tools/patcher-configs
cvs co -r UPDATE_PACKAGING_R10 -d patcher mozilla/tools/patcher
cd patcher
cvs co -r UPDATE_PACKAGING_R10 -d MozBuild mozilla/tools/release/MozBuild 
# build tools
./patcher2.pl --build-tools --app=firefox --tools-rev=UPDATE_PACKAGING_R10  --config=../patcher-configs/moz191-branch-major-update-patcher2.cfg 2>&1 | tee  ../firefox_build-tools.log
# fake 3.5.10 mars, which aren't used for anything but take time to d/l
mkdir -p temp/firefox/3.5.10/ftp/
# I don't know where this link of locales comes from
# maybe http://hg.mozilla.org/releases/mozilla-1.9.1/raw-file/1e0223b57404/browser/locales/shipped-locales?
# it seems to match 3.5.8's http://hg.mozilla.org/releases/mozilla-1.9.1/raw-file/9165e7415f91/browser/locales/shipped-locales
for l in af ar as be bg bn-BD bn-IN ca cs cy da de el en-GB en-US eo es-AR es-CL es-ES es-MX et eu fa fi fr fy-NL ga-IE gl gu-IN he hi-IN hr hu id is it ja ja-JP-mac ka kk kn ko ku lt lv mk ml mn mr nb-NO nl nn-NO oc or pa-IN pl pt-BR pt-PT rm ro ru si sk sl sq sr sv-SE ta ta-LK te th tr uk vi zh-CN zh-TW; do
  touch temp/firefox/3.5.10/ftp/firefox-3.5.10.${l}.{linux-i686,mac,win32}.complete.mar
done
# download mars
./patcher2.pl --download --app=firefox --config=../patcher-configs/moz191-branch-major-update-patcher2.cfg 2>&1 | tee ../firefox_download.log
 
'''DONE TO HERE'''
<i>
# FIXME - patcher needs to see that the MARs that it thinks are partials
#            are there or else it will not attempt to generate patchinfo
cd temp/firefox
mkdir 3.5.10-3.6.4
ln -s ../3.6.4/ftp 3.5.10-3.6.4/ftp
cd ../..
# Create partial patches and snippets
./patcher2.pl --create-patches --app=firefox --config=../patcher-configs/moz191-branch-major-update-patcher2.cfg 2>&1 | tee ../firefox-create-patches.log
 
===== Quick verify =====
Check that releasetest = beta = release .
cd temp/firefox/3.5.10-3.6.4
# releasetest == beta
find aus2.test -type d -iregex '.*/releasetest$' | perl -nle '$a = $_; $a =~ s/releasetest/beta/; $a =~ s/aus2\.test/aus2/; system("diff -r -u $_ $a");'
find aus2 -type d -iregex '.*/beta$' | perl -nle '$a = $_; $a =~ s/beta$/releasetest/; $a =~ s/aus2/aus2.test/; system("diff -r -u $_ $a");'
# beta == release
find aus2 -type d -iregex '.*/beta$' | perl -nle '$a = $_; $a =~ s/beta/release/; system("diff -r -u $_ $a");'
find aus2 -type d -iregex '.*/release$' | perl -nle '$a = $_; $a =~ s/release$/beta/; system("diff -r -u $_ $a");'
# beta == betatest
find aus2.test -type d -iregex '.*/betatest$' | perl -nle '$a = $_; $a =~ s/betatest$/beta/; $a =~ s/aus2\.test/aus2/; system("diff -r -u $_ $a");'
find aus2 -type d -iregex '.*/beta$' | perl -nle '$a = $_; $a =~ s/beta$/betatest/; $a =~ s/aus2/aus2.test/; system("diff -r -u $_ $a");'
No output, as expected.
 
===== Push to AUS =====
rsync -e 'ssh -i /home/cltbld/.ssh/aus' -av aus2.test/ cltbld@aus2-staging.mozilla.org:/opt/aus2/snippets/staging/20100210-Firefox-3.5.10-3.6.4-MU-test
rsync -e 'ssh -i /home/cltbld/.ssh/aus' -av aus2/      cltbld@aus2-staging.mozilla.org:/opt/aus2/snippets/staging/20100210-Firefox-3.5.10-3.6.4-MU
 
===== Enable test snippets =====
# cltbld@aus2-staging
~/bin/backupsnip 20100210-Firefox-3.5.10-3.6.4-MU-test
~/bin/pushsnip  20100210-Firefox-3.5.10-3.6.4-MU-test
 
===== Update verify =====


Ran update verify on fx-{linux,mac,win32}-1.9-slave2 as follows:
mkdir -p /builds/verify/firefox-3510-364-major/
cd /builds/verify/firefox-3510-364-major/
hg clone http://hg.mozilla.org/build/tools
# get patch to trawl "Only in" directories
cd tools/release/common
# on mac & linux
curl -sL https://bugzilla.mozilla.org/attachment.cgi?id=367544 | patch -p3
# on win32
wget --no-check-certificate -O patch https://bugzilla.mozilla.org/attachment.cgi?id=367544
patch -p3 < patch
# everyone ...
cd ../updates
platform=linux  # or mac or win32
./verify.sh -c moz191-firefox-$platform-major.cfg 2>&1 | tee $platform.log


Results:
* First run failed on the download step:
* No update found for mn, but that's not available for 3.6 so that's fine
** {{bug|573828}} - "major update" failed to download file for 3.5.10 -> 3.6.4 MU
* Linux - no files or directories left over
* I clobbered and re-triggered
* Mac - leftover empty directories (updater not allowed to remove them)
* I had to trigger for a third time. This time it worked
<pre>Only in source/Firefox.app/Contents: Plug-Ins
* It seems that downloading from stage-old.mozilla.org is not 100% safe since it is a proxy.
Contents of source/Firefox.app/Contents/Plug-Ins dir only in source or target
1775958570    0 drwxr-xr-x    3 cltbld  cltbld        102 Feb  2 16:58 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin
1775958571    0 drwxr-xr-x    4 cltbld  cltbld        136 Feb 10 15:00 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents
1775958572    0 drwxr-xr-x    2 cltbld  cltbld        68 Feb 10 15:00 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents/MacOS
1775958573    0 drwxr-xr-x    3 cltbld  cltbld        102 Feb  2 16:58 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents/Resources
1775958574    0 drwxr-xr-x    3 cltbld  cltbld        102 Feb 10 15:00 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents/Resources/English.lproj
1775958575    0 drwxr-xr-x    2 cltbld  cltbld        68 Feb 10 15:00 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents/Resources/English.lproj/PrintPDE.nib
</pre>
* Windows: All the normal suspects, no problems with this (chk files will go away with bug 489961)
<pre>Only in source/bin: .autoreg
Binary files source/bin/freebl3.chk and target/bin/freebl3.chk differ
Binary files source/bin/nssdbm3.chk and target/bin/nssdbm3.chk differ
Only in source/bin: removed-files
Binary files source/bin/softokn3.chk and target/bin/softokn3.chk differ
</pre>


 
====== Verification ======
</i>
* All platforms
** no update for mn since that doesn't exist for 3.6.4
** sl leaves these searchplugins behind (they were removed between 3.6 and 3.6.2)
iskalnik-gov-si.xml
najdi-si.xml
yahoo.xml
* Linux - PASS, no extra differences found.
* Windows - PASS, with the usual issues differences for .autoreg, freebl3.chk, nssdbm3.chk, removed-files, softokn3.chk
* Mac - PASS, with some leftover directories
Only in source/Firefox.app/Contents: Plug-Ins
Contents of source/Firefox.app/Contents/Plug-Ins dir only in source or target
229503469        0 drwxr-xr-x    3 cltbld  staff        102 May  4 10:31 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin
229503470        0 drwxr-xr-x    4 cltbld  staff        136 Jun 22 18:30 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents
229503474        0 drwxr-xr-x    2 cltbld  staff          68 Jun 22 18:30 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents/MacOS
229503475        0 drwxr-xr-x    3 cltbld  staff        102 May  4 10:31 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents/Resources
229503477        0 drwxr-xr-x    3 cltbld  staff        102 Jun 22 18:30 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents/Resources/English.lproj
229503481        0 drwxr-xr-x    2 cltbld  staff          68 Jun 22 18:30 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents/Resources/English.lproj/PrintPDE.nib


==== Publish updates to beta channel  ====
==== Publish updates to beta channel  ====
Line 394: Line 321:


==== Final Verification  ====
==== Final Verification  ====
After all products/files had some uptake the "force build" button was used to start the "final_verification" builder.


==== Fix Major Update snippets ====
* We have a bunch of 404 message for cacheboy.net.
* nthomas suggested me to chat with adrian on #mirrors
* nthomas is verifying the log as well
* nthomas suggested me for next time to use something like this:
  while [[ 2 > 1 ]]; do curl -sI  http://mozilla.cdn.cacheboy.net/firefox/releases/3.5.10/update/win32/en-US/firefox-3.5.10.complete.mar | grep ^HTTP; done


==== Throttling Updates  ====
NOTE: If there had been neither 404s nor 503s in the log I should have marked this step as a PASS.


==== Push updates to release channel  ====
==== Push updates to release channel  ====
* Push 3.5.x snippets
# cltbld @ aus2-staging
cd /opt/aus2/snippets/staging
~/bin/backupsnip 20100504-Firefox-3.5.10
~/bin/pushsnip 20100504-Firefox-3.5.10
* push major update snippets (unadvertised)
~/bin/backupsnip 20100622-Firefox-3.5.10-3.6.4-MU
~/bin/pushsnip  20100622-Firefox-3.5.10-3.6.4-MU
==== Unthrottle release channel ====
* We have to remove all throttling for the previous '''dot'''release since only the "release" users are excepted.
** Unthrottle 3.5.9 - [https://bugzilla.mozilla.org/attachment.cgi?id=453231 patch], tag, and [https://bugzilla.mozilla.org/show_bug.cgi?id=573888 push].
==== Unthrottle MU ====
* {{bug|578450}} do unthrottled 3.5.10 -> 3.6.6 major update
** [https://bug578450.bugzilla.mozilla.org/attachment.cgi?id=457139] remove 3.5.10 throttling, add 3.5.11 throttling (NOTE: I forgot to add "releasetest" in the patch)


==== Release  ====
==== Release  ====
# ffxbld@stage
cd /home/ftp/pub/firefox/releases
rm latest-3.5 && ln -s 3.5.10 latest-3.5


==== XULRunner build ====
==== XULRunner build ====
Discontinued ?

Latest revision as of 16:07, 20 July 2010

Build Engineers

armenzg bug 563338

Signed-off Revision(s)

http://hg.mozilla.org/releases/mozilla-1.9.1/rev/6d296f4b8ad9

Tags

On releases/mozilla-1.9.1:

Build # Tag Changeset
1 GECKO19110_20100504_RELBRANCH
6d296f4b8ad9
FIREFOX_3_5_10_BUILD1 FIREFOX_3_5_10_RELEASE 1e0223b57404

Build data

Build # Type Build ID Build machine
1 Linux 20100504085637 mv-moz2-linux-ix-slave16
1 Mac 20100504085753 bm-xserve21
1 Windows 20100504093643 mw32-ix-slave22

Notes

Build 1

  • Used clobberer to clean up previous release
  • Landed automation version bumps, reconfigured production-master02
    • Deleted all the .pyc files in the master dir before reconfig just in case
  • Kicked off automation
buildbot sendchange --username=armenzg --master=localhost:9010 --branch=releases/mozilla-1.9.1 -m "Firefox 3.5.10 build1" Go
  • Tagged build repos (as soon as tagging and branching finishes)
# buildbot-configs
hg tag -r 2a7d23c0b20a FIREFOX_3_5_10_RELEASE; hg tag -r 2a7d23c0b20a FIREFOX_3_5_10_BUILD1
hg push
# buildbotcustom
hg tag -r 6490ead4317f FIREFOX_3_5_10_RELEASE; hg tag -r 6490ead4317f FIREFOX_3_5_10_BUILD1
hg push
# tools
hg tag -r 4911ca459d50 FIREFOX_3_5_10_RELEASE; hg tag -r 4911ca459d50 FIREFOX_3_5_10_BUILD1
hg push


Tag

mv-moz2-linux-ix-slave24

remote: ssh_exchange_identification: Connection closed by remote host
abort: no suitable response from remote hg!
diff -r 2a7d23c0b20a mozilla2/l10n-changesets
--- a/mozilla2/l10n-changesets  Tue May 04 11:14:05 2010 -0400
+++ b/mozilla2/l10n-changesets  Tue May 04 08:35:45 2010 -0700
@@ -1,21 +1,3 @@
-af 13e01380d0ae
-ar b5139ff0f18a
-as cf8a573950c5
-be 33f4b80fbc7e
-bg 47fb5af14c40
-bn-BD 406e0431af75
-bn-IN f1653cf6cf20
-ca 30f4322ce9d1
-cs 06e8039a3a88
-cy 1ec72cb0a4f5
-da 987d06dc1013
-de 75a62aa26f22
-el 4359d2ea676f
-en-GB 5cbd966ebcc0
-eo ce59fce0702c
-es-AR 26ab5157d62c
-es-CL ff0d83ed9733
-es-ES e860ef7ebcf9
 es-MX d8f55a9f91ed
 et 6f16a54f0986
 eu 1c17d7ee65b4

Source

mv-moz2-linux-ix-slave13

  • No problems

Build/Repack

mv-moz2-linux-ix-slave16, bm-xserve21 and mw32-ix-slave22

  • Linux: No problems
  • Win32: No problems
  • Mac: No problems. 2 red repacks
abort: data/seamonkey/l10n-changesets.i@fddfb9ec8dd4: no match found!
  • Removed manually en-US.xpi from candidates dir

Sign

Signing Instructions

  • I had to trigger this twice since I had typed the wrong signcodepwd
  • You don't get any error until it is actually going to sign (few minutes after having typed the wrong password)
  • I checked the signature verification log and everything was OK

L10nVerify

bm-xserve21

  • No problems

Unthrottle beta channel

  • Unthrottle previous dot release on beta channel
    • This will bring beta users to the current dot release. The day of the release we have to do the same for the "release" users.
    • bug 567040 - Unthrottle 3.5.9 -> 3.5.10build1 on beta channel (it was forgotten on beta day)

Generate updates and push betatest snippets

mv-moz2-linux-ix-slave17

  • No problems

Update verify

mv-moz2-linux-ix-slave17, bm-xserve22 and mw32-ix-slave22

  • Linux: PASS
  • MacOSX: PASS
  • Windows: PASS

Major update generation and verification

3.5.10 -> 3.6.4 build1

mv-moz2-linux-ix-slave24

NOTE for next release: generate the MU the day before going live

  • I forced "major_update"
  • Send email to release drivers once the updates are generated (do not wait for major_update_verify to finish). updates available for 3.5.10 -> 3.6.4 build3 on betatest"
  • Known red for "major_update" builder bug 563935.
  • Read Major Update & Verification
Verification
  • Check the last 2 or 3 Build Notes if this is your first time verifying a major update generated in this new way. Carrying forward the known issues might be overkill.
  • Do this to check for the test failures:

Open each of the logs and search for "https://" (use Apple + G to repeat search) and you will find errors like this just two or three lines before the matching string:

  • Affects all 3 platforms:
    • failed to get partial/complete mar because we don't have "mn" for 3.6.x
Using  https://aus2.mozilla.org/update/1/Firefox/3.5.10/20100504085637/Linux_x86-gcc3/mn/betatest/update.xml?force=1
FAIL: no partial update found for https://aus2.mozilla.org/update/1/Firefox/3.5.10/20100504085637/Linux_x86-gcc3/mn/betatest/update.xml?force=1
FAIL: download_mars returned non-zero exit code: 1
Using  https://aus2.mozilla.org/update/1/Firefox/3.5.10/20100504085637/Linux_x86-gcc3/mn/betatest/update.xml?force=1
FAIL: no complete update found for https://aus2.mozilla.org/update/1/Firefox/3.5.10/20100504085637/Linux_x86-gcc3/mn/betatest/update.xml?force=1
FAIL: download_mars returned non-zero exit code: 1
    • For 'sl' we get these warnings "These were removed between 3.6 and 3.6.2 which is why they're no. No issues here." (confirm this quote from previous notes):
Only in source/firefox/searchplugins: iskalnik-gov-si.xml
Only in source/firefox/searchplugins: najdi-si.xml
Only in source/firefox/searchplugins: yahoo.xml
WARN: non-binary files found in diff
WARN: check_updates returned warning for Linux_x86-gcc3 downloads/firefox-3.5.10.tar.bz2 vs. downloads/firefox-3.6.4.tar.bz2: 2
  • Linux:
    • No test failure that was only Linux specific
  • MacOSX:
    • For all locales:
Contents of source/Firefox.app/Contents/Plug-Ins dir only in source or target 379277599        0 drwxr-xr-x    3 cltbld   staff         102 May  4 10:31 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin
379277600        0 drwxr-xr-x    4 cltbld   staff         136 May  5 08:05 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents
379277604        0 drwxr-xr-x    2 cltbld   staff          68 May  5 08:05 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents/MacOS
379277605        0 drwxr-xr-x    3 cltbld   staff         102 May  4 10:31 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents/Resources
379277607        0 drwxr-xr-x    3 cltbld   staff         102 May  5 08:05 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents/Resources/English.lproj
379277611        0 drwxr-xr-x    2 cltbld   staff          68 May  5 08:05 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents/Resources/English.lproj/PrintPDE.nib
WARN: non-binary files found in diff
WARN: check_updates returned warning for Darwin_Universal-gcc3 downloads/Firefox 3.5.10.dmg vs. downloads/Firefox 3.6.4.dmg: 2
  • Windows:
    • The chk files will go away with bug 489961
    • For all locales:
Only in source/bin: .autoreg
Files source/bin/freebl3.chk and target/bin/freebl3.chk differ
Files source/bin/nssdbm3.chk and target/bin/nssdbm3.chk differ
Only in source/bin: removed-files
Files source/bin/softokn3.chk and target/bin/softokn3.chk differ
WARN: non-binary files found in diff
WARN: check_updates returned warning for WINNT_x86-msvc downloads/Firefox Setup 3.5.10.exe vs. downloads/Firefox Setup 3.6.4.exe: 2
3.5.10 -> 3.6.3

mv-moz2-linux-ix-slave24

  • It seems that after all we are waiting for 3.6.4 to release. Nevertheless, I generated the MU for 3.5.10->3.6.3 just in case the plans change again
  • I had to trigger it a couple of times due to:
    • clobber does not clobber "major_update" so it required manual clobbering
    • Downloading failed
  • I have not spent time on checking the verification logs
3.5.10 -> 3.6.4 build7

NOTE for post-mortem:

  • pm02 was pointing to release-mozilla-central.py instead of release-mozilla-1.9.1.py. Therefore I did not see any "major_update" builder. After a while I realized about this.
  • pm was turned off so I turned it on. I got a slave and started doing "final_verification".
  • I landed a change for changing release_config1.py to point at release-mozilla-1.9.1.py. Unfortunately I had landed it on the buildbot-0.8.0 branch and therefore I was not able to see any "major_update" builder.
  • I started preparing the patches for manual generation of the MU until catlee noticed that the "major_update" builder was there (There was too much going and I probably missed it).
  • I made sure that now my patches were correctly landed on default and reconfigured.
  • I have now "force build" the builder


  • First run failed on the download step:
    • bug 573828 - "major update" failed to download file for 3.5.10 -> 3.6.4 MU
  • I clobbered and re-triggered
  • I had to trigger for a third time. This time it worked
  • It seems that downloading from stage-old.mozilla.org is not 100% safe since it is a proxy.
Verification
  • All platforms
    • no update for mn since that doesn't exist for 3.6.4
    • sl leaves these searchplugins behind (they were removed between 3.6 and 3.6.2)
iskalnik-gov-si.xml
najdi-si.xml
yahoo.xml
  • Linux - PASS, no extra differences found.
  • Windows - PASS, with the usual issues differences for .autoreg, freebl3.chk, nssdbm3.chk, removed-files, softokn3.chk
  • Mac - PASS, with some leftover directories
Only in source/Firefox.app/Contents: Plug-Ins
Contents of source/Firefox.app/Contents/Plug-Ins dir only in source or target
229503469        0 drwxr-xr-x    3 cltbld   staff         102 May  4 10:31 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin
229503470        0 drwxr-xr-x    4 cltbld   staff         136 Jun 22 18:30 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents
229503474        0 drwxr-xr-x    2 cltbld   staff          68 Jun 22 18:30 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents/MacOS
229503475        0 drwxr-xr-x    3 cltbld   staff         102 May  4 10:31 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents/Resources
229503477        0 drwxr-xr-x    3 cltbld   staff         102 Jun 22 18:30 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents/Resources/English.lproj
229503481        0 drwxr-xr-x    2 cltbld   staff          68 Jun 22 18:30 source/Firefox.app/Contents/Plug-Ins/PrintPDE.plugin/Contents/Resources/English.lproj/PrintPDE.nib

Publish updates to beta channel

  • backupsnip took 18 minutes
# cltbld @ aus-staging
cd /opt/aus2/snippets/staging
~/bin/backupsnip 20100504-Firefox-3.5.10-beta
~/bin/pushsnip 20100504-Firefox-3.5.10-beta

Socorro product data updates

  • Use crash-stats admin page
  • "Branch Data Sources"
  • Added Firefox 3.5.10 and 3.5.11pre
    • note that there has to be crashes to "add" - this needs the "bump version" patch to have landed first.
    • Adjust the "branch" drop down list to be 1.9.1 and that's it

Update Bouncer

  • Used bouncer admin page
  • Added product "Firefox-3.5.10", "Firefox-3.5.10-Complete" and "Firefox-3.5.10-Partial" with "Check Now" checked
  • Add the file locations as well or you won't see product uptake (I had missed this step)

Final checks before push

# ffxbld@stage
cd /pub/mozilla.org/firefox/nightly/3.5.10-candidates/build1/
find . ! -user ffxbld
find . ! -group firefox
find . -type f ! -perm 644
find . -mindepth 1 -type d ! -perm 755 ! -name 'contrib*'
find . -maxdepth 1 -type d ! -perm 2775  -name 'contrib*'

The first check returned Solaris builds, all others returned nothing, as expected.

Virus Scan

This is what I got at first:

[ffxbld@surf build1]$ clamdscan -m /pub/mozilla.org/firefox/nightly/3.5.10-candidates/build1
ERROR: Can't access file /pub/mozilla.org/firefox/nightyl/3.5.10-candidates/build1
/pub/mozilla.org/firefox/nightyl/3.5.10-candidates/build1: No files scanned

Ask IT to login as root or clamav user and run this:

/etc/init.d/clamd start

and then:

[ffxbld@surf build1]$ clamdscan -m /pub/mozilla.org/firefox/nightly/3.5.10-candidates/build1
/pub/mozilla.org/firefox/nightly/3.5.10-candidates/build1: OK

----------- SCAN SUMMARY -----------
Infected files: 0
Time: 1933.489 sec (32 m 13 s)

Push to mirrors

  • I decided to wait for 3.6.4's uptake to go up first
  • 3.6.4 was pushed to mirrors at 8:13 PDT
  • I pushed to mirrors at 9:15 PDT.
  • NOTE: according to reed from mirrors' perspective it is better to push all releases at the same time.
# ffxbld@stage
rsync -av --exclude="*reporter*" --exclude=*.log --exclude=*.txt --exclude=*unsigned* /pub/mozilla.org/firefox/nightly/3.5.10-candidates/build1/ /pub/mozilla.org/firefox/releases/3.5.10/
# cltbld@stage
vim /pub/mozilla.org/zz/rsyncd-mozilla-current.exclude
# replace 3.5.9 with 3.5.10

Final Verification

After all products/files had some uptake the "force build" button was used to start the "final_verification" builder.

  • We have a bunch of 404 message for cacheboy.net.
  • nthomas suggested me to chat with adrian on #mirrors
  • nthomas is verifying the log as well
  • nthomas suggested me for next time to use something like this:
while [[ 2 > 1 ]]; do curl -sI  http://mozilla.cdn.cacheboy.net/firefox/releases/3.5.10/update/win32/en-US/firefox-3.5.10.complete.mar | grep ^HTTP; done

NOTE: If there had been neither 404s nor 503s in the log I should have marked this step as a PASS.

Push updates to release channel

  • Push 3.5.x snippets
# cltbld @ aus2-staging
cd /opt/aus2/snippets/staging
~/bin/backupsnip 20100504-Firefox-3.5.10
~/bin/pushsnip 20100504-Firefox-3.5.10
  • push major update snippets (unadvertised)
~/bin/backupsnip 20100622-Firefox-3.5.10-3.6.4-MU
~/bin/pushsnip   20100622-Firefox-3.5.10-3.6.4-MU

Unthrottle release channel

  • We have to remove all throttling for the previous dotrelease since only the "release" users are excepted.

Unthrottle MU

  • bug 578450 do unthrottled 3.5.10 -> 3.6.6 major update
    • [1] remove 3.5.10 throttling, add 3.5.11 throttling (NOTE: I forgot to add "releasetest" in the patch)

Release

# ffxbld@stage
cd /home/ftp/pub/firefox/releases 
rm latest-3.5 && ln -s 3.5.10 latest-3.5

XULRunner build

Discontinued ?