Releases/Firefox 13.0b3/BuildNotes: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
(moar bugs)
 
(15 intermediate revisions by 2 users not shown)
Line 8: Line 8:
* {{bug|753226}} - <tt>release-sanity.py</tt> doesn't validate non-optional arguments
* {{bug|753226}} - <tt>release-sanity.py</tt> doesn't validate non-optional arguments
* {{bug|743304}} - <small>pre-existing</small> partial mars signing failed due to py26/py27 differences, delaying win32 builds, so QA opened {{bug|753352}} to check on status
* {{bug|743304}} - <small>pre-existing</small> partial mars signing failed due to py26/py27 differences, delaying win32 builds, so QA opened {{bug|753352}} to check on status
* {{bug|753300}} - missing keys/known_hosts on <tt>bld-centos6-*</tt> machines didn't allow several uploads.


=Build Engineers=
=Build Engineers=
Line 47: Line 48:
| rowspan="4" | 1  
| rowspan="4" | 1  
| Linux
| Linux
| rowspan="4" | 20120508180640
| rowspan="3" | 20120508180640
| linux-ix-slave14
| linux-ix-slave14
| 1 hrs, 3 mins, 26 secs
| 1 hrs, 3 mins, 26 secs
Line 56: Line 57:
|-
|-
| Mac
| Mac
|  
| moz2-darwin10-slave55
|  
| 3 hrs, 14 mins, 30 secs
|-
|-
| Windows  
| Windows  
|  
| 20120509070325
|  
| w32-ix-slave37
| 3 hrs, 42 mins, 15 secs
|}
|}


Line 135: Line 137:
=== Build ===
=== Build ===
==== Firefox ====
==== Firefox ====
 
OK
===== Firefox repacks =====
===== Firefox repacks =====
OK


==== Fennec ====
==== Fennec ====
 
===== Fennec repacks =====
===== Fennec repacks =====


=== Unittests / Talos ===
=== Unittests / Talos ===
<small>[[Release:Release_Automation_on_Mercurial:Documentation#Talos_.26_Unittests|details]]</small>
# Look to see that they ran
# Document any oranges (per platform) for unittests - if possible, try to confirm it's known/random
# Make sure there's no red/failures that we need to have a dev look at


=== XULRunner ===
=== XULRunner ===


====Source====
====Source====
 
OK
====Build====
====Build====
 
OK
=== Partner Repack ===
==== Firefox ====
==== Fennec ====


=== Android Signing ===
=== Android Signing ===
Line 162: Line 160:


Now run on signing1.
Now run on signing1.
OK
=== L10N verify ===
=== L10N verify ===
Failed on mac after hy-AM, other platforms okay. This verify step scheduled to be removed ({{bug|749748}}), so "mach nicht".


Rest OK


=== Checksums ===
=== Checksums ===
 
OK
=== Updates ===
=== Updates ===
 
OK
==== Update verify ====
==== Update verify ====
 
OK
=== Major Update ===
Major update generation is not kicked off automatically. You should only create them once the final builds for the "latest" build are ready.
For instance, the 3.6.26 builds got created a week before the 10.0 release but the "final" 10.0 builds were not created after few days.
 
Follow instructions from the [[Release:Release_Automation_on_Mercurial:Documentation#Major_Update_.28Firefox_only.29|Major update]] documentation.
 
==== Major Update verify ====


=== Reset reserved slaves ===
=== Reset reserved slaves ===
 
The final release with this naming convention, so just got rid of the file:
<pre>
    rm reserved_slaves_bm13-build1
</pre>
=== Check permissions / AV scan ===
=== Check permissions / AV scan ===
It is supposed to be triggered automatically after updates are done.
OK
File a bug if it doesn't. <small>[[Release:Release_Automation_on_Mercurial:Documentation#Antivirus_check|details]]</small>
 
=== Push to internal mirrors ===
=== Push to internal mirrors ===
This is done by automation for rapid release betas.
OK


For other releases, this should be done manually at this point, after check permissions / AV scan have completed.
'''automation failure''' on <tt>bld-centos6-hp-*</tt> hosts {{bug|753053}}, so manually pushed.
* Make sure the rsync excludes have been updated ([[Releases/BuildNotesTemplate#Edit_rsync_exclude_files]])
* Force build the push to mirrors builder. Make sure at least 15 minutes have elapsed since editing the rysnc module to give it time to sync out.


[https://intranet.mozilla.org/ReleaseEngineering/Release/Primer#Mirrors_.28internal_.26_external.29 Mirrors Policy]
Had to reconfig master in middle of run for {{bug|753300}}, so uptake monitoring broke. Manually sent "ready for releasetest" emails.


=== Final verification ===
=== Final verification ===
Line 198: Line 193:


=== Going to Beta ===
=== Going to Beta ===
<font color='orange'>NOTE: Skip to "Before Release Day" for '''beta''' releases</font>


==== Run backupsnip ====
==== Run backupsnip ====
NOTE: Remember to do this at least '''2 hours''' ahead of the expected "go to beta" email. <small>''[[Release:Release_Automation_on_Mercurial:Documentation#Prepare_for_Beta_Release_.28Firefox_only.29|details]]''</small>
NOTE: Remember to do this at least '''2 hours''' ahead of the expected "go to beta" email. <small>''[[Release:Release_Automation_on_Mercurial:Documentation#Prepare_for_Beta_Release_.28Firefox_only.29|details]]''</small>
 
<pre>
Remember to ssh to aus3-staging using your short LDAP name and then run <code>sudo su - ffxbld</code> once on.  If you intend to use screen, initiate your screen session while you are still yourself.
$ cd /opt/aus2/snippets/staging/
$ time ~/bin/backupsnip Firefox-13.0b3-build1
</pre>
Done in 9 minutes


==== Push to beta ====
==== Push to beta ====
Line 210: Line 207:
* Publish (and record run time here): <small>''[[Release:Release_Automation_on_Mercurial:Documentation#Beta_Release_.28Firefox_only.29|details]]''</small>
* Publish (and record run time here): <small>''[[Release:Release_Automation_on_Mercurial:Documentation#Beta_Release_.28Firefox_only.29|details]]''</small>
* on completion, email r-d that VERSION updates are live on the beta channel
* on completion, email r-d that VERSION updates are live on the beta channel
<tt>pushsnip</tt> ran in 7m21.799s; email sent to r-d


For Android:
For Android:
* publish on Google Play (nee Android Marketplace), using [[#Publish_Fennec_to_the_Android_Market|instructions below]]
''no android this release''
* on completions, email r-d that VERSION is live on Google Play


Wait for confirmation from QA that each of the above releases is okay, then close the tracking ticket.
Wait for confirmation from QA that each of the above releases is okay, then close the tracking ticket.


=== Before Release Day ===
<pre>
<!-- not for beta -->
-------- Original Message --------
Assuming this is not a chemspill.
Subject: Firefox 13.0b3 updates on beta channel signed off
 
Date: Fri, 11 May 2012 12:52:24 -0700 (PDT)
==== Run backupsnip for release snippets ====
From: Anthony Hughes <ahughes@mozilla.com>
Do this the night before release day as it can take up to two hours.
To: release-drivers drivers <release-drivers@mozilla.org>
 
</pre>
=== Push index file to mirrors ===
 
=== Push to external mirrors ===
If this is a chemspill you will want to ping justdave (or other sysadmin) in #release-drivers and ask them to enable CDN.
 
* Remove previously added blacklisting entry from stage.mozilla.org:/pub/mozilla.org/zz/rsyncd-mozilla-releases.exclude
* Replace old version with the current one in stage.mozilla.org:/pub/mozilla.org/zz/rsyncd-mozilla-current.exclude
 
See [https://intranet.mozilla.org/RelEngWiki/index.php/Managing_Rsync_Modules details]
 
=== Release Day ===
==== Publish Fennec to the Play Store (for beta releases and release releases) ====
=====Push the files (for beta releases and release releases)=====
* Use [http://hg.mozilla.org/build/braindump/file/tip/releases-related/push_fennec.sh this script] and run it as ffxbld@stage (please push you changes prior to using it, and grab latest on stage via <tt>curl -O http://hg.mozilla.org/build/braindump/raw-file/tip/releases-related/push_fennec.sh</tt>)
 
=====Play Store (for beta releases and release releases)=====
'''IMPORTANT -''' Make sure to follow instructions!
* download multi apk (e.g. [http://ftp.mozilla.org/pub/mozilla.org/mobile/candidates/10.0b6-candidates/build1/android/multi/fennec-10.0b6.multi.android-arm.apk multi/fennec-10.0b6.multi.android-arm.apk])
* visit https://market.android.com/publish
* choose "Firefox Beta" or "Firefox"
* select the "APK Files" tab and choose "Upload APK"
** choose the multi apk that you downloaded and hit "upload"
*** NOTE: the progress bar does not seem to show progress (at least on Google Chrome)
** when it finishes uploading, verify VersionCode is the build date (almost anyway, the market reports an hour later than our buildID)
** hit "Save"
* activate new apk (You should see an Error message since both apk's are active)
* deactivate old apk (You should not see the Error message anymore)
* hit "Save"
* If this is a beta 1, go to "Product Details" tab -> Recent Changes, change the url to  http://www.mozilla.com/en-US/mobile/{VERSION}beta/releasenotes/
** and hit "Save"
 
====Push XULRunner to Mirrors ====
 
==== Update XULRunner wiki page ====
For major releases or chemspills, update the links on:
* https://developer.mozilla.org/en/XULRunner
* https://developer.mozilla.org/en/Gecko_SDK
 
Also for older releases:
* https://developer.mozilla.org/en/XULRunner_1.9.2_Release_Notes
* https://developer.mozilla.org/en/Gecko_SDK
 
==== Check Throttling  ====
See http://update-watch.localgho.st/release/ for example AUS links
 
Some links to check:
* Automatic (idle time check) update links:
** 10.0.2 en-US [https://aus3.mozilla.org/update/1/Firefox/10.0.2/20120215223356/WINNT_x86-msvc/en-US/release/update.xml win32] [https://aus2.mozilla.org/update/1/Firefox/10.0.2/20120215223356/Linux_x86-gcc3/en-US/release/update.xml linux] [https://aus2.mozilla.org/update/1/Firefox/10.0.2/20120215223356/Darwin_x86_64-gcc3-u-i386-x86_64/en-US/release/update.xml mac] [https://aus2.mozilla.org/update/1/Firefox/10.0.2/20120215223356/Linux_x86_64-gcc3/en-US/release/update.xml linux64]
** 9.0 en-US [https://aus2.mozilla.org/update/1/Firefox/9.0/20111216140209/WINNT_x86-msvc/en-US/release/update.xml win32] [https://aus2.mozilla.org/update/1/Firefox/9.0/20111216140209/Linux_x86-gcc3/en-US/release/update.xml linux] [https://aus2.mozilla.org/update/1/Firefox/9.0/20111216140209/Darwin_x86_64-gcc3-u-i386-x86_64/en-US/release/update.xml mac] [https://aus2.mozilla.org/update/1/Firefox/9.0/20111216140209/Linux_x86_64-gcc3/en-US/release/update.xml linux64]
** 10.0.2esr en-US [https://aus2.mozilla.org/update/1/Firefox/10.0.2/20120216092139/WINNT_x86-msvc/en-US/esr/update.xml win32] [https://aus2.mozilla.org/update/1/Firefox/10.0.2/20120216092139/Linux_x86-gcc3/en-US/esr/update.xml linux] [https://aus2.mozilla.org/update/1/Firefox/10.0.2/20120216092139/Darwin_x86_64-gcc3-u-i386-x86_64/en-US/esr/update.xml mac] [https://aus2.mozilla.org/update/1/Firefox/10.0.2/20120216092139/Linux_x86_64-gcc3/en-US/esr/update.xml linux64]
** 10.0esr en-US [https://aus2.mozilla.org/update/1/Firefox/10.0/20120130064731/WINNT_x86-msvc/en-US/esr/update.xml win32] [https://aus2.mozilla.org/update/1/Firefox/10.0/20120130064731/Linux_x86-gcc3/en-US/esr/update.xml linux] [https://aus2.mozilla.org/update/1/Firefox/10.0/20120130064731/Darwin_x86_64-gcc3-u-i386-x86_64/en-US/esr/update.xml mac] [https://aus2.mozilla.org/update/1/Firefox/10.0/20120130064731/Linux_x86_64-gcc3/en-US/esr/update.xml linux64]
** 3.6.27 en-US [https://aus2.mozilla.org/update/1/Firefox/3.6.27/20120216013254/WINNT_x86-msvc/en-US/release/update.xml win32] [https://aus2.mozilla.org/update/1/Firefox/3.6.27/20120216013254/Linux_x86-gcc3/en-US/release/update.xml linux] [https://aus2.mozilla.org/update/1/Firefox/3.6.27/20120216013254/Darwin_x86-gcc3-u-ppc-i386/en-US/release/update.xml mac]
* Manual update links:
** 10.0.2 en-US [https://aus3.mozilla.org/update/1/Firefox/10.0.2/20120215223356/WINNT_x86-msvc/en-US/release/update.xml?force=1 win32] [https://aus2.mozilla.org/update/1/Firefox/10.0.2/20120215223356/Linux_x86-gcc3/en-US/release/update.xml?force=1 linux] [https://aus2.mozilla.org/update/1/Firefox/10.0.2/20120215223356/Darwin_x86_64-gcc3-u-i386-x86_64/en-US/release/update.xml?force=1 mac] [https://aus2.mozilla.org/update/1/Firefox/10.0.2/20120215223356/Linux_x86_64-gcc3/en-US/release/update.xml?force=1 linux64]
** 9.0 en-US [https://aus2.mozilla.org/update/1/Firefox/9.0/20111216140209/WINNT_x86-msvc/en-US/release/update.xml?force=1 win32] [https://aus2.mozilla.org/update/1/Firefox/9.0/20111216140209/Linux_x86-gcc3/en-US/release/update.xml?force=1 linux] [https://aus2.mozilla.org/update/1/Firefox/9.0/20111216140209/Darwin_x86_64-gcc3-u-i386-x86_64/en-US/release/update.xml?force=1 mac] [https://aus2.mozilla.org/update/1/Firefox/9.0/20111216140209/Linux_x86_64-gcc3/en-US/release/update.xml?force=1 linux64]
** 10.0.2esr en-US [https://aus2.mozilla.org/update/1/Firefox/10.0.2/20120216092139/WINNT_x86-msvc/en-US/esr/update.xml?force=1 win32] [https://aus2.mozilla.org/update/1/Firefox/10.0.2/20120216092139/Linux_x86-gcc3/en-US/esr/update.xml?force=1 linux] [https://aus2.mozilla.org/update/1/Firefox/10.0.2/20120216092139/Darwin_x86_64-gcc3-u-i386-x86_64/en-US/esr/update.xml?force=1 mac] [https://aus2.mozilla.org/update/1/Firefox/10.0.2/20120216092139/Linux_x86_64-gcc3/en-US/esr/update.xml?force=1 linux64]
** 10.0esr en-US [https://aus2.mozilla.org/update/1/Firefox/10.0/20120130064731/WINNT_x86-msvc/en-US/esr/update.xml?force=1 win32] [https://aus2.mozilla.org/update/1/Firefox/10.0/20120130064731/Linux_x86-gcc3/en-US/esr/update.xml?force=1 linux] [https://aus2.mozilla.org/update/1/Firefox/10.0/20120130064731/Darwin_x86_64-gcc3-u-i386-x86_64/en-US/esr/update.xml?force=1 mac] [https://aus2.mozilla.org/update/1/Firefox/10.0/20120130064731/Linux_x86_64-gcc3/en-US/esr/update.xml?force=1 linux64]
** 3.6.27 en-US [https://aus2.mozilla.org/update/1/Firefox/3.6.27/20120216013254/WINNT_x86-msvc/en-US/release/update.xml?force=1 win32] [https://aus2.mozilla.org/update/1/Firefox/3.6.27/20120216013254/Linux_x86-gcc3/en-US/release/update.xml?force=1 linux] [https://aus2.mozilla.org/update/1/Firefox/3.6.27/20120216013254/Darwin_x86-gcc3-u-ppc-i386/en-US/release/update.xml?force=1 mac]
 
==== Push to Release Channel (for beta releases and release releases) ====
Once there is enough uptake and we get "go" from release driver.
 
==== Update symlinks ====
Once we're signed off on the release channel.
===== Remove index.html files =====
If you created them earlier to hide the release.
 
==== Update browser choice website ====

Latest revision as of 13:49, 17 May 2012

Notes About Releasing

Please update the Notes Template and the Release:Primer for future releases (bug fixes, changes to automation) as needed

Bugs hit

Enter any bugs pre-existing or newly discovered and filed during the release:

  • bug 753172 - needed to steal darwin10 slaves for the duration
  • bug 753053 - missing symlinks on build master for l10n configs
  • bug 753226 - release-sanity.py doesn't validate non-optional arguments
  • bug 743304 - pre-existing partial mars signing failed due to py26/py27 differences, delaying win32 builds, so QA opened bug 753352 to check on status
  • bug 753300 - missing keys/known_hosts on bld-centos6-* machines didn't allow several uploads.

Build Engineers

{hwine} - Tracking bug: bug 744592

Signed-off Revision(s)

Build 1: aa323b98df36

L10N changesets

Instructions on how to get them

Tags

Manually tag the automation code, then record the generated tags below. (details)

Build # Branch, Tags Changeset
1 MOBILE130_2012050817_RELBRANCH, FENNEC_13_0b3_RELEASE FENNEC_13_0b3_BUILD1 64ffbdd90ac0
GECKO130_2012050817_RELBRANCH, FIREFOX_13_0b3_RELEASE FIREFOX_13_0b3_BUILD1 4f3991db9f8b

Build data

Firefox

Build # Type Build ID Build machine Time to build
1 Linux 20120508180640 linux-ix-slave14 1 hrs, 3 mins, 26 secs
Linux64 linux64-ix-slave21 1 hrs, 1 mins, 48 secs
Mac moz2-darwin10-slave55 3 hrs, 14 mins, 30 secs
Windows 20120509070325 w32-ix-slave37 3 hrs, 42 mins, 15 secs

Fennec

Build # Type Build ID Build machine Time to build
1 android 20120508174549 n/a n/a
android-xul linux-ix-slave15 47 mins, 22 secs

Notes

Build 1

Preparing to start Automation

detailed instructions

  • Set clobbers for the appropriate masters. Doing this 24-48 hours in advance should speedup the build.
  • Reserve slaves, e.g.:
[cltbld@buildbot-master08 master]$ pwd
/builds/buildbot/build1/master
[cltbld@buildbot-master08 master]$ cat reserved_slaves_bm08-build1 
8
  • For build1 only, create a symlink for your $version (eg 11.0b4, 10.0.2esr, 10.0.2, 3.6.27) (until bug 725839 is resolved)
# ffxbld@stage
cd /pub/mozilla.org/firefox/nightly/
mkdir ../candidates/$version-candidates
ln -s ../candidates/$version-candidates $version-candidates
  • Update l10n changesets for desktop, mobile
  • double-landed automation configs
  • Tag buildbot-configs, buildbotcustom, & tools with build & release tags. (details)
 hg tag -f {FIREFOX,FENNEC}_13_0b3_{RELEASE,BUILD1}
  • updated and reconfigure the master via fabric
cd /builds/buildbot/build1/master
source ../bin/activate
PYTHONPATH=. python ../tools/buildbot-helpers/release_sanity.py --dryrun \
    -u hwine -V 13.0b3 --branch mozilla-beta --build-number 1 \
    -c release-firefox-mozilla-beta.py -c release-fennec-mozilla-beta.py \
    --products firefox,fennec localhost:9001
  • start automation ← monitor progress on buildbot (e.g. beta)
    • the same command as above but without the "--dryrun"

E-mail Metrics

Use the address "metrics-alerts < AT > mozilla < PERIOD > org" 

   Firefox,firefox,firefox,13.0b3,13.0
   Fennec,firefox-mobile,fennec,13.0b3,13.0

Tag

OK

Bouncer Submitter

OK

Source

OK

Build

Firefox

OK

Firefox repacks

OK


Fennec

Fennec repacks

Unittests / Talos

XULRunner

Source

OK

Build

OK

Android Signing

Instructions in MobileSigning

Now run on signing1.

OK

L10N verify

Failed on mac after hy-AM, other platforms okay. This verify step scheduled to be removed (bug 749748), so "mach nicht".

Rest OK

Checksums

OK

Updates

OK

Update verify

OK

Reset reserved slaves

The final release with this naming convention, so just got rid of the file: 

    rm reserved_slaves_bm13-build1

Check permissions / AV scan

OK

Push to internal mirrors

OK

automation failure on bld-centos6-hp-* hosts bug 753053, so manually pushed.

Had to reconfig master in middle of run for bug 753300, so uptake monitoring broke. Manually sent "ready for releasetest" emails.

Final verification

Record receipt of "completed_final_verification" emails (1 per platform)

Going to Beta

Run backupsnip

NOTE: Remember to do this at least 2 hours ahead of the expected "go to beta" email. details 

 $ cd /opt/aus2/snippets/staging/
 $ time ~/bin/backupsnip Firefox-13.0b3-build1

Done in 9 minutes

Push to beta

Wait for "go" from release managers
For Firefox:

  • Publish (and record run time here): details
  • on completion, email r-d that VERSION updates are live on the beta channel

pushsnip ran in 7m21.799s; email sent to r-d

For Android: no android this release

Wait for confirmation from QA that each of the above releases is okay, then close the tracking ticket. 

-------- Original Message --------
Subject: 	Firefox 13.0b3 updates on beta channel signed off
Date: 	Fri, 11 May 2012 12:52:24 -0700 (PDT)
From: 	Anthony Hughes <ahughes@mozilla.com>
To: 	release-drivers drivers <release-drivers@mozilla.org>
Retrieved from "https://wiki.mozilla.org/index.php?title=Releases/Firefox_13.0b3/BuildNotes&oldid=432007"