ReleaseEngineering/BuildFaster

Goals

  • Get time from build-available to all tests done to <= 30 minutes
  • Get per-checkin build time to under 2 hours for all platforms

Current activities

  • Set up metrics to quantify our current end-to-end time, and be able to track it
  • Do non-PGO opt builds for linux and windows bug 658313
  • Investigate if we can do 64-bit only 10.6 builds per-checkin. Need to determine if there are many 10.5 only test failures.
  • Determine which suites to be merged with others - bug 659328
    • Improve set-up time
  • Gather data for devs to tackle test jobs that take long
  • Speeding up the build system itself:
    • (universal-singlepass) less painful universal builds on mac (build universal as a single pass) - bug 417044
    • makefiles: split of config/rules.mk into a hierarchy of makefiles - bug 662833
Bug Description Owner Status
?? Set up metrics to quantify our current end to end time for tracking catlee In Design
bug 658313 Make on-change builds into non PGO, only do PGO on an as available basis UNOWNED Needs owner
?? Investigate if we can do 64 bit only 10.6 builds per-checkin (how many 10.5 failures are there?) UNOWNED Needs Owner
bug 659328 Determine which suites can be merged to amortize setup cost armenzg Has Patches
n/a Profile Test suites to find individual tests are higher than average time to complete (so devs can fix them) jmaher First analysis of mochitest-plain complete
bug 417044 Perform Universal binary builds as single-pass :joey In Progress
bug 662833 Split config/rules.mk into hierarchy of makefiles :joey Waiting on Review
bug 659222 Branch prioritization broken for test jobs catlee In Progress
bug 661656 Improving network between colos zandr In Progress
bug 586418 Selective unpacking of unittests :salbiz Selective unpacking landed, cannot finish until bug 594415 completed

People

  • Chris AtLee (:catlee)
  • Armen Zambrano (:armenzg)
  • Joey Armstrong (:joey)

Definitions

end-to-end time
The time between a change being pushed to HG and all builds and test results being available
per-checkin build
Opt and debug builds that are triggered by a new checkin