Build/DashboardUseCases

• Per-push view
  • This is what tinderboxpushlog does. We need to make sure that we can continue to feed it the same data (even if we change the format).
  • We need to figure out what to do with build logs.
  • We need to be able to add comments on builds, indicate that the tree is open/closed, who is sheriff, etc.
    • is this an API-level requirement, i.e. allow builds to be annotated in the db? Should we be pushing back the comment-on-a-build functionality to tinderboxpushlog rather than recreating the current tinderbox comment interface in our dashboard?

• Unittest results
  • Track results of individual tests over time
    • automate the tracking of intermittent failures
  • Not tracking data here in a good way yet

• Build group dashboards:
  • Wait times for various pools (how long has it been between a request arriving, and the job being given to a build slave)
  • Per-branch view
    • What is the level of activity on all our branches.
    • End-to-end time (how long between a developer pushing a change and all the builds, test results, etc. being available.
    • Track average time per builder, raise alerts when it goes too high

• Talos
  • integrate regression tracking into dashboard

• Existing stats/graphs that joduinn generates (ref: http://oduinn.com/2009/07/15/infrastructure-load-during-may/)
  • total pushes per unit time
  • total # build jobs (unittest/talos/etc) triggered by those pushes
  • avg # pushes per day
  • max # builds per day
  • monthly reports:
    • # pushes per day per branch
    • theoretical # jobs per month, broken down by branch
    • # pushes by time of day (also broken down by day)
    • avg # pushes by hour of day
  • possible extensions
    • avg # pushes by day of week
    • # failures (build/test) by hour of day
    • # failures (build/test) by day of week

See also: http://oduinn.com/2009/02/18/what-are-all-these-machines-telling-us/

What do we need during releases?

• nthomas managed to generate this manually. http://people.mozilla.org/~nthomas/misc/uptake.html