Sheriffing/TBPL/ArchitectureAndDependencies: Difference between revisions

From MozillaWiki
Jump to navigation Jump to search
No edit summary
No edit summary
Line 1: Line 1:
==Modes==
# Traditional Tinderbox mode<br>Was used before bug 669000
# Transitory mode<br>Uses data from Buildbot or Tinderbox depending on usebuildbot=1 flag
# Future pure-Buildbot mode<br>Won't use data from Tinderbox any more. Not there yet.
==Servers==
==Servers==


* Tinderboxpushlog<br>tbpl.mozilla.org
* Tinderboxpushlog at [http://tbpl.mozilla.org/ tbpl.mozilla.org]
* Tinderbox<br>tinderbox.mozilla.org
* Tinderbox at [http://tinderbox.mozilla.org/ tinderbox.mozilla.org]
* Buildbot<br>build.mozilla.org
* Buildbot at [http://build.mozilla.org/ build.mozilla.org]
* Mercurial<br>hg.mozilla.org
* Mercurial at [http://hg.mozilla.org/ hg.mozilla.org]
* Mozilla FTP<br>ftp.mozilla.org
* Mozilla FTP at [http://ftp.mozilla.org/ ftp.mozilla.org]
* Bugzilla API<br>api-dev.bugzilla.mozilla.org
* Bugzilla API at [http://api-dev.bugzilla.mozilla.org/ api-dev.bugzilla.mozilla.org]
* War-on-orange elastic search database<br>elasticsearch1.metrics.sjc1.mozilla.com:9200<br>(only accessible from tbpl.mozilla.org)
* War-on-orange elastic search database at elasticsearch1.metrics.sjc1.mozilla.com:9200 (only accessible from tbpl.mozilla.org)


And there's the client, i.e. the user's browser.
And there's the client, i.e. the user's browser.
Line 22: Line 16:


* MongoDB needs to run
* MongoDB needs to run
* TBPL PHP scripts need PHP 5.3 with access to:
* TBPL PHP scripts need Apache and PHP 5.3 with access to:
** MongoDB through MongoPHP driver
** MongoDB through MongoPHP driver
** file system for caching
** file system for caching

Revision as of 17:06, 19 July 2011

Servers

And there's the client, i.e. the user's browser.

Dependencies

Inside the TBPL server

  • MongoDB needs to run
  • TBPL PHP scripts need Apache and PHP 5.3 with access to:
    • MongoDB through MongoPHP driver
    • file system for caching
  • TBPL Python script needs Python 2.6 with access to:
    • MongoDB through pymongo driver
  • Cronjob needs to run /dataimport/import-buildbot-data.py periodically

Between TBPL server and other servers

tbpl.mozilla.org needs access to:

  • tinderbox.mozilla.org
    • from /php/getTinderboxSummary.php to /showlog.cgi?...: Build logs
    • from /leak-analysis/index.php to /showlog.cgi?...: Build logs
  • build.mozilla.org
    • from /dataimport/import-buildbot-data.py to /builds/builds-...js.gz: Build data
  • hg.mozilla.org
    • from /dataimport/import-buildbot-data.py to /try/json-pushes?...: Pusher for revision
  • ftp.mozilla.org
    • from /php/inc/RawGzLogDownloader.php to /pub/mozilla.org/...: Build logs
  • api-dev.bugzilla.mozilla.org
    • from /php/submitBugzillaComment.php to /...: Automated commenting on starred orange bugs
  • elasticsearch1.metrics.sjc1.mozilla.com:9200
    • from /php/starcomment.php to /...: Storing and retrieving build stars

Between the client and other servers

Visitors of TBPL (the "client") need access to:

  • tbpl.mozilla.org (duh)
  • tinderbox.mozilla.org
    • to /.../status.html: Tree status
    • to /showbuilds.cgi?...: Build data
    • to /.../json.js: Cached build data
  • build.mozilla.org
    • to /builds/...: Data about pending and running builds
    • to /buildapi/...: Self-serve API to retrigger and cancel builds
  • hg.mozilla.org
    • to /.../pushlog: Push data
  • api-dev.bugzilla.mozilla.org
    • to /...: Showing bug summaries as tooltips for bug numbers

Diagram

being drawn now