Changes

<div style="float:right;background-color:#fff;padding:20px;">[[Image:Moz blackhole.png]]</div>

Project BlackholeWormhole (previously known as Wormhole), is a collaborative effort to develop and maintain an infrastructure of gathering and serving raw contribution data within Mozilla.

Project Blackhole Wormhole makes sure to integrate with those systems, get the contribution data from all different functional areas and store them as raw data, which then in turn become available for querying.

Blackhole Wormhole data architecture and flow can be outlined in the following diagram:

In brief, there's a central database into which unrelated systems push data describing contributions. This data can be queried very broadly (eg. show me contributions by a certain user; show me contributions made during a certain period; show me a certain type of contribution), as well as with very deeply (eg. show me Bugzilla triage contributions for the Firefox product). All data stored has a small amount of commonality, describing where it came from, who contributed, when they did it, and how to find the original contribution. Further information available varies per type of contribution, so Blackhole Wormhole users can query specifically for it if they're interested.

In depth, the preferable push infrastructure is built on [http://pulse.mozilla.org/ pulse]. A system accepting user contributions sends a pulse message when a contribution is made, with as much detail as is required to give the contribution context. A Blackhole Wormhole pulse consumer observes the message, and stores the contribution data in the database with very little processing. A frontend for the database allows complex queries to be executed via a RESTful web interface, allowing consumers to build tools that integrate with Blackhole Wormhole by performing on-demand lookups.

<li>Assuming viability, find a permanent home for Blackhole Wormhole and associated infrastructure</li>

Database schema: [[BlackholeWormhole/Schema]]