Confirmed users
1,927
edits
No edit summary |
|||
| Line 14: | Line 14: | ||
* Protocol used to talk to the broker is [http://en.wikipedia.org/wiki/AMQP AMQP]. | * Protocol used to talk to the broker is [http://en.wikipedia.org/wiki/AMQP AMQP]. | ||
* Messages are sent by default in JSON, though if you know all the producers and consumers will be in python you can change it to pickle. | * Messages are sent by default in JSON, though if you know all the producers and consumers will be in python you can change it to pickle. | ||
* For python, the underlying library currently used to talk AMQP is [ | * For python, the underlying library currently used to talk AMQP is [http://kombu.readthedocs.org/ Kombu]. | ||
* [http://docs.celeryproject.org/en/latest/index.html Celery] is used to run the scrapers that feed data into the broker. | * [http://docs.celeryproject.org/en/latest/index.html Celery] is used to run the scrapers that feed data into the broker. | ||
* pubsub plugins should be installed soon | * pubsub plugins should be installed soon | ||