Socorro/Pig Python InstallGuide: Difference between revisions

Jump to navigation Jump to search
details
(write down some of the insanity)
 
(details)
Line 1: Line 1:
This is documentation that bsmedberg wrote primarily for rhelmer and xstevens. Buyer beware.
This is documentation that bsmedberg wrote primarily for rhelmer and xstevens. This is what I had to do to write a python UDF which imports the socorro signature generation mechanism.
 
Buyer beware.


Trying to use python UDFs with pig is... painful. Here are the known issues:
Trying to use python UDFs with pig is... painful. Here are the known issues:
Line 15: Line 17:
With all of this, then, I think I have a working pig/jython setup:
With all of this, then, I think I have a working pig/jython setup:


self-build jython trunk
* self-build jython trunk
self-build pig 0.10.x trunk (0.10.x branch should also work) with some patchery
** ant && ant jar-standalone
set up the environment ridiculously carefully!
* self-build pig using this branch: https://github.com/bsmedberg/pig "jython-trunk-support"
* cp jython/dist/jython-standalone.jar pig/lib/jythong-standalone.jar
 
You should now have a pig which does useful things with python UDFs. But the work isn't done: parts of configman don't run under jython because.... well just because. So you'll have to use this version of configman: https://github.com/bsmedberg/configman/tree/formappingexception
 
The UDF, .pig script, and postprocessor script are now at https://github.com/bsmedberg/socorro-toolbox/tree/improveskiplist in
  src/main/pig/improveskiplist.pig
  src/main/python/pig_socorro.py (the UDF)
  src/main/python/checkimprovedskiplist.py (postprocessor)
Confirmed users, Bureaucrats and Sysops emeriti
1,217

edits

Navigation menu