parallel python tools to consider

[paciorek]

might consider joblib for shared memory and ipython parallel tools for distributed. Currently we have multiprocessing (which comes installed by default) and pp installed for shared memory and pp for distributed.

[davclark]

Check out dask?

And certainly PySpark! (the full spark stack is installable with conda)