In this talk, Raphael will share his experience taking part to the development of 3 new packages dedicated to the parallelization of distributed Python workloads:
- Scaler, a light-weight and resilient distributed task scheduler for Python;
- Parfun, an easy to use map-reduce decorator for Python;
- Pargraph a battle-tested distributed graph engine for Python.
The talk will show examples on how to leverage these three projects for efficient distributed computations.