Last updated: | Permalink
Lecture 3: Python Parallel Processing
Learning objectives:
In this lecture, you will learn:
- the basics of parallelism in Python.
- Process-level parallelism
- Thread-level parallelism
- Task-level parallelism
- how to calculate speedup and the definition of strong scaling and weak scaling.
- task-level parallelism in Dask.
Lecture slides
- Lec3: Parallel processing in Python: slides pdf, python parallelism notebook demo, dask dag notebook demo
Readings
- Lec3: Dask.distributed (optional), Python multiprocessing (optional)
Recordings
- Lec3a (A1 walkthru + caching worksheet + process parallelism): video
- Lec3b (thread parallelism + task parallelism + demo): video