Learning objectives:

In this lecture, you will learn:

• the motivation of Spark RDD
• the difference between RDD transformations and actions
• the benefits of the RDD abstraction

Lecture slides

• Lec8: Spark RDD: slides pdf, PageRank notes, Interactive debugging lineage graph example

Recordings

• Lec8a: video
• Lec8b: video
• Lec8c: video