Last updated: | Permalink
Lecture 4: GFS (HDFS) and MapReduce
Learning objectives:
In this lecture, you will learn:
- Lec4a: the design of GFS (HDFS)
- Lec4a: partitioning, replication, and the motivation of them
- Lec4a: role clients, master (NameNode), chunk servers (DataNodes) play for distributed file system reads and writes
- Lec4b: role mappers and reducers have in MapReduce jobs
Lecture slides
- Lec4a: GFS and HDFS: slides pdf slides+notes
- Lec4b: (Hadoop) MapReduce: slides pdf
Readings
- Lec4a: GFS paper
- Lec4b: MapReduce paper