← Back to Home

Session 14 — Big Data & Parallel Processing

Hadoop, MapReduce & Spark. These are interactive browser demos — no cluster, no setup. Open them full-screen and show them live in class.

▶  Open the Interactive Slides

1. MapReduce Word Count (step-through)

Trace a sentence through Split → Map → Shuffle & Sort → Reduce. The clearest way to see MapReduce — type your own sentence and step through each phase.

2. Spark vs Hadoop (disk vs memory)

The same iterative job run both ways. Watch Hadoop's disk round-trips pile up while Spark stays in memory — and the speed gap grow as you add iterations.

No installs, no compilers — these run in any modern browser. In production this runs on managed clusters (AWS EMR, Google Dataproc, Databricks) or cloud warehouses (BigQuery, Snowflake).