TT Lab
Get started
Learn Learning paths Courses

Apache Spark — The answer to a slow job is in the plan and the event log

Measure shuffles, joins and skew in local-mode Spark with the event log

중급 · Lessons 30 · Lab 10

Start the lab

Curriculum

The driver and jobs

Schemas and broken rows

DataFrames and SQL

Reading execution plans

Shuffles and partition counts

Join strategies

Skew

Caching and recomputation

Writing to files

Structured Streaming

Reference docs