Tag: #rdd
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 1 posts
Apache Spark Internals Deep Dive 2025: RDD, Catalyst Optimizer, Tungsten, Whole-Stage Codegen, Shuffle
Why Spark runs the same query 100x faster than MapReduce. RDD to DataFrame/Dataset, Catalyst optimizer, Tungsten project, whole-stage code generation, and shuffle optimization — a complete internal analysis.
2026-04-15 · 13 min read #spark#catalyst#tungsten#rdd#whole-stage-codegen