Tag: #yarn
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 9 posts
9 posts are tagged #yarn; the most recent was published on 2026-08-12.
Often tagged together: #hadoop 7 #hdfs 4 #2026-03 3 #big-data 3 #mapreduce 3
Most read in the last 90 days:
Positional Encoding — RoPE and the Price of Context Extension
Showing through wavelength arithmetic how a single ropetheta value acts on context length, then comparing the 500000 of Llama 3, the ABF step in Qwen3, the YaRN settings of DeepSeek-V3 and Kimi K2, and the partial rotati
2026-08-12 · 6 min read #ai-papers#model-internals#rope#positional-encoding#long-contextRevisiting Hadoop Architecture — HDFS, YARN, and Beyond ♪ Listenable
A diagram-driven walkthrough of Hadoop core internals — HDFS, YARN, and how MapReduce works. We look at how Hadoop role has shifted in the era of object storage, the cloud, and the lakehouse, and how we should understand
2026-06-27 · 30 min read #hadoop#hdfs#yarn#mapreduce#lakehouseModern Hadoop & Big Data Ecosystem 2026 Deep Dive - Hadoop 3.4 · Spark 4 · Hive 4 · Kafka 4 · Flink 2 · Iceberg · Trino ♪ Listenable
In 2026 Hadoop and the broader big-data ecosystem are not dead — they have been relocated. Hadoop 3.4 Erasure Coding and Ozone, Spark 4 ANSI mode and Spark Connect, Hive 4 Iceberg integration, Kafka 4 with KRaft GA and t
2026-05-16 · 26 min read #english#hadoop#spark#hive#kafkaHadoop Ecosystem Operations Guide: HDFS, YARN, and MapReduce Operational Standards ♪ Listenable
Practical operational standards for running Hadoop clusters: HDFS capacity management, YARN queue design, MapReduce job tuning, monitoring, and troubleshooting.
2026-03-08 · 20 min read #hadoop#hdfs#yarn#mapreduce#databaseHadoop Ecosystem Practical Guide: HDFS, MapReduce, and YARN Core Concepts
A comprehensive guide covering the architecture and internals of Hadoop's core components -- HDFS, MapReduce, and YARN -- along with practical operational know-how from cluster setup to performance tuning and monitoring.
2026-03-08 · 14 min read #hadoop#hdfs#mapreduce#yarn#big-dataComplete Guide to LLM Context Window Extension: From RoPE, ALiBi, and YaRN to Ring Attention
An in-depth analysis of techniques for extending LLM context windows from 512 to 2M tokens. Covers the mathematical principles of RoPE through NTK-aware scaling, YaRN, and Ring Attention with practical code examples.
2026-03-03 · 9 min read #llm#context-window#rope#yarn#positional-encodingWhat is Hadoop's OS 'YARN'?
Learn about YARN (Yet Another Resource Negotiator), a platform that runs on Hadoop to manage cluster resources and execute distributed processing applications.
2023-09-02 · 4 min read #hadoop#yarnHow to Install Spark on YARN
Learn how to install Spark on YARN.
2022-11-26 · 7 min read #hadoop#spark#yarnBuilding a Secured (Kerberized) YARN Cluster
Learn how to apply Kerberos security to YARN.
2022-10-21 · 2 min read #hadoop#kerberos#yarn