Tag: #lakehouse
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 10 posts
10 posts are tagged #lakehouse; the most recent was published on 2026-07-31.
Often tagged together: #data-engineering 6 #iceberg 6 #spark 5 #big-data 4 #delta-lake 4
Most read in the last 90 days:
- Feature Stores 2026 Deep Dive — Feast, Tecton, Hopsworks, Databricks, Vertex AI, SageMaker, Featureform, Bytewax, Materialize, RisingWave, Fennel, Chalk
- Modern Hadoop & Big Data Ecosystem 2026 Deep Dive - Hadoop 3.4 · Spark 4 · Hive 4 · Kafka 4 · Flink 2 · Iceberg · Trino
- Hadoop Ecosystem & Data Engineering 2026 Deep Dive - Hadoop, Spark, Flink, Trino, Iceberg, Delta Lake, Hudi, Airflow, dbt
How to Read the 2026 Data Tooling Landscape — Layer-by-Layer Decisions, Not a Tool List
On July 28, 2026, "A Data Tooling Landscape Guide for Developers" landed on GeekNews and picked up 51 points. It is a good map, but a map does not choose your destination for you. This post redraws the same landscape acr
2026-07-31 · 16 min read #data-engineering#lakehouse#iceberg#duckdb#data-platformIceberg v3 Row Lineage: Row IDs Aren't Stored in the File
Apache Iceberg format v3 writes row lineage — a stable identifier for every row — into the spec, and it isn't optional: any v3 table has it on unconditionally. But that value isn't stored in the data file — it's computed
2026-07-16 · 18 min read #iceberg#lakehouse#table-format#data-engineering#sparkRevisiting Hadoop Architecture — HDFS, YARN, and Beyond ♪ Listenable
A diagram-driven walkthrough of Hadoop core internals — HDFS, YARN, and how MapReduce works. We look at how Hadoop role has shifted in the era of object storage, the cloud, and the lakehouse, and how we should understand
2026-06-27 · 30 min read #hadoop#hdfs#yarn#mapreduce#lakehouseModern Hadoop & Big Data Ecosystem 2026 Deep Dive - Hadoop 3.4 · Spark 4 · Hive 4 · Kafka 4 · Flink 2 · Iceberg · Trino ♪ Listenable
In 2026 Hadoop and the broader big-data ecosystem are not dead — they have been relocated. Hadoop 3.4 Erasure Coding and Ozone, Spark 4 ANSI mode and Spark Connect, Hive 4 Iceberg integration, Kafka 4 with KRaft GA and t
2026-05-16 · 26 min read #english#hadoop#spark#hive#kafkaModern Cloud Data Warehouses 2026 Deep Dive - Snowflake, Databricks SQL, BigQuery, Redshift, Firebolt, Azure Synapse, MotherDuck ♪ Listenable
A May 2026 survey of the modern cloud data warehouse landscape. Covers Snowflake, Databricks SQL, Google BigQuery, AWS Redshift Serverless, Azure Synapse, Firebolt, MotherDuck, DuckDB, ClickHouse Cloud, StarRocks, Apache
2026-05-16 · 28 min read #data-warehouse#snowflake#databricks#bigquery#redshiftHadoop Ecosystem & Data Engineering 2026 Deep Dive - Hadoop, Spark, Flink, Trino, Iceberg, Delta Lake, Hudi, Airflow, dbt ♪ Listenable
A complete look at the data engineering stack in May 2026. The truth behind the "Hadoop is dead" headline (HDFS is shrinking, but YARN and the lakehouse pattern survive), the conclusion of the Iceberg vs Delta Lake vs Hu
2026-05-16 · 25 min read #hadoop#spark#flink#trino#prestoFeature Stores 2026 Deep Dive — Feast, Tecton, Hopsworks, Databricks, Vertex AI, SageMaker, Featureform, Bytewax, Materialize, RisingWave, Fennel, Chalk ♪ Listenable
A no-marketing tour of the 2026 feature store landscape: Feast (CNCF sandbox), Tecton (with the Eppo merger), Hopsworks, Vertex AI Feature Store, SageMaker Feature Store, Databricks Feature Engineering in Unity Catalog,
2026-05-16 · 17 min read #feature-store#feast#tecton#hopsworks#databricksIs Hadoop Dead? — The Evolution of the Big Data Stack, From Hadoop to Lakehouse (Spark, Iceberg, Delta, and Where Things Actually Stand in 2026) ♪ Listenable
Is Hadoop dead? More precisely — it has been demoted from the default. The HDFS plus YARN plus MapReduce trio is no longer how anyone starts a new analytics platform. Spark replaced MapReduce, object storage replaced HDF
2026-05-14 · 21 min read #hadoop#big-data#spark#iceberg#delta-lakeData Engineering Complete Guide — Lakehouse, Streaming, dbt, Orchestration, Data Mesh (Season 2 Ep 8, 2025)
Data engineering is no longer "running ETL scripts." In 2025 a data engineer designs Lakehouse architectures (Iceberg, Delta, Hudi), combines Streaming (Flink, Kafka) with Batch (Spark), standardizes modeling with dbt, r
2026-04-15 · 10 min read #data-engineering#lakehouse#iceberg#delta-lake#hudiDatabricks AI Engineer (FDE) Complete Guide: Spark, Unity Catalog, RAG to Customer Deployment ♪ Listenable
A complete analysis of the Databricks AI Engineer (FDE) JD. From Spark/Delta Lake/Unity Catalog tech stack, Lakehouse architecture, RAG pipeline construction, to customer deployment skills — 25 interview questions and an
2026-03-23 · 34 min read #databricks#fde#spark#delta-lake#unity-catalog