Tag: #flink

← All posts

• Stream Processing 2026 Deep Dive - Kafka Streams, Flink SQL, RisingWave, Materialize, Arroyo, ksqlDB, Bytewax, Decodable ♪ Listenable

  The 2026 stream processing landscape. Flink 2.0 broke the library-vs-DB boundary with Disaggregated State and Materialized Tables; Kafka Streams 4.0 absorbed queue semantics via Share Groups; RisingWave 2.x and Materiali

  2026-05-16 · 25 min read #stream-processing#kafka-streams#flink#risingwave#materialize

• Modern Hadoop & Big Data Ecosystem 2026 Deep Dive - Hadoop 3.4 · Spark 4 · Hive 4 · Kafka 4 · Flink 2 · Iceberg · Trino ♪ Listenable

  In 2026 Hadoop and the broader big-data ecosystem are not dead — they have been relocated. Hadoop 3.4 Erasure Coding and Ozone, Spark 4 ANSI mode and Spark Connect, Hive 4 Iceberg integration, Kafka 4 with KRaft GA and t

  2026-05-16 · 26 min read #english#hadoop#spark#hive#kafka

• Hadoop Ecosystem & Data Engineering 2026 Deep Dive - Hadoop, Spark, Flink, Trino, Iceberg, Delta Lake, Hudi, Airflow, dbt ♪ Listenable

  A complete look at the data engineering stack in May 2026. The truth behind the "Hadoop is dead" headline (HDFS is shrinking, but YARN and the lakehouse pattern survive), the conclusion of the Iceberg vs Delta Lake vs Hu

  2026-05-16 · 25 min read #hadoop#spark#flink#trino#presto

• Data Lakehouse & Modern Data Engineering 2026 — Iceberg / Delta / Hudi / Paimon / Tabular (Databricks acquisition) / Trino / Spark 4 / Flink 2 / DataFusion Deep Dive ♪ Listenable

  Data engineering in 2026 is no longer the era of "data warehouse vs data lake." Apache Iceberg emerged as the winner of the 2024-25 table format war — Netflix, Apple, LinkedIn, Stripe, Airbnb all converged on it. Databri

  2026-05-16 · 30 min read #data-engineering#data-lakehouse#apache-iceberg#delta-lake#apache-hudi

• Feature Stores 2026 Deep Dive — Feast, Tecton, Hopsworks, Databricks, Vertex AI, SageMaker, Featureform, Bytewax, Materialize, RisingWave, Fennel, Chalk ♪ Listenable

  A no-marketing tour of the 2026 feature store landscape: Feast (CNCF sandbox), Tecton (with the Eppo merger), Hopsworks, Vertex AI Feature Store, SageMaker Feature Store, Databricks Feature Engineering in Unity Catalog,

  2026-05-16 · 17 min read #feature-store#feast#tecton#hopsworks#databricks

• Streaming vs Batch Redefined: Flink, RisingWave, Materialize, CDC, Streaming SQL and the Pragmatism of Real Time (2025)

  Season 5 Ep 2. "Everything in real time" was the promise of 2020. 2025 is the era of pragmatism — the line between batch and streaming has blurred, and the real question has become "how fresh does this data have to be to

  2026-04-15 · 13 min read #streaming#batch#flink#risingwave#materialize

• Kafka and Event-Driven Architecture Deep Dive — Partition/ISR, Exactly-Once, Outbox, Schema Registry, Flink

  Many use Kafka; few understand its internals. Partitions and Leader/ISR, Log Segment physical layout, Exactly-Once Semantics truth, Transactional Outbox, Event Sourcing vs CDC, Schema Registry, and 100ms SLA techniques.

  2026-04-15 · 9 min read #kafka#event-driven#streaming#exactly-once#schema-registry

• Data Engineering Complete Guide — Lakehouse, Streaming, dbt, Orchestration, Data Mesh (Season 2 Ep 8, 2025)

  Data engineering is no longer "running ETL scripts." In 2025 a data engineer designs Lakehouse architectures (Iceberg, Delta, Hudi), combines Streaming (Flink, Kafka) with Batch (Spark), standardizes modeling with dbt, r

  2026-04-15 · 10 min read #data-engineering#lakehouse#iceberg#delta-lake#hudi

• Event Streaming Deep Dive Guide 2025: Kafka Internals, Flink, Exactly-Once, Schema Evolution ♪ Listenable

  Event Streaming Deep Dive! Kafka Internals (Partitions/Segments/ISR/Controller), Consumer Groups (Rebalancing/Offset Management), Exactly-Once (Transactions/Idempotency), Schema Registry (Avro/Protobuf Evolution), Apache

  2026-04-14 · 21 min read #event-streaming#kafka#flink#exactly-once#schema-registry

• Toss Bank Data Engineer (Kafka & Streaming) Study Guide: Tech Stack, Interview Prep, and 6-Month Roadmap ♪ Listenable

  Complete analysis of Toss Bank Real-Time Data team JD. Master Kafka Broker operations, Spring Boot Kafka Client, Active-Active replication, CDC with Debezium, Flink stream processing, and ClickHouse analytics — with a 6-

  2026-03-21 · 29 min read #kafka#data-engineering#tossbank#streaming#flink

• Building Real-time Financial Data Pipelines: A Practical Guide to Kafka and Flink Streaming Architecture

  A comprehensive guide to designing and implementing real-time financial data pipelines. Covers Kafka-based market data ingestion, Flink stream processing, CDC integration, windowed aggregation, anomaly detection, and low

  2026-03-13 · 14 min read #finance#kafka#flink#streaming#data-pipeline