Last Week in Stream Data Integration & Stream Analytics – 18.5.2022

This is the 245th edition of my blog series blog series around Stream Data Integration and Stream Analytics!

As usual, find below the new blog articles, presentations, videos and software releases from last week. Happy reading and stay safe!

News and Blog Posts

General

• Need for Speed: Evaluating Real-time Analytics Systems by Gang Tao
• Powering real-time data analytics with Druid at Twitter by Ruchin Kabra & Chunxu Tang

Kafka

• How Walmart Uses Apache Kafka for Real-Time Replenishment at Scale by Suman Pattnaik
• Confluent at a Fully Disconnected Edge by Joseph Morais & Braeden Quirante
• Cloud-native Core Banking Modernization with Apache Kafka by Kai Waehner
• Kafka Streaming: Live Streaming Kafka Application to Cassandra by Isaac Omolayo
• What’s New in Apache Kafka 3.2.0 by Bruno Cadonna
• Stream Processing vs. Batch Processing: What to Know by Jean-Sébastien Brunner

Flink

• Getting into Low-Latency Gears with Apache Flink – Part One by Jun Qin & Nico Kruber

Apache NiFi

• Apache NiFi: Importing and exporting parameters by Maarten Smeets

StreamSets

• Redis Pipeline: How to Publish and Subscribe Data from Redis to Your Destination by Wilson Shamim

New Videos

• Apache Kafka 3.2 – New Features & Improvements by Danica Fine

New Podcasts

• Scaling Apache Kafka Clusters on Confluent Cloud ft. Ajit Yagaty and Aashish Kohli by Confluent Streaming Audio (#214)
• Data Journey with Victoria Bukta (Shopify) – Apache Iceberg and Data Ingestion

New Releases

• Apache Flink Table Store 0.1.0
• Apache Kafka 3.2.0

Please let me know if that is of interest. Please tweet your projects, blog posts, and presentations & videos to @gschmutz to get them listed in next week’s edition!

Last Week in Stream Data Integration & Stream Analytics – 9.5.2022

This is the 244th edition of my blog series blog series around Stream Data Integration and Stream Analytics!

As usual, find below the new blog articles, presentations, videos and software releases from last week. Happy reading and stay safe!

News and Blog Posts

General

• On Data Lakes and Stream Ingestion by Vojtech Tuma
• Unbundling the Modern Streaming Stack by Dunith Dhanushka

Kafka

• Zero Copy. One Of Reason Behind Why Kafka So Fast by ANKIT
• Accelerate Cloud Database Modernizations and Migrations with Confluent by Peter Kennedy
• Process Formula 1 telemetry with Quarkus and OpenShift Streams for Apache Kafka by Paolo Patierno
• Accelerate Cloud Database Modernizations and Migrations with Confluent by Peter Kennedy
• Designing and testing a highly available Kafka cluster on Kubernetes by Douglas Hellinger
• Announcing ksqlDB 0.25.1 by Tolga Dur
• Fine-tune Kafka performance with the Kafka optimization theorem by Bilgin Ibryam
• From the Cellar to the Cloud – How Aedifion is Driving Next-Generation Building Automation with Confluent by Dr. Jan Henrik Ziegeldorf
• Transactions vs. Analytics in Apache Kafka by Kai Waehner
• How To Deploy Apache Kafka With Kubernetes by Alvin Lee
• Kafka Monthly Digest: April 2022 by Mickael Maison
• How to Remove Apache Kafka Brokers the Easy Way by Stanislav Kozlovski
• Spinning Your Drones With Cadence and Apache Kafka® – Architecture, Order and Delivery Workflows by Paul Brebner
• Why Apache Kafka is dropping ZooKeeper for KRaft by Paul Krill
• My top 5 tools to manage/develop with Apache Kafka by Rafael Zimmermann
• Learn Apache Kafka with Python and docker by Rafael Zimmermann
• Kafka Consumer Group Rebalance (1 of 2) by Rob Golder
• Kafka Consumer Group Rebalance (2 of 2) by Rob Golder

Spark

• Speed Up Streaming Queries With Asynchronous State Checkpointing by Craig Ng
• Streaming Windows Event Logs into the Cybersecurity Lakehouse by Derek King 

Flink

• Announcing the Release of Apache Flink 1.15 by Joe Moser & Yun Gao

Apache NiFi

• Apache NiFi: Having fun with Jolt transformations by Maarten Smeets

StreamSets

• The Role of ETL in Data Integration by Sean Anderson

New Presentations

• Keep Your Cache Always Fresh With Debezium by Gunnar Morling

New Videos

• Build a Data Streaming App for Sound & Vision | Coding in Motion | Coding Workshop by Kris Jenkins

New Podcasts

• Optimizing Apache Kafka’s Internals with Its Co-Creator Jun Rao by Confluent Streaming Audio (#211)
• Build a Data Streaming App with Apache Kafka and JS – Coding in Motion by Confluent Streaming Audio (#212)
• Streaming Analytics on 50M Events Per Day with Confluent Cloud at Picnic by Confluent Streaming Audio (#213)

New Releases

• Apache NiFi 1.16.1
• ksqlDB 0.25.1
• Flink 1.15
• Debezium 2.0.0.Alpha1 Released

Please let me know if that is of interest. Please tweet your projects, blog posts, and presentations & videos to @gschmutz to get them listed in next week’s edition!