Last Week in Stream Data Integration & Stream Analytics – 31.7.2020

This is the 197th edition of my blog series blog series around Stream Data Integration and Stream Analytics!

As every week I was also updating the following two lists with the presentations/videos of the current week:

As usual, find below the new blog articles, presentations, videos and software releases from last week. Happy reading and stay safe!

News and Blog Posts

General

(De)coupling yourself by Dina Bogdan
What Does It Mean to be Event Driven? Open Your Mind and Unlock New Business Value! by Jamil Ahmed
Event-Driven Architecture as a Strategy by David Mooter

Apache Kafka / Kafka Streams / Confluent Platform

Improved Robustness and Usability of Exactly-Once Semantics in Apache Kafka by Boyang Chen & Bob Barrett
Continuous NLP Pipelines with Python, Java, and Apache Kafka by Victor Künstler
Data Enrichment in ksqlDB Using UDTFs by Marc-André Bouchard
Building a Real-Time Leaderboard with Kafka Connect and KSQL by Avinash Bhardwaj
Publish Vonage Events to Kafka with Spring Boot by Steve Crow
How PushOwl Uses ksqlDB to Scale Their Analytics and Reporting Use Cases by Abhishek Kumar
Exponential Increases in Value Flow from Greater Maturity in Event Streaming by Mark Sakurada
Infinite Storage & Retention for Apache Kafka in Confluent Cloud by Aditya Kulkarni
Analysing Changes with Debezium and Kafka Streams by Mike Fowler
Sizing Calculator for Apache Kafka and Confluent Platform by Confluent
Data dump to data catalog for Apache Kafka by Andrew Stevenson
I’ve Got the Key, I’ve Got the Secret. Here’s How Keys Work in ksqlDB 0.10. by Andy Coates
Kafka on Kubernetes, the Strimzi Way! (Part 1) by Abhishek Gupta
Kafka on Kubernetes, the Strimzi Way! (Part 2) by Abhishek Gupta

Spark

A look at the new Structured Streaming UI in Apache Spark™ 3.0 by Genmao Yu, Yuanjian Li & Shixiong Zhu

Flink

Sharing is caring – Catalogs in Flink SQL by Dawid Wysakowicz
Flink SQL Demo: Building an End-to-End Streaming Application by Jark Wu
Advanced Flink Application Patterns Vol.3: Custom Window Processing by Alexander Fedulov

New Presentations

Kafka and Big Data Streaming Use Cases in the Gaming Industry by Kai Waehner
Follow the (Kafka) Streams by Mario Molina
Streaming Apps and Poison Pills: handle the unexpected with Kafka Streams by Loic Divad

New Videos

Kafka and Big Data Streaming Use Cases in the Gaming Industry by Kai Waehner
End to End Integration from IoT Edge to Serverless Apache Kafka in Confluent Cloud by Kai Waehner
Livestreams: Kafka Streams, Spring Boot, and Confluent Cloud by Viktor Gamov

New Podcasts

How to Measure the Business Value of Confluent Cloud ft. Lyndon Hedderly by Confluent Streaming Audio

New Releases

Please let me know if that is of interest. Please tweet your projects, blog posts, and presentations & videos to @gschmutz to get them listed in next week’s edition!

gschmutz 19:20 on July 22, 2020
Tags: kafka ( 248 ), kafka-streams ( 176 ), nifi ( 238 ), spark ( 153 ), spark-streaming ( 219 ), Stream Processing ( 241 )

Last Week in Stream Data Integration & Stream Analytics – 22.7.2020

This is the 196th edition of my blog series blog series around Stream Data Integration and Stream Analytics!

As every week I was also updating the following two lists with the presentations/videos of the current week:

As usual, find below the new blog articles, presentations, videos and software releases from last week. Happy reading and stay safe!

News and Blog Posts

Apache Kafka / Kafka Streams / Confluent Platform

Measuring and Monitoring a Stream Processing Cloud Service: Inside Confluent Cloud ksqlDB by Victoria Xia
Getting Started With Kafka on OpenShift by Neeharika Kompala
Apache Kafka Native MQTT at Scale with Confluent Cloud and Waterstream by Kai Waehner & Paul Lysak
Track Transportation Assets in Real Time with Apache Kafka and Kafka Streams by Ram Dhakne
Top 5 Reasons to Attend Kafka Summit Virtually by Tim Berglund
Apache Kafka and Blockchain – Comparison and a Kafka-native Implementation by Kai Waehner
Migrate and modernize your on-prem data lake with managed Kafka by Jorge Geronimo
Data Privacy, Security, and Compliance for Apache Kafka by David Millman
Apache Kafka as a Service with Confluent Cloud Now Available on AWS Marketplace by Ricardo Ferreira

Flink

Creating Datadog Dashboards with Apache Flink by Steve Whelan
Application Deployment in Flink: Current State and the new Application Mode by Kostas Kloudas

New Presentations

Apache Kafka in Gaming Industry (Games, Mobile, Betting, Gambling, Bookmaker, Video Streaming) by Kai Waehner
Apache Kafka and Blockchain – Comparison and a Kafka-native Implementation by Kai Waehner & Stephen Reed
KSQL: Streaming SQL for Apache Kafka by Kenneth Cheung

New Videos

Building Event Streaming Applications with Serverless Kafka by Gnanaguru Sattanathan
Connecting Data to and from Kafka by Daniel Hinojosa
From ksqlDB with Love: Detecting 007’s presence with a dash of machine learning by Hans-Peter Grahsl
Kafkathon 2020, Kafka Summit, Spring Boot, and Confluent Cloud by Viktor Gamov

New Podcasts

Event streaming architectures enabling IoT applications beyond messaging – Kai Waehner, Enterprise Architect, Confluent by IoT One
Fault Tolerance and High Availability in Kafka Streams and ksqlDB ft. Matthias J. Sax by Confluent Streaming Radio
Modernizing Inventory Management Technology ft. Sina Sojoodi and Rohit Kelapure by Confluent Streaming Radio
Modernizing Inventory Management Technology ft. Sina Sojoodi and Rohit Kelapure by Confluent Streaming Radio

New Releases

Please let me know if that is of interest. Please tweet your projects, blog posts, and presentations & videos to @gschmutz to get them listed in next week’s edition!

gschmutz 18:56 on July 12, 2020
Tags: kafka ( 248 ), kafka-streams ( 176 ), nifi ( 238 ), spark ( 153 ), spark-streaming ( 219 ), Stream Processing ( 241 )

Last Week in Stream Data Integration & Stream Analytics – 12.7.2020

Black Lives Matter (@Blklivesmatter) | Twitter

This is the 195th edition of my blog series blog series around Stream Data Integration and Stream Analytics!

As every week I was also updating the following two lists with the presentations/videos of the current week:

As usual, find below the new blog articles, presentations, videos and software releases from last week. Happy reading and stay safe!

News and Blog Posts

General

Commands and Events in a Distributed System by Dave Taubler
Stop overselling Event Sourcing as the silver bullet to microservice architectures by Oskar uit de Bos
Overselling Event Sourcing by Alexey Zimarev

Comparision

Comparing Apache Kafka and Apache Pulsar by Jaroslaw Kijanowski
Pulsar vs. Kafka — Part 1 — A More Accurate Perspective on Performance, Architecture, and Features by Carolyn King & Addison Higham & Sijie Guo

Apache Kafka / Kafka Streams / Confluent Platform

Kafka, for your data pipeline? Why not? by Abhishek Gupta
Break down Kafka by Nine Graphs by Patrick Gopher
Kafka on Kubernetes, the Strimzi way! (Part 3) by Abhishek Gupta
Putting Several Event Types in the Same Topic – Revisited by Robert Yokota
Reducing the Total Cost of Operations for Self-Managed Apache Kafka by Nick Bryan
Spring for Apache Kafka – Beyond the Basics: Can Your Kafka Consumers Handle a Poison Pill? by Tim van Baarsen
Project Metamorphosis Month 3: Infinite Storage in Confluent Cloud for Apache Kafka by Jun Rao
Announcing the Elasticsearch Service Sink Connector for Apache Kafka in Confluent Cloud by Nathan Nam
Schema evolution is not that complex by Francesco Nobilia
Set up a Change Data Capture architecture on Azure using Debezium, Postgres and Kafka by Abhishek Gupta
Kafka Monthly Digest – June 2020 by Mickael Maison
Data Sharing between Java & Go using Kafka and Protobuf by Ricardo Ferreira

Flink

Running Streaming ETL Pipelines with Apache Flink on Zeppelin Notebooks by Jeff Zhang

New Presentations

The Changing Face of ETL: Event-Driven Architectures for Data Engineers by Robin Moffatt
Apache Kafka and ksqlDB in Action: Let’s Build a Streaming Data Pipeline! by Robin Moffatt
Exactly Once Delivery with Kafka by Natan Silnitsky

New Videos

Tips and Tricks for Apache Kafka Ops by Jen Snipes & Kat Grigg
Building your First Connector for Kafka Connect by Ricardo Ferreira

New Podcasts

Open Source Workflow Automation with Apache Kafka ft. Bernd Ruecker by Confluent Streaming Audio
Benchmarking Apache Kafka Latency at the 99th Percentile ft. Anna Povzner by Confluent Streaming Audio

New Releases

Please let me know if that is of interest. Please tweet your projects, blog posts, and presentations & videos to @gschmutz to get them listed in next week’s edition!