Last Week in Stream Data Integration & Stream Analytics – 29.3.2020

This is the 187th edition of my blog series blog series around Stream Data Integration and Stream Analytics!

As every week I was also updating the following two lists with the presentations/videos of the current week:

As usual, find below the new blog articles, presentations, videos and software releases from last week. Happy reading and stay safe!

News and Blog Posts

General

Stream Reasoning With Stardog by Bram Steenwinckel

Apache Kafka / Kafka Streams / Confluent Platform

Kafka on VMware vSphere with Kubernetes: Deploying the Confluent Operator by Justin Murray
Announcing ksqlDB 0.8.0 by Victoria Xia
Integration Testing for Change Data Capture with Testcontainers by Gunnar Morling
Confluent Platform Reference Architecture for Kubernetes by Viktor Gamov
Building Confluent Cloud – Here’s What We’ve Learned by Frank Greco
ksqlDB: The Missing Link Between Real-Time Data and Big Data Streaming by Guillermo Gavilán
How to Make Your Open Source Apache Kafka Connector Available on Confluent Hub by Neil Buesing
Kafka Acks Explained by Stanislav Kozlovski
Help, Kafka ate my data! by Grzegorz Kocur

Apache Flink

Advanced Flink Application Patterns Vol.2: Dynamic Updates of Application Logic by Alexander Fedulov
Migrating Flink’s CI Infrastructure from Travis CI to Azure Pipelines by Robert Metzger

StreamSets

COVID-19 Open Research Dataset Analysis on StreamSets DataOps Platform by Dash Desai

New Presentations

Let’s write a production-ready Kafka Streams app before the end of this talk! by Florian Hussonnois
Kafka Needs No Keeper by Colin McCabe
Concepts and Patterns for Streaming Services with Kafka by Perry Krol
IoT Architectures for a Digital Twin with Apache Kafka, IoT Platforms and Machine Learning by Kai Waehner
Introduction to the Processor API by Christoph Schubert

New Videos

Kafka Connect in Action: JDBC Sink by Robin Moffatt
Ask Confluent #17: The “What is Apache Kafka?” by Ask Confluent
ksqlDB and the Kafka Connect JDBC Sink by Robin Moffatt
IoT Architectures for a Digital Twin with Apache Kafka and Comparison to other IoT Platforms by Kai Waehner

New Podcasts

Explore, Expand, and Extract with 3X Thinking by Confluent Audio

New Releases

Please let me know if that is of interest. Please tweet your projects, blog posts, and presentations & videos to @gschmutz to get them listed in next week’s edition!

gschmutz 20:36 on March 18, 2020
Tags: kafka ( 248 ), kafka-streams ( 176 ), nifi ( 238 ), spark ( 153 ), spark-streaming ( 219 ), Stream Processing ( 241 )

Last Week in Stream Data Integration & Stream Analytics – 18.3.2020

This is the 186th edition of my blog series blog series around Stream Data Integration and Stream Analytics!

As every week I was also updating the following two lists with the presentations/videos of the current week:

As usual, find below the new blog articles, presentations, videos and software releases from last week. Happy reading!

News and Blog Posts

Apache Kafka / Kafka Streams / Confluent Platform

Learn Stream Processing With Kafka Streams by Abhishek Gupta
Sharpening your Stream Processing Skills with Kafka Tutorials by Rick Spurgeon
Streaming Wi-Fi trace data from Raspberry Pi to Apache Kafka with Confluent Cloud by Robin Moffatt
Scalable Microservice Demo K8s Istio Kafka by Kim Wuestkamp
Can Apache Kafka Replace a Database? – The 2020 Update by Kai Waehner
Protobuf as an encoding format for Apache Kafka by Francesco Nobilia
Why the property ‘auto.create.topics.enable’ is disabled in Confluent Cloud? by Ricardo Ferreira
15 Things Every Apache Kafka Engineer Should Know About Confluent Replicator by Tom Scott
Building a Cloud ETL Pipeline on Confluent Cloud by Yeva Byzek
Smart City With an Event Streaming Platform Like Apache Kafka by Kai Waehner
Reactive Messaging Examples for Quarkus by Niklas Heidloff

Apache Flink

How OpenSSL in Ververica Platform 2.1 improves your Flink performance by Nico Kruber
Apache Beam: How Beam Runs on Top of Flink by Maximilian Michels & Markos Sfikas

StreamSets

Fun with Spark and Kafka: Slot Car Performance Tracking by Antonin Bruneau

Spark

Data Quality Monitoring on Streaming Data Using Spark Streaming and Delta Lake by Abraham Pabbathi and Greg Wood

New Presentations

Pivoting event streaming, from PROJECTS to a PLATFORM by Lyndon Hedderly

New Videos

Streaming Cassandra into Kafka presented by Yelp! by Abrar Sheikh & Andrew Prudhomme
Kafka Needs No Keeper by Colin McCabe
Kafka Connect in Action : S3 Sink by Robin Moffatt

New Podcasts

Domain-Driven Design and Apache Kafka with Paul Rayner by Confluent Streaming Audio

New Releases

Please let me know if that is of interest. Please tweet your projects, blog posts, and presentations & videos to @gschmutz to get them listed in next week’s edition!

gschmutz 16:43 on March 7, 2020
Tags: kafka ( 248 ), kafka-streams ( 176 ), nifi ( 238 ), spark ( 153 ), spark-streaming ( 219 ), Stream Processing ( 241 )

Last Week in Stream Data Integration & Stream Analytics – 6.3.2020

This is the 185th edition of my blog series blog series around Stream Data Integration and Stream Analytics!

As every week I was also updating the following two lists with the presentations/videos of the current week:

As usual, find below the new blog articles, presentations, videos and software releases from last week. Happy reading!

News and Blog Posts

General

RabbitMQ vs. Kafka: Head-To-Head by Eran Stiller
How to Create a Digital Integration Hub to Run Real-Time Business Processes by Nikita Ivanov
Empowering Digital Twins with Streaming Analytics by Salvatore Salamone

Apache Kafka / Kafka Streams / Confluent Platform

Integrating Data-in-Motion with Data-at-Rest using Oracle SQL Access to Kafka Views by Bob Hanckel
Building an Adaptive, Multi-Tenant Stream Bus with Kafka and Golang by Xinyu Liu
Monolith to Event-Driven Microservices with Apache Kafka by Aleksander Nowak
Using graph algorithms to optimize Kafka operations, Part 2 by Ping-Min Lin
Processing Large Messages with Kafka Streams by Philipp Schirmer
Introducing Confluent Developer by Tim Berglund
Mock APIs vs. Real Backends – Getting the Best of Both Worlds by Alex Liu
Kafka Connect Elasticsearch Connector in Action by Danny Kay & Liz Bennett
Playing Chess with Confluent Schema Registry by Robert Yokota
Real-Time Data Streaming, Kafka,and Analytics Part 2: Going Beyond Pure Streaming by Thornton Craig, Dan Potter & Tim Berglund
Real-Time Data Streaming, Kafka and Analytics Part 3: Effective Planning for Data Streaming Improves Data Analytics by Thornton Craig, Dan Potter & Tim Berglund
Sorting my socks with deep learning — Part 1 by Simon Aubury
Kafka stream processing: sorting socks with ksqlDB — part 2 by Simon Aubury
Confluent Go Client with Docker by Ricardo Ferreira
Kafka Connect Secrets Management with ksqlDB by Simon Aubury
Add Schema Registry to Kafka in Your Local Docker Environment by billydharmawan

Apache Flink

A Journey to Beating Flink’s SQL Performance by Nico Kruber

Spark

Data Quality Monitoring on Streaming Data Using Spark Streaming and Delta Lake by Abraham Pabbathi & Greg Wood

New Presentations

Event Hub (i.e. Kafka) in Modern Data (Analytics) Architecture by Guido Schmutz
Apache Kafka and KSQL in Action : Let’s Build a Streaming Data Pipeline! by Robin Moffatt
Using Kafka to integrate DWH and Cloud Based big data systems by Mic Hussey
Apache Kafka at LinkedIn – How LinkedIn Customizes Kafka to Work at the Trillion Scale by Jon Lee & Wesley Wu
Patterns and anti patterns of streaming by Richard Noble & Francesco Nobilia

New Videos

Event Streaming and Apache Kafka in the Telecommunications Industry by Kai Waehner

New Podcasts

Towards Successful Apache Kafka Implementations ft. Jakub Korab by Confluent Streaming Audio
Distributed Systems Engineering with Apache Kafka ft. Gwen Shapira by Confluent Streaming Audio

New Releases

ksqlDB 0.7.1

Please let me know if that is of interest. Please tweet your projects, blog posts, and presentations & videos to @gschmutz to get them listed in next week’s edition!