September | 2021 | Enjoy IT - SOA, Java, Event-Driven Computing and Integration

This is the 232nd edition of my blog series blog series around Stream Data Integration and Stream Analytics! There has been some time since my last blog, so this one is once more rather large! Will try to get back to a weekly schedule ….

As usual, find below the new blog articles, presentations, videos and software releases from last week. Happy reading and stay safe!

News and Blog Posts

Kafka

What’s new in Kafka 3.0 by Apache Kafka
What’s New in Apache Kafka 3.0.0 by Konstantine Karantasis
Kafka for Neo4j Aura Is Available Now by David Allen
Kappa Architecture is Mainstream Replacing Lambda by Kai Waehner
Messaging Modernization with Confluent by Jeff Bean
Announcing ksqlDB 0.21.0 by Walker Carlson
Trigger AWS Lambda Functions Directly from an Apache Kafka Topicc by Jobin George & Joseph Morais
Completed Kafka Connectivity by Yannic Klem
Kafka Connect Fundamentals: What is Kafka Connect? by Tim Berglund

Flink

Real-Time Exactly-Once Ad Event Processing with Apache Flink, Kafka, and Pinot by Jacob Tsafatinos, Yuriy Bondaruk, Yupeng Fu, and James Kwon
Apache Flink 1.14.0 Release Announcement by Stephan Ewen & JOhannes Moser

StreamSets

Our StreamSets Data Integration Patterns by Instadeq Team

New Presentations

All at Sea with Streams – Using Kafka to Detect Patterns in the Behaviour of Ships by Robin Moffatt

New Videos

All at Sea with Streams – Using Kafka to Detect Patterns in the Behaviour of Ships by Robin Moffatt
Apache Kafka 3.0 – Improving KRaft and an Overview of New Features by Tim Berglund

New Podcasts

Apache Kafka 3.0 – Improving KRaft and an Overview of New Features by Confluent Streaming Audio (#177)
Designing a Cluster Rollout Management System for Apache Kafka ft. Twesha Modi by Confluent Streaming Audio (#178)
Intro to Kafka Connect: Core Components and Architecture ft. Robin Moffatt by Confluent Streaming Audio (#179)

New Releases

Please let me know if that is of interest. Please tweet your projects, blog posts, and presentations & videos to @gschmutz to get them listed in next week’s edition!

This is the 231st edition of my blog series blog series around Stream Data Integration and Stream Analytics! There has been some time since my last blog, so this one is once more rather large! Will try to get back to a weekly schedule ….

As usual, find below the new blog articles, presentations, videos and software releases from last week. Happy reading and stay safe!

News and Blog Posts

General

Introducing WebSockets — Building Real-time Apps by Jung Taejin
How to integrate legacy systems with event-driven architecture? by Mortaza Ghahremani
Event Driven Architecture (3) Operational Data Store using event streaming by Architech
Many Faces of Event-driven Architecture by Dunith Dhanushka
How to integrate legacy systems with event-driven architecture? by Mortaza Ghahremani
Understanding Protobuf Compatibility by Robert Yokota

Kafka

Monitor Apache Kafka messages using Elasticsearch/Logstash/Kibana stack by Shashank Srivastava
Netflix Builds a Reliable, Scalable Platform with Event Sourcing, MQTT and Alpakka-Kafka by Eran Stiller
Hydrating a Data Lake using Log-based Change Data Capture (CDC) with Debezium, Apicurio, and Kafka Connect on AWS by Gary A. Stafford
Make a mock “real-time” data stream with Python and Kafka by Maria Patterson
Apache Kafka in Cybersecurity for Situational Awareness in Real-Time by Kai Waehner
Driving New Integrations with Confluent and ksqlDB at ACERTUS by Jeffrey Jennings
From Pets to Cattle: Going Cloud Native with Apache Kafka by Jennifer Riggins
Optimizing Kafka Streams Apps on Kubernetes by Splitting Topologies by Victor Künstler
Apache Kafka in Cybersecurity for Digital Forensics by Kai Waehner
Going ZooKeeper-less With the Debezium Container Image for Apache Kafka by Gunnar Morling
Announcing Elastic Data Streams Support for Confluent’s Elasticsearch Sink Connector by Kundan Vyas
How ksqlDB Works: Internal Architecture and Advanced Features by Michael Drogalis
Run Self-Managed Kusto Kafka Connector Serverless in Azure Container Instances by Niels Berglund
Real-time Einstein Insights Using Kafka Streams by Rohit Deshpande
Event Sourcing Outgrows the Database by Ben Stopford
Kafka Monthly Digest – August 2021 by Mickael Maison
Confluent Unlocks the Full Power of Event Streams with Stream Governance by David Araujo
Getting Started with GraphQL and Apache Kafka by Gerard Klijs
Kafka Summit Americas 2021 Recap by Tim Berglund
Operating Apache Kafka with Cruise Control by Viktor Somogyi-Vass
Enabling Seamless Kafka Async Queuing with Consumer Proxy by Yang Yang, Zhifeng Chen, Qichao Chu, Haitao Zhang, & George Teo

Flink

Stateful Functions 3.1.0 Release Announcement by Seth Wiesman & Igal Shilman & Tzu-Li (Gordon) Tai
Implementing a Custom Source Connector for Table API and SQL – Part One by Ingo Buerk & Daisy Tsang
Implementing a custom source connector for Table API and SQL – Part Two by Ingo Buerk & Daisy Tsang

Pulsar

Building Scalable Streaming Applications with DataStax Astra Streaming by Jeff Davies

Redpanda

Schema Registry – The event is the API by Ben Pope

RabbitMQ

RabbitMQ In Event-Driven Communication Between Microservices by Darshana Wickramasinghe
Observability with RabbitMQ and microservices by Dmitrii Tarasov

AWS

Adopting an Event-Driven Architecture: A comparative look at AWS messaging solutions — SNS by Mario Bittencourt
Introducing Amazon MSK Connect – Stream Data to and from Your Apache Kafka Clusters Using Managed Connectors by Danilo Poccia

New Presentations

Cloud-Native 5G, MEC and OSS/BSS/OTT Telco with Apache Kafka and Kubernetes by Kai Waehner
Rethinking Financial Services with Data in Motion by Jeffrey Lam
Event sourcing – what could possibly go wrong? by Andrzej Ludwikowski

New Videos

Data Mess to Data Mesh | Kafka Summit Americas 2021 Keynote by Jay Kreps
Eberhard Wolff about Kafka Patterns and Anti-Patterns by Erik Wilde
Kafka – The New Database Monolith by Eberhard Wolf
Panel Discussion about Kafka, Edge, Networks and 5G in Oil & Gas and Mining Industry by Kai Wähner
Kafka in the Wild by Laura Schornack & Maureen Penzenik
Event-Driven applications: Apache Kafka and Python by Francesco Tisiot
Event-driven APIs & Schema governance for Apache Kafka by Hugo Guerrero
All at Sea with Streams – Using Kafka to Detect Patterns in the Behaviour of Ships by Robin Moffatt
Multi-Cluster Apache Kafka with Cluster Linking ft. Nikhil Bhatia by Confluent Streaming Audio (#174)
Using Apache Kafka and ksqlDB for Data Replication at Bolt by Confluent Streaming Audio (#173)

New Podcasts

Using Apache Kafka and ksqlDB for Data Replication at Bolt by Confluent Streaming Audio (#173)
Multi-Cluster Apache Kafka with Cluster Linking ft. Nikhil Bhatia by Confluent Streaming Audio (#174)
What Is Data Mesh, and How Does it Work? ft. Zhamak Dehghani by Confluent Streaming Audio (#175)
How to Build a Strong Developer Community with Global Engagement ft. Robin Moffatt and Ale Murray by Confluent Streaming Audio (#176)
Designing Data Intensive Applications with Martin Kleppmann by Coding over Cocktails

New Releases

Please let me know if that is of interest. Please tweet your projects, blog posts, and presentations & videos to @gschmutz to get them listed in next week’s edition!