Last Week in Stream Data Integration & Stream Analytics – 11.04.2022

This is the 241st edition of my blog series blog series around Stream Data Integration and Stream Analytics!

As usual, find below the new blog articles, presentations, videos and software releases from last week. Happy reading and stay safe!

News and Blog Posts

General

• Real-time data ingestion in Grab by Shuguang Xiang & Irfan Hanif & Feng Cheng
• The Evolution To Streaming Graph from Graph Databases by Rob Malnati
• Key Concepts to Help You Get Started With Streaming Graph by Allan Konar
• Can Streaming Graphs Clean Up the Data Pipeline Mess? by Alex Woodie

Comparision

• Why you want RabbitMQ not Kafka by Eric Fossas
• Kafka vs. Kinesis: A Deep Dive Comparison by Raji Narayanan

Kafka

• Why ZooKeeper Was Replaced with KRaft – The Log of All Logs by Guozhang Wang
• How Confluent Can Help Optimize and Modernize Your SIEM for Better Cybersecurity by Jeff Bean & Will LaForest
• Deploying Self-Managed Connectors on EKS Fargate by Braeden Quirante & Joseph Morais
• Why you should not query a database in your stream processors by Brice LEPORINI
• Introducing Stream Processing Use Case Recipes Powered by ksqlDB by Michael Drogalis & Sophia Jiang
• Build a real-time data analytics pipeline with Airbyte, Kafka, and Pinot by Dunith Dhanushka
• Migrating to a Multi-Cluster Managed Kafka with 0 Downtime by Natan Silnitsky
• Apache Kafka in the Healthcare Industry by Kai Waehner
• Testing your Apache Kafka Data with Confidence by James
• Legacy Modernization and Hybrid Multi-Cloud with Kafka in Healthcare by Kai Waehner
• Read-only Incremental Snapshots for MySQL by Kate Galieva
• Multi-Cluster Deployment Options for Apache Kafka: Pros and Cons by  Nikita Gorbachevski
• Building a Dependable Real-Time Betting App with Confluent Cloud and Ably by Ben Gamble
• Comparison: Apache Camel vs. Apache Kafka? by Kai Waehner
• Why we dropped event sourcing with Kafka Streams when given a second chance by Mateusz Jadczyk
• Beautify kcat consumer output by piping to jq by Francesco Tisiot
• Kafka Monthly Digest: March 2022 by Mickael Maison
• Migrating Data to Azure Synapse with Confluent’s Fully Managed Connector to Unlock Real-Time Advanced Analytics by Jacob Bogie & Dustin Vannoy
• Securing Kafka® Infrastructure at Uber by Prateek Agarwal, Ryan Turner & KK Sriramadhesikan
• The State of Data Streaming by Alexander Heckmann

Flink

• Apache Flink Kubernetes Operator 0.1.0 Release Announcement by Gyula Fora

Apache NiFi

• Apache NiFi: Avoid these common pitfalls by Maarten Smeets

StreamSets

• What is Streaming Analytics? Use Cases, Examples, and Architecture by Sean Anderson
• Python Pipeline: Here’s How to Build Your Python Package and install it in StreamSets by Wilson Shamim
• Streaming Kafka to Snowflake: A Strategic & Technical Walkthrough by Thomas Bennett
• When, Why, and How to Use Change Data Capture (CDC) by Raji Narayanan
• How Your Data Ingestion Framework Turns Strategy into Action by Sean Anderson

New Presentations

• Apache Flink Adoption at Shopify by Yaroslav Tkachenko
• Resilient Real-time Data Streaming across the Edge and Hybrid Cloud with Apache Kafka by Kai Waehner

New Videos

• Building a real-time streaming WebSockets server with TypeScript and Apache Kafka by Kris Jenkins
• Building Real-Time Data Governance at Scale with Apache Kafka ft. Tushar Thole by Confluent Streaming Audio (#205)
• Bridging Frontend and Backend with GraphQL and Apache Kafka ft. Gerard Klijs by Confluent Streaming Audio (#206) by Confluent Streaming Audio (#206)
• Let’s Talk Streaming Graph! by thatDot team
• Scaling an Apache Kafka Based Architecture at Therapie Clinic by Confluent Streaming Audio (#207)

New Podcasts

• Building Real-Time Data Governance at Scale with Apache Kafka ft. Tushar Thole by Confluent Streaming Audio (#205)
• A Bootiful Podcast: Event streaming guru Jan Svoboda on Apache Kafka Design Patterns by A Bootiful Podcast
• Bridging Frontend and Backend with GraphQL and Apache Kafka ft. Gerard Klijs by Confluent Streaming Audio (#206)
• JMS vs. Kafka: Technology Smackdown with Clement Escoffier and Kai Waehner by Coding over Cocktails
• Scaling an Apache Kafka Based Architecture at Therapie Clinic by Confluent Streaming Audio (#207)

New Releases

• Apache NiFi 1.16.0
• Debezium 1.9.0.Final Released

Please let me know if that is of interest. Please tweet your projects, blog posts, and presentations & videos to @gschmutz to get them listed in next week’s edition!