Last Week in Stream Data Integration & Stream Analytics – 20.3.2021

This is the 219th edition of my blog series blog series around Stream Data Integration and Stream Analytics!

Once more there is a lot of content, as I was quite busy the past few weeks and so it is compilation of the almost 3 weeks!

As usual, find below the new blog articles, presentations, videos and software releases from last week. Happy reading and stay safe!

News and Blog Posts

General

• Capturing Every Change From Shopify’s Sharded Monolith by John Martin & Adam Bellemare
• How to develop a digital transformation strategy based on Event-Driven Architecture by Tom Fairbairn
• Streaming Annotated Monthly – March 2021 by Antón
• Process your iPhone’s sensor data with an IoT Spreadsheet and MQTT by Kristian Raue

Kafka

• Real-Time Locating System with Kafka by Igor De Souza
• Azkarra Streams 0.9.0 release by Florian Hussonnois
• Quick profiling of data in Apache Kafka using kafkacat and visidata by Robin Moffatt
• Kafka Monthly Digest – February 2021 by Mickael Maison
• OCI Dashboard with Smashing/Dashing and Kafka by Igor De Souza
• Simplifying Apache Kafka Multi-Cluster Management Using Control Center and Cluster Registry by Shailesh Panwar
• Connected vehicles & Self-driving cars with Kafka by Igor De Souza
• App Modernization and Hybrid Cloud Architectures with Apache Kafka by Kai Waehner
• How to Tune RocksDB for Your Kafka Streams Application by Bruno Cadonna & Dhruba Borthakur
• Energy switch and smart home with Kafka by Igor De Souza
• Visualizing Kafka by Timothy Stepro
• Apache Kafka and MQTT (Part 1 of 5) – Overview and Comparison by Kai Waehner
• Apache Kafka and MQTT (Part 2 of 5) – V2X and Connected Vehicles by Kai Waehner
• Kafka Connect JDBC Sink deep-dive: Working with Primary Keys by Robin Moffatt
• Kafka Connect – SQLSyntaxErrorException: BLOB/TEXT column … used in key specification without a key length by Robin Moffatt
• Using ksqlDB to process data ingested from ActiveMQ with Kafka Connect by Robin Moffatt
• Creating your managed Kafka shortlist by Olivier de Garrigues
• Under the Hood of Real-Time Analytics with Apache Kafka and Pinot by Chinmay Soman
• Integrating Azure and Confluent: Ingesting Data to Azure Cosmos DB through Apache Kafka by Alicia Moniz & Siva Mullapudi
• Securing the Infrastructure of Confluent with HashiCorp Vault by Tim Ellis
• Integrating Apache Kafka Clients with CNCF Jaeger at Funding Circle Using OpenTelemetry by Nacho Munoz & Samir Hafez
• Understanding Non-Key Joins With the Quarkus Extension for Kafka Streams by Anisha Mohanty
• Data Driven Development for Stream Processing – Part 1 of 4: Introduction + Foundational Concepts by Caito S
• Data Driven Development for Stream Processing – Part 2 of 4: Anti-Patterns and The “Metrics-Driven Metrics” Cycle by Caito S
• Learning with LiveStreams: Cloud-Native Apache Kafka and Serverless Stream Processing by Viktor Gamov
• Introducing Azkarra Streams V0.9 by Florian Hussonnois
• Contrasting Kafka with Akka by Emil Koutanov
• Apache Kafka MirrorMaker 2 (MM2) Part 1: Theory by Paul Brebner
• Apache Kafka MirrorMaker 2 (MM2) Part 2: Practice by Paul Berebner

Streamsets

• Load Data from S3 to Snowflake and Use TensorFlow Model by Dash Desai

Streamsets

• Building Riviera: A Declarative Real-Time Feature Engineering Framework by Allen Wang & Kunal Shah

New Presentations

• Can Apache Kafka Replace a Database? by Kai Waehner
• Pragmatic Guide to Apache Kafka®’s Exactly Once Semantics by Gwen Shapira
• Evolving from Messaging to Event Streaming by Perry Krol & Mic Hussey
• Kafka in the Service Mesh, Not just API’s in disguise! by Johnny Mirza

New Videos

• How to stream data from MySQL to Apache Kafka® by Viktor Gamov
• App Modernization and Hybrid Cloud Architectures with Apache Kafka by Kai Waehner
• Streaming Concepts & Introduction to Flink – [BONUS] Exactly Once Fault Tolerance Guarantees by Alexander Fedulov
• Kafka Connect JDBC sink deep-dive: Working with Primary Keys by Robin Moffatt

New Podcasts

• Gamified Fitness at Synthesis Software Technologies Using Apache Kafka and IoT by Confluent Streaming Audio (#146)
• The Human Side of Apache Kafka and Microservices ft. SPOUD by Confluent Streaming Audio (#147)
• Event-Driven Architecture – Common Mistakes and Valuable Lessons ft. Simon Aubury by Confluent Streaming Audio (#148)

New Releases

• Apache Flink 1.12.2
• Debezium 1.5.0.Beta2

Please let me know if that is of interest. Please tweet your projects, blog posts, and presentations & videos to @gschmutz to get them listed in next week’s edition!

Last Week in Stream Data Integration & Stream Analytics – 2.3.2021

This is the 218th edition of my blog series blog series around Stream Data Integration and Stream Analytics!

As usual, find below the new blog articles, presentations, videos and software releases from last week. Happy reading and stay safe!

News and Blog Posts

General

• Saga Orchestration for Microservices Using the Outbox Pattern by Gunnar Morling

Kafka

• From Oracle to Google Big Query by Kafka by Gleb
• Apache Kafka and SAP Integration with the Kafka Connect ODP Source Connector by Kai Waeher & Ronald Schertle
• How to Manage Secrets for Confluent Platform with Kubernetes and HashiCorp Vault by Amit Gupta
• Containerized Testing with Kerberos and SSH by Daniel Osvath
• Loading delimited data into Kafka – quick & dirty (but effective) by Robin Moffatt
• Apache Kafka for the Connected World – Vehicles, Factories, Cities, Digital Services by Kai Waehner
• Kafka at the edge with Raspberry PI by Igor De Souza
• To Pull or to Push Your Data with Kafka Connect? That Is the Question by Vitalii Rudenskyi

Streamsets

• How To Load Data Into Google BigQuery on Dataproc and AutoML by Dash Desai
• Optimizing Re-use for Data Quality to Scale Data Pipelines by James Parham

New Presentations

• Apache Kafka for Automotive Industry, Mobility Services & Smart City by Kai Waehner
• Schemas, streams, and grocery stores by Alexei Zenin
• Evolving from Messaging to Event Streaming by Perry Krol & Mic Hussey
• Journey to Event Driven Architecture by Suraj Pillai

New Videos

• Serverless Kotlin and Apache Kafka® with Google Cloud by Viktor Gamov & James Ward

New Releases

• Debezium 1.5.0.Beta1

Please let me know if that is of interest. Please tweet your projects, blog posts, and presentations & videos to @gschmutz to get them listed in next week’s edition!