Last Week in Stream Processing & Analytics – 13.3.2018

This is the 106th edition of my blog series blog series around Stream Processing and Analytics!

As every week I was also updating the following two lists with the presentations/videos of the current week:

• Presentations from SlideShare
• Videos from YouTube

As usual, find below the new blog articles, presentations, videos and software releases from last week:

News and Blog Posts

General

• Stream-Relational Processing Platforms by Robert Yokota

Apache Kafka / Kafka Streams / Confluent Platform

• Introduction to Apache Kafka Security by Stéphane Maarek
• Creating DDD aggregates with Debezium and Kafka Streams by Hans-Peter Grahsl, Gunnar Morling
• Using Apache Kafka for Real-Time Event Processing at New Relic by Amy Boyle
• KSQL February Release: Streaming SQL for Apache Kafka by Neil Avery
• KSQL: Topic … does not conform to the requirements by Robin Moffatt
• Streaming data from Kafka into Elasticsearch by Robin Moffatt
• Installing the Python Kafka library from Confluent – troubleshooting some silly errors… by Robin Moffatt
• Why Do We Need Streaming ETL? by Robin Moffatt
• Unit Testing Kafka Streams by Jesse Anderson
• Getting started with the Kafka Connect Cassandra Source by Mike B
• MongoDB and Data Streaming: Implementing a MongoDB Kafka Consumer by Andrew Morgan

Spark Streaming

• Introducing Stream-Stream Joins in Apache Spark 2.3 by Tathagata Das and Joseph Torres

Apache Pulsar

• Introducing Pulsar Functions by Jerry Peng, Sanjeev Kulkarni, Sijie Guo

StreamSets

• Creating Data Pipelines for IoT with StreamSets by Ian Downard
• StreamSets Balances Streaming Data Demands for Security, Access by Alex Woodie

Apache NiFi / HDF

• Ingesting Flight Data ADS-B USB Receiver With Apache NiFi 1.5+ by Tim Spann

Presentations

• Rethinking Stream Processing with Apache Kafka, Kafka Streams and KSQL by Kai Waehner
• Integrating Apache Kafka and Elastic Using the Connect Framework by Confluent
• Streaming ETL to Elastic with Apache Kafka and KSQL by Nick Dearden
• Why and how to leverage the power and simplicity of SQL on Apache Flink by Fabian Hueske
• Introducing Spark Structured Streaming by Jose Carlos Garcia Serrano
• Kafka’s principles and protocols by Minh Nguyen
• Building event-driven (Micro)Services with Apache Kafka by Guido Schmutz

Videos

• Introduction to Apache Kafka as Event-Driven Open Source Streaming Platform by Kai Waehner
• Apache Pulsar -Distributed Pub/Sub as scale by Joe Francis
• Apache Pulsar – fast, durable, flexible pub/sub messaging by Matteo Merli
• Building event-driven (Micro)Services with Apache Kafka by Guido Schmutz
• Kafka Streams and Protobuf stream processing at trivago by Clemens Valiente
• Not less, Not more. Exactly Once Large-Scale Stream Processing in Action by Paris Carbone
• The Database Unbundled: Commit Logs in an Age of Microservices by Tim Berglund
• Streaming Architecture by Tugudal Grall
• SMACK 2.0: Emerging Data Pipelines Panel by IBM Code
• Intelligently Collecting Data at the Edge Intro to Apache NiFi and MiNiFi by Andy LoPresto

New Releases

• Debezium 0.7.4

Upcoming Events

• 14.3.2018 (Leeds, UK) – Kafka Meetup in Leeds (Meetup)
• 14.3.2018 (Kontich, BE) – Cloudera Training Tapas: Hands-on with StreamSets (Meetup)
• 15.3.2018 (online) – Empowering Streams through KSQL: Part 3: Deploying and Operating KSQL (Confluent Webinar)
• 17.4.2018 (Laurel, US) – Huge steps for Apache NiFi – Talks on NiFi in Finance and Powerful New Features  (Meetup)

Please let me know if that is of interest. Please tweet your projects, blog posts, and meetups to @gschmutz to get them listed in next week’s edition!