Please let me know if that is of interest. Please tweet your projects, blog posts, and meetups to @gschmutz to get them listed in next week’s edition!

gschmutz 08:57 on December 18, 2018
Tags: kafka ( 248 ), kafka-streams ( 176 ), nifi ( 238 ), spark ( 153 ), spark-streaming ( 219 ), Stream Processing ( 241 )

Last Week in Stream Processing & Analytics – 17.12.2018

This is the 136th edition of my blog series blog series around Stream Processing and Analytics!

As every week I was also updating the following two lists with the presentations/videos of the current week:

As usual, find below the new blog articles, presentations, videos and software releases from last week:

News and Blog Posts

Apache Kafka / Kafka Streams / Confluent Platform

Deep Dive into KSQL Deployment Options by Hojjat Jafarpour
Confluent Cloud: Security Overview and Recommendations by Gwen Shapira
One for the Road by Dan Taylor
Kafka Streams Interactive Queries by Abhishek Gupta
Streaming data from Oracle into Kafka (December 2018) by Robin Moffatt
Accessing Kafka on host machine from minikube pods by Abhishek Gupta
License Changes for Confluent Platform by Jay Kreps
A Quick Comment On Bryan Cantrill’s Blog On Licensing by Jay Kreps
Apache Kafka Security | Need and Components of Kafka by Rinu Gour
Southpaw – Streaming Left Joins with Change Data Capture by Morrigan Jones
Our real-time data processing – part 2 by Bartosz Łoś
Democratizing Analytics Within Kafka With 3 New Access Patterns by George Vetticaden
Docker Tips and Tricks with KSQL and Kafka by Robin Moffatt
HDP 3.1 Released! All The Kafka! by Tim Spann
New Features of Kafka 2.1 by Stéphane Maarek

Spark Streaming

Apache Spark and Developing Applications Using Spark Streaming by Radhakrishnan Ramakrishnan

StreamSets

Getting Started with Apache Pulsar and Data Collector by Pat Patterson

NiFi / HDF

What’s new in Hortonworks DataFlow 3.3 by Dinesh Chandrasekhar
Apache NiFi Processor for Apache MXNet SSD: Single Shot MultiBox Object Detector by Tim Spann

Presentations

ATM Fraud detection with Kafka and KSQL by Robin Moffatt
Polylog: A Log-Based Architecture for Distributed Systems by Morrigan Jones & Eric Weaver
IoT data streaming with Apache Kafka by Paolo Patierno
Cloud-Native Streaming Platform: Running Apache Kafka on PKS (Pivotal Container Service) by Viktor Gamov
What’s new in Apache Spark 2.4 by Xiao Li
Demystifying Data-Intensive Systems On Kubernetes by Alena Hall

Videos

The IoT data river: processing the flood with Apache Kafka Streams by Paolo Patierno
Demystifying Data-Intensive Systems On Kubernetes by Alena Hall

New Releases

Upcoming Events

18.12.2018 (online) – How-To Build Real-Time Dashboards (MemSQL Webinar)
19.12.2018 (online) – Hortonworks DataFlow (HDF) 3.3 – Taking Stream Processing to the Next Level (Hortonworks Webinar)
9.1.2019 (Munich, GE) – Apache Flink Meetup (Meetup)
10.1.2019 (Leeds, UK) – Running a cluster in the Cloud and ATM Fraud detection with Kafka and KSQL (Meetup)

Please let me know if that is of interest. Please tweet your projects, blog posts, and meetups to @gschmutz to get them listed in next week’s edition!

gschmutz 21:15 on December 9, 2018
Tags: kafka ( 248 ), kafka-streams ( 176 ), nifi ( 238 ), spark ( 153 ), spark-streaming ( 219 ), Stream Processing ( 241 )

Last Week in Stream Processing & Analytics – 9.12.2018

This is the 135th edition of my blog series blog series around Stream Processing and Analytics!

As every week I was also updating the following two lists with the presentations/videos of the current week:

As usual, find below the new blog articles, presentations, videos and software releases from last week:

News and Blog Posts

General

Real-Time Machine Learning With TensorFlow in Data Collector by Dash Desai
By 2025, nearly 30 percent of data generated will be real-time, IDC says by Stephanie Condon
With Real-Time Analytics, Alexa Will Soon Know You Better by Seeta Hariharan

Apache Kafka / Kafka Streams / Confluent Platform

Time at the Bar Chart by Dan
Kafka’s Beer Festival by Dan
How Pinterest runs Kafka at scale by Yu Yang
Queryable Kafka Topics with Kafka Streams by Robert Schmid
Kafka Go client: No Producer error during connection ? by Abhishek Gupta
An Honest Review of AWS Managed Apache Kafka: Amazon MSK by Stéphane Maarek
Big Data Spain Talk About KSQL, the Streaming SQL Engine for Apache Kafka by Kai Waehner
Kafka Connect CLI tricks by Robin Moffatt
Optimizing Read Access to Sharded MongoDB Collections utilizing Apache Kafka Connect by Hans-Peter Grahsl
Twitter’s Kafka adoption story by Philip Su
What happened in the Kafka community in November 2018? by Mickael Maison
Kafka Streams – Is it the right Stream Processing engine for you? by George Vetticaden
Kafka Streams and KSQL with Minimum Privileges by Gwen Shapira
Building Secure and Governed Microservices with Kafka Streams by George Vetticaden
Kafka Summit 2019 Call for Papers, Tracks and Office Hours by Tim Berglund

Apache Pulsar

Simplifying Zhaopin’s Event Center with Apache Pulsar by Penghui Li

Samza

Samza 1.0: Stream Processing at Massive Scale by Jagadish Venkatraman

Apache Flink

Stream processing with Apache Flink and Minio by Nitish Tiwari
5 “baby” steps to develop a Flink application by
Marta Paes and Markos Sfikas

StreamSets

Low-latency Inference Using Databricks ML in StreamSets by Dash Desai

Presentations

Apache Kafka as Event-Driven Open Source Streaming Platform by Kai Waehner
Build the future Scale in / scale out with Kafka-Streams and Kubernetes by Loic Divad
Large scale stream processing with Apache Flink by Nikolay Stoitsev
Intro to Kapacitor for Alerting and Anomaly Detection by Noah Crowley
KSQL: Open Source Streaming for Apache Kafka by Kim Berglund
Visualizing Streams by Francesco Tisiot
Embrace the Anarchy : Apache Kafka’s Role in Modern Data Architectures by Robin Moffatt
No More Silos: Integrating Databases and Apache Kafka by Robin Moffatt
Apache Kafka and KSQL in Action : Let’s Build a Streaming Data Pipeline! by Robin Moffatt
Serverless Stream Processing Pipeline Best Practices by Roy Ben-Alta & Eyal Levi
Stream Processing Live Traffic Data with Kafka Streams bx Tim Ysewyn & Tom Van den Bulck
Serverless Stream Processing Tips & Tricks by Rajeev Chakrabarti & Girish Sood
Bridge OLTP and Stream Processing with Amazon Kinesis, AWS Lambda, & MongoDB Atlas by Eliot Horowitz
Building Event Driven (Micro)services with Apache Kafka by Guido Schmutz
Introduction to Stream Processing by Guido Schmutz
Spark (Structured) Streaming vs. Kafka Streams by Guido Schmutz

Videos

Kafka Consumers and Streams Failover Explained ft. Matthias Sax by Ask Confluent
Rethinking stream processing with Kafka Streams and KSQL by Viktor Gamov by Viktor Gamov
Introduction to Kafka Streaming by Lindsey Dew & Omnia Ibrahim
Integrating Machine Learning, Reactive Microservices, and Akka with Kafka by Andrew Bonham
Fast Data apps with the Alpakka Kafka connector by Sean Glover
Hands On With Spark: Creating A Fast Data Pipeline With Structured Streaming And Spark Streaming by Gerard Maas
Processing Fast Data with Apache Spark: The Tale of Two Streaming APIs by Gerard Maas
Introduction to Confluent Operator for Kubernetes by Viktor Gamov
State of the Apache NiFi Ecosystem & Community by Aldrin Piri
Taking The Pain out of Deploying Streaming Applications by Craig Blitz & Gerard Maas
Streaming pipelines in a batch world: The journey from batch to stream by Jeffrey Sewell
Fast Data apps with the Alpakka Kafka connector by Sean Glover
Mastering the Microservices, Fast Data, & Hybrid Cloud Trifecta by Edward Hsu
Deeper insights from streaming data by Dean Wampler & Steven Astorino

New Releases

Upcoming Events

10.12.2018 (Frankfurt, GE) – ATM Fraud Detection with Apache Kafka and KSQL (Meetup)
13.12.2018 (Atlanta, US) – The present state of operational analytics and Apache Druid (Meetup)
13.12.2018 (online) – Real-Time Data Streaming in the Insurance Industry (Confluent / Attunity webinar)
18.12.2018 (online) – How-To Build Real-Time Dashboards (MemSQL Webinar)
9.1.2019 (Munich, GE) – Apache Flink Meetup (Meetup)

Please let me know if that is of interest. Please tweet your projects, blog posts, and meetups to @gschmutz to get them listed in next week’s edition!