Last week in Stream Processing & Analytics – 17.5.2017

This is the 66th edition of my blog series blog series around Stream Processing and Analytics!

As every week I was also updating the following two lists with the presentations/videos of the current week:

• Presentations from SlideShare
• Videos from YouTube

As usual, find below the new blog articles, presentations, videos and software releases from last week:

News and Blog Posts

General

• Fast Cars, Big Data – How Streaming Data Can Help Formula 1 by Carol McDonald
• Thoughts on Building a Successful Streaming Analytics Platform by George Vetticaden
• A Digital Reference Architecture for the Industrial Internet Of Things (IIoT) by Vamsi Chemitiganti
• Introducing DevHigh5 Project Pravega: Storage reimagined for a streaming world by Salvatore DeSimone

Apache Kafka / Kafka Streams / Confluent Platform

• Kafka Summit New York: The Rise of the Streaming Platform by Clarke Patterson
• Reading data securely from Apache Kafka to Apache Spark by Mark Grover
• Installing and Running Kafka on an AWS Instance by Sahil Sawhney
• Managing Spark and Kafka Pipelines by Larry Murdock
• Getting Started with the Kafka Streams API using Confluent Docker Images by Michael Noll
• Kafka Consumer Architecture – Consumer Groups and subscriptions by Cloudurable
• The new version of Kafka Topics UI is now available! by Christina Daskalaki
• Startup Confluent makes Kafka cloud play to ease streaming deployment by Jack Vaughan
• Securing Apache Kafka with Kerberos by Colm O hEigeartaigh
• Apache Kafka – Introduction & Installation by Rudra Narayan Garnaik
• Visualizing the flow of data as it moves through a Kafka cluster by James Cheng

Spark Streaming

• How to Get Started with Spark Streaming and MapR Streams Using the Kafka API by Carol McDonald

Apache Beam

• Apache Beam publishes the first stable release by Davor Bonaci

Apache Flink

• Introducing Official Docker Images for Apache Flink by Patrick Lucas & Ismaël Mejía

StreamSets

• Visualizing and Analyzing Salesforce Data with Neo4j by Pat Patterson
• Calling External Libraries from the JavaScript Evaluator by Pat Patterson

Apache NiFi

• Apache NiFi and TLS Toolkit Ansible Roles to create a multi-node secure NiFi cluster by Roger Carhuatocto
• Apache Nifi Sensitive Value Encryption by Kya
• Record based processors in Apache NiFi 1.2 by Haimo Liu

New Presentations

• Intro to Apache Kafka by Jason Hubbard
• Stream processing using Kafka by Himani Arora & Prabhat Kashyap
• Rethinking Services With Stateful Streams by Ben Stopford
• Connect S3 with Kafka leveraging Akka Streams by Seiya Mizuno
• Stream Processing with MicroProfile and Apache Kafka by Matthias Wessendorf
• Real-time Data Pipelines with SAP and Apache Kafka by Carole Gunst
• Processing IoT Data with Apache Kafka by Confluent
• Functional streams with Kafka – A comparison between Akka-streams and FS2 by Luis Reis & Rui Batista
• Open Blueprint for Real-Time Analytics with In-Stream Processing (ISP) by Victoria Livschitz
• Dataservices – Processing Big Data The Microservice Way by Josef Adersberger

New Video

• Scalable Stream Processing: A Survey of Storm, Samza, Spark and Flink by Felix Gessert
• Improve your App UX with one model processing insights from batch and streams by Robert Kubis
• Apache Ignite: Real Time Processing of IoT Generated Streaming Data by Denis Magda
• Rethinking Microservices with Stateful Streams by Ben Stopford
• Fast Cars, Big Data – How Streaming Can Help Formula 1 by Tugdual Grall

New Releases

• Apache Beam 2.0.0

Upcoming Events

• 17.5.2017 (Mountain View, US) – Stream Processing with Apache Kafka & Apache Samza (Meetup)
• 18.5.2017 (online) – Conquering Data in Motion with a Modern Ingestion Platform (Cloudera Webinar)
• 22.5.2017 (Los Angeles, US) – Apache Kafka & the Riseof real-time (Meetup)
• 23.5.2017 (online) – Deploy and Scale a Real-Time Streaming Data Platform with Confluent on DC/OS (Mesosphere Webinar)
• 23.5.2017 (London, UK) – Stream Analytics with SQL on Apache Flink (Meetup)
• 24.5.2017 (online) – Simplifying Real-Time Architectures for IoT with Apache Kudu (Cloudera Webinar)
• 7.6.2017 (San Francisco, US) – Integrated Dataflow Processing with Spark and StreamSets (Meetup)
• 12.6.2017 (Columbia, US) – Latest developments in Apache NiFi and MiNiFi (Meetup)
• 22.6.2017 (Canberra, Australia) – Data-in-Motion: Recent advances in Apache projects for streaming data (Meetup)

Please let me know if that is of interest. Please tweet your projects, blog posts, and meetups to @gschmutz to get them listed in next week’s edition!