Last Week in Stream Processing & Analytics – 24.7.2017

This is the 74th edition of my blog series blog series around Stream Processing and Analytics!

As every week I was also updating the following two lists with the presentations/videos of the current week:

• Presentations from SlideShare
• Videos from YouTube

As usual, find below the new blog articles, presentations, videos and software releases from last week:

News and Blog Posts

General

• Converged Architecture for Real-time Anomaly Detection for IoT Sensor Data by Mathieu Dumoulin
• Adopting Stream Processing for Instrumentation by Sean Cribbs
• The IoT Data Platform: Architectural Approaches by Mark Herring
• A lot of fun with … AMQP, Spark, Kafka, EnMasse, MQTT, Vert.x & IoT by Paolo Patierno
• Evaluating persistent, replicated message queues by Adam Warski
• The Big Data technologies that saved BP $7bn by Andrew Carr

Apache Kafka / Kafka Streams / Confluent Platform

• Upgrading Apache Kafka Clients Just Got Easier by Colin McCabe
• Using Apache Kafka as a Scalable, Event Driven Backbone for Service Architectures by Ben Stopford
• Real-time Financial Alerts at Rabobank with Apache Kafka’s Streams API by Jeroen van Disseldorp
• How to Use the Kafka Streams API by Anuj Saxena

Apache Flink

• Flink Forward Berlin Preview: Flink Use Cases and Applications by Michael Winters
• Apache Flink: The Next Distributed Data Processing Revolution? by Datafloq
• Dynamically Configured Stream Processing: How BetterCloud Built an Alerting System with Apache Flink by David Hardwick, Sean Hester, Jason Brelloch & David Brelloch

Apache NiFi / Hortonworks HDF

• Change Data Capture (CDC) with Apache NiFi (Part 1 of 3) by Andrew Lim
• Change Data Capture (CDC) with Apache NiFi (Part 2 of 3) by Andrew Lim
• Change Data Capture (CDC) with Apache NiFi (Part 3 of 3) by Andrew Lim

New Presentations

• When Streams Fail – Kafka Off the Shore, What If? by Goldman Sachs
• Online change point detection using spark streaming by Michal Monselise
• Batch and Streaming Processing in the World of Data Engineering and Data Science by Keira Zhou
• Introduction to AWS Big Data by Omid Vahdaty
• Performance Metrics for Big Data Systems: Streaming Data Analytics  by Shikha Mehta
• Analyzing Real-time Streaming Data with Amazon Kinesis by Roy Ben-Alta & Daniel Modlinger
• Big data processing with Apache Beam by Sourabh Bajaj 
• How to build Next Generation Analytics Applications using Hortonworks DataFlow by Sebastian Carroll

New Videos

• Building Microservice Architectures by Sam Newman & Mark Stopford
• Apache Spark Pipeline for Game Data Processing by Nick Afshartous 
• Real Time stream analytics, easy to use by SQLStream

New Books

• Understanding Message Brokers by Jakub Korab

New Podcasts

• What’s Next for Apache Beam? by Frances Perry

Upcoming Events

• 25.7.2017 (Arlington, US) – Streaming Analytics Applications (Meetup)
• 27.7.2017 (online) – Introduction to (Micro)Service Meshes (O’Reilly Webinar)
• 27.7.2017 (Palo Alto, US) – Exactly Once Semantics in Kafka & Confluent: Speaks Kafka (Meetup)
• 27.7.2017 (London, UK) – Real Life (Structured) Streaming & Customer Lifetime Value (Meetup)
• 3.8.2017 (online) – How Yelp Leapt to Microservices with More than a Message Queue (Confluent Webinar)
• 9.8.2017 (Bellevue, US) – Spark Structured Streaming : Introduction and Internals (Meetup)
• 9.8.2017 (Sydney, AU) – Data-in-Motion: Recent advances in Apache projects for streaming data (Meetup)
• 10.8.2017 (online) – Why VR Needed Stream Processing to Survive (Confluent Webinar)
• 15.8.2017 (Milwaukee, US) – Sensors, Spark and Kafka: Applied Machine Learning (Meetup)
• 16.8.2017 (online) – Pandora Plays Nicely Everywhere with Real-Time Data Pipelines (Confluent Webinar)
• 24.8.2017 (San Francisco, US) – Visualizing and Analyzing Salesforce Data with StreamSets and Neo4j (Meetup)
• 27.8.2017 (online) – Embrace Streaming Analytics and Transform Your Business (AWS Webinar)
• 16.9.2017 (McLean, US) – Spark Saturday DC (Meetup)

Please let me know if that is of interest. Please tweet your projects, blog posts, and meetups to @gschmutz to get them listed in next week’s edition!

Last week in Stream Processing & Analytics 8/22/2016

This is the 28th installment of my blog series around Stream Processing and Analytics.

As usual, find below the new blog articles, presentations, videos and software releases from last week:

News and Blog Posts

General

• IoT Facts and Figures by Gil Press
• A Tale of Two Industrial IoT Standards: DDS and OPC-UA by Angelo Corsaro
• Analytics for an Edge: Optimizing Operations in the Energy Sector by Michael O’Connell
• Realtime Fast Data Analytics with Druid by Florian Trossbach
• IoT Gains Traction for Supply Chain Uses by Sue Walsh
• Stream Processing Hard Problems Part II: Data Access by Kartik Paramasivam

Amazon Kinesis Analytics

• The SQL Service at the Heart of Amazon Kinesis Analytics by Alex Woodie

Apache Beam

• Apache Beam in action: same code, several execution engines by Jean-Baptiste Onofré

Apache Kafka / Kafka Streams

• Applying Kafka Streams for internal message delivery pipeline by Yuto Kawamura
• Monitoring Apache Kafka with Grafana / InfluxDB via JMX by Jarosław Kijanowski
• Data Ingestion with Kafka and Spark, Big Data Journey Part 2 by Gavin Lewis
• Loading data from Kafka into BigQuery with Kafka Connect by Chris Egerton
• Processing Tweets with Kafka Streams by Jendrik Poloczek

Apache Flink

• Robust Stream Processing with Apache Flink™: A Simple Walkthrough by Michael Winters
• DATA INGESTION PLATFORM(DIP) — REAL TIME DATA ANALYSIS — FLINK STREAMING by Xavient

Spark Streaming

• Enhanced Streaming and Machine Learning with Apache Spark 2.0 by Sean Anderson
• How Spark is transforming apps with data streaming by R. Danes
• Spark Streaming for Near Real-Time Analytics Store Updates by Kumar Palaniappan & Filip Jaros

Streamsets

• Dynamic Outlier Detection with StreamSets and Cassandra by Pat Patterson
• Whole File Transfer with StreamSets Data Collector by Pat Patterson

Apache NiFi / Hortonworks Data Flow (HDF)

• Apache NiFi 1.0.0 – Authorization and Multi-Tenancy by Bryan Bende
• What You Need to Know to Extend NiFi by Hays Hutton
• HDF on HDI – NiFi  by Vasilis Vagias

New Presentations

• Apache Kafka – The Big Data Messaging Tool by NextThoughts Technologies
• Ingesting Data from Kafka to JDBC with Transformation and Enrichment by Sandeep Deshumukh
• Real-Time Analytics with Confluent and MemSQL by Hans Jespersen & Steven Camina
• Streaming Patterns Revolutionary Architectures with the Kafka API by Carol McDonald
• Ingest and Extract Big Data Natively in Hadoop with Apache Apex by Vlad Rozov
• Apache Apex: Stream Processing Architecture and Applications by Thomas Weise
• Concord: Simple & Flexible Stream Processing on Apache Mesos by Shinji Kim
• Apache NiFi – MiNiFi by Joe Percivall
• Streaming Analytics by Ashish Gupta & Neera Agarwal
• Commander: Decoupled, Immutable REST APIs with Kafka Streams by Bobby Claderwood
• Apache Kafka Introduction & Use Cases by Amita Mirajkar & Sunny Gupta

New Podcasts

• Apache Beam with Frances Perry by Jeff

New Videos

• Apache Flink: A Quick Guide to the Next Generation Stream Processing Platform by Vladimir Bacvanski
• Building scalable enterprise data flows and IoT apps using Apache NiFi by Dhruv Kumar

Upcoming Events

• 8/23/2016 (Mountain View, US) – Stream Processing Meetup @ LinkedIn (Meetup)
• 8/25/2016 (San Francisco, US) – Focusing on Ingest into Hive and Streaming with Kafka (Meetup)
• 8/31/2016 (Palo Alto, US) – Heron@Twitter (Meetup)
• 9/1/2016 (online) – Microservices in the Apache Kafka Ecosystem (Confluent Webinar)
• 9/8/2016 (San Francisco, US) – Adaptive Data Cleansing with StreamSets and Cassandra (Cassandra Summit)
• 9/8/2016 (online) – Protecting Your Data at Rest in Apache Kafka (Confluent Webinar)
• 9/13/2016 (online) – Data Streaming with Apache Kafka & MongoDB (MongoDB webinar)

Please let me know if that is of interest. Please tweet your projects, blog posts, and meetups to @gschmutz to get them listed in next week’s edition!