Please let me know if that is of interest. Please tweet your projects, blog posts, and meetups to @gschmutz to get them listed in next week’s edition!

gschmutz 22:08 on August 7, 2017
Tags: confluent ( 7 ), flink ( 66 ), IoT ( 8 ), kafka ( 75 ), nifi ( 68 ), spark ( 8 ), storm ( 44 ), Stream Processing ( 69 ), streaming-analytics ( 67 )

Last Week in Stream Processing & Analytics – 7.8.2017

This is the 76th edition of my blog series blog series around Stream Processing and Analytics!

As every week I was also updating the following two lists with the presentations/videos of the current week:

As usual, find below the new blog articles, presentations, videos and software releases from last week:

News and Blog Posts

General

Real-Time Anomaly Detection Streaming Microservices with H2O and MapR – Part 3: Production Deployment of ML Model With a Streaming Microservice by Mathieu Dumoulin
Event sourcing on blockchain with Ethereum, TypeScript and React by Krzysztof Ciesielski
Event Driven Microservices Patterns by Carol McDonald
Edge Computing Unlocks the Business Value of IoT Data by RTInsights Team
Flogo: Built From the Ground Up for Edge Computing by Matt Elis
NBCUniversal Changes the Game for TV Advertising with DC/OS and the SMACK Stack by Mesosphere

Apache Kafka / Kafka Streams / Confluent Platform

We’ll Say This Exactly Once: Confluent Platform 3.3 is Available Now by Geherig Kunz
How WePay uses stream analytics for real-time fraud detection using GCP and Apache Kafka by Wei Li
Messaging as the Single Source of Truth by Ben Stopford
Scaling Blockchains with Apache Kafka by Alex Miller
Kafka Streams: Unit Testing by Anuj Saxena
Install Apache Kafka On Windows by howtoprogram
Are You Ready for Kafka Summit San Francisco? by Tim Berglund
Kafka Streams and Unit Testing by Anuj Saxena

Apache Flink

Flink Forward Berlin Preview: The Apache Flink Ecosystem by Michael Winters

Apache NiFi / Hortonworks HDF

Ingest Salesforce Data Incrementally Into Hive Using Apache NiFi by
Saikrishna Teja Bobba
Building a Custom Processor in Apache NiFi 1.2 for TensorFlow Using the Java API by Timothy Spann
How to collect data like a spy — Part 1: How to collect data like a spy by Mark Craddock
How to collect data like a spy — Part 2: Getting NiFi up and running by Mark Craddock
How to collect data like a spy — Part 3: How to collect social media data like a pro by Mark Craddock
How to collect data like a spy — Part 4: Turning JSON into a database with AWS Athena by Mark Craddock
How to collect data like a spy — Part 5: Connecting rStudio to Amazon Athena by Mark Craddock
How to collect data like a spy — Part 6: Creating Maps of the Data in RStudio by Mark Craddock
Creating WordClouds From DataFlows with Apache NiFi and Python by Timothy Spann
Convert CSV to JSON, Avro, XML using ConvertRecord (Apache NiFi 1.2+) by Andrew Lim
Installing a local Hortonworks Registry to use with Apache NiFi by Andrew Lim

New Presentations

Streaming Real-Time Events Using Apache APIs by Carol McDonald
Exactly-once Data Processing with Kafka Streams by Guozhang Wang
How Yelp Leapt to Microservices with More than a Message Queue by Justin Cunningham
Deep learning and streaming in Apache Spark 2.2 by Matei Zaharia
Kafka RealTime Streaming by Viyaan Jhiingade

New Videos

Google Dataflow: The New Open Model for Batch and Stream Processing by Robert Kubis
Building an automation-driven Lambda architecture by Malwarebytes

New Releases

Upcoming Events

9.8.2017 (Bellevue, US) – Spark Structured Streaming : Introduction and Internals (Meetup)
9.8.2017 (Sydney, AU) – Data-in-Motion: Recent advances in Apache projects for streaming data (Meetup)
10.8.2017 (online) – Why VR Needed Stream Processing to Survive (Confluent Webinar)
15.8.2017 (Milwaukee, US) – Sensors, Spark and Kafka: Applied Machine Learning (Meetup)
16.8.2017 (online) – Pandora Plays Nicely Everywhere with Real-Time Data Pipelines (Confluent Webinar)
16.8.2017 (online) – Data Warehouse Modernization: Accelerating Time-to-Action (MapR Webinar)
24.8.2017 (San Francisco, US) – Visualizing and Analyzing Salesforce Data with StreamSets and Neo4j (Meetup)
27.8.2017 (online) – Embrace Streaming Analytics and Transform Your Business (AWS Webinar)
16.9.2017 (McLean, US) – Spark Saturday DC (Meetup)
18.9.2017 (Zurich, CH) – First Kafka Meetup Zurich (Meetup)
19.9.2017 (online) – Real-time marketing analytics with stream processing (O’Reilly Webcast)

Please let me know if that is of interest. Please tweet your projects, blog posts, and meetups to @gschmutz to get them listed in next week’s edition!

gschmutz 19:20 on July 24, 2017
Tags: beam ( 25 ), flink ( 66 ), kafka ( 75 ), kinesis ( 2 ), nifi ( 68 ), Stream Processing ( 69 ), streaming-analytics ( 67 )

Last Week in Stream Processing & Analytics – 24.7.2017

This is the 74th edition of my blog series blog series around Stream Processing and Analytics!

As every week I was also updating the following two lists with the presentations/videos of the current week:

As usual, find below the new blog articles, presentations, videos and software releases from last week:

News and Blog Posts

General

Converged Architecture for Real-time Anomaly Detection for IoT Sensor Data by Mathieu Dumoulin
Adopting Stream Processing for Instrumentation by Sean Cribbs
The IoT Data Platform: Architectural Approaches by Mark Herring
A lot of fun with … AMQP, Spark, Kafka, EnMasse, MQTT, Vert.x & IoT by Paolo Patierno
Evaluating persistent, replicated message queues by Adam Warski
The Big Data technologies that saved BP $7bn by Andrew Carr

Apache Kafka / Kafka Streams / Confluent Platform

Upgrading Apache Kafka Clients Just Got Easier by Colin McCabe
Using Apache Kafka as a Scalable, Event Driven Backbone for Service Architectures by Ben Stopford
Real-time Financial Alerts at Rabobank with Apache Kafka’s Streams API by Jeroen van Disseldorp
How to Use the Kafka Streams API by Anuj Saxena

Apache Flink

Flink Forward Berlin Preview: Flink Use Cases and Applications by Michael Winters
Apache Flink: The Next Distributed Data Processing Revolution? by Datafloq
Dynamically Configured Stream Processing: How BetterCloud Built an Alerting System with Apache Flink by David Hardwick, Sean Hester, Jason Brelloch & David Brelloch

Apache NiFi / Hortonworks HDF

Change Data Capture (CDC) with Apache NiFi (Part 1 of 3) by Andrew Lim
Change Data Capture (CDC) with Apache NiFi (Part 2 of 3) by Andrew Lim
Change Data Capture (CDC) with Apache NiFi (Part 3 of 3) by Andrew Lim

New Presentations

When Streams Fail – Kafka Off the Shore, What If? by Goldman Sachs
Online change point detection using spark streaming by Michal Monselise
Batch and Streaming Processing in the World of Data Engineering and Data Science by Keira Zhou
Introduction to AWS Big Data by Omid Vahdaty
Performance Metrics for Big Data Systems: Streaming Data Analytics by Shikha Mehta
Analyzing Real-time Streaming Data with Amazon Kinesis by Roy Ben-Alta & Daniel Modlinger
Big data processing with Apache Beam by Sourabh Bajaj
How to build Next Generation Analytics Applications using Hortonworks DataFlow by Sebastian Carroll

New Videos

Building Microservice Architectures by Sam Newman & Mark Stopford
Apache Spark Pipeline for Game Data Processing by Nick Afshartous
Real Time stream analytics, easy to use by SQLStream

New Books

Understanding Message Brokers by Jakub Korab

New Podcasts

What’s Next for Apache Beam? by Frances Perry

Upcoming Events

25.7.2017 (Arlington, US) – Streaming Analytics Applications (Meetup)
27.7.2017 (online) – Introduction to (Micro)Service Meshes (O’Reilly Webinar)
27.7.2017 (Palo Alto, US) – Exactly Once Semantics in Kafka & Confluent: Speaks Kafka (Meetup)
27.7.2017 (London, UK) – Real Life (Structured) Streaming & Customer Lifetime Value (Meetup)
3.8.2017 (online) – How Yelp Leapt to Microservices with More than a Message Queue (Confluent Webinar)
9.8.2017 (Bellevue, US) – Spark Structured Streaming : Introduction and Internals (Meetup)
9.8.2017 (Sydney, AU) – Data-in-Motion: Recent advances in Apache projects for streaming data (Meetup)
10.8.2017 (online) – Why VR Needed Stream Processing to Survive (Confluent Webinar)
15.8.2017 (Milwaukee, US) – Sensors, Spark and Kafka: Applied Machine Learning (Meetup)
16.8.2017 (online) – Pandora Plays Nicely Everywhere with Real-Time Data Pipelines (Confluent Webinar)
24.8.2017 (San Francisco, US) – Visualizing and Analyzing Salesforce Data with StreamSets and Neo4j (Meetup)
27.8.2017 (online) – Embrace Streaming Analytics and Transform Your Business (AWS Webinar)
16.9.2017 (McLean, US) – Spark Saturday DC (Meetup)

Please let me know if that is of interest. Please tweet your projects, blog posts, and meetups to @gschmutz to get them listed in next week’s edition!

gschmutz 22:14 on July 18, 2017
Tags: flink ( 66 ), kafka ( 75 ), nifi ( 68 ), spark ( 8 ), spark-streaming ( 64 ), Stream Processing ( 69 ), streamsets ( 49 )

Last Week in Stream Processing & Analytics – 18.7.2017

This is the 74th edition of my blog series blog series around Stream Processing and Analytics!

As every week I was also updating the following two lists with the presentations/videos of the current week:

As usual, find below the new blog articles, presentations, videos and software releases from last week:

News and Blog Posts

General

Growth of Streaming Analytics by stephnissen

Apache Kafka / Kafka Streams / Confluent Platform

Apache Kafka and Amazon Kinesis by Jesse Anderson
Rethinking Stream Processing with Apache Kafka: Applications vs. Clusters, Streams vs. Databases by stephnissen
One File System to ingest them all (and in Kafka bind them) by Mario Molina
Analyzing Wimbledon Twitter Feeds in Real Time with Kafka, Presto and Oracle DVD v3 by Francesco Tisiot

Spark

Introducing Apache Spark 2.2 by Michael Armbrust

Apache Flink

Complex Event Generation for Business Process Monitoring using Apache Flink by Hung Chang

Heron

How Twitter Overcame Its Real-Time Data Challenges by Kat Campise

StreamSets

Scaling out StreamSets with Kubernetes by Hari Nayak

Apache NiFi / Hortonworks HDF

Encrypted Provenance Repositories in Apache NiFi by Andy LoPresto
It’s Here! An Apache NiFi Simulator for Generating Random AND Realistic Time Series Data by Chris Herrera

New Presentations

Kafka Streams for Java enthusiasts by Slim Baltagi
Big Data Best Practices – Real Time Analytics by Lior Hipsh

New Videos

Khermes, an Open-Source and distributed data generator for Apache Kafka by Stratio

Upcoming Events

20.7.2017 (online) – Building Microservice Architectures (Confluent Webinar)
20.7.2017 (online) – How to build Next Generation Analytics Applications using Hortonworks DataFlow (Hortonworks Webinar)
27.7.2017 (online) – Introduction to (Micro)Service Meshes (O’Reilly Webinar)
24.8.2017 (San Francisco, US) – Visualizing and Analyzing Salesforce Data with StreamSets and Neo4j (Meetup)
16.9.2017 (McLean, US) – Spark Saturday DC (Meetup)

Please let me know if that is of interest. Please tweet your projects, blog posts, and meetups to @gschmutz to get them listed in next week’s edition!

gschmutz 22:49 on July 3, 2017
Tags: flink ( 66 ), heron ( 16 ), kafka ( 75 ), nifi ( 68 ), spark-streaming ( 64 ), Stream Processing ( 69 ), streaming-analytics ( 67 ), streamsets ( 49 )

Last Week in Stream Processing & Analytics – 3.7.2017

This is the 73rd edition of my blog series blog series around Stream Processing and Analytics!

As every week I was also updating the following two lists with the presentations/videos of the current week:

As usual, find below the new blog articles, presentations, videos and software releases from last week:

News and Blog Posts

General

Open Sourcing Bullet, Yahoo’s Forward-Looking Query Engine for Streaming Data by Michael Natkovich, Akshai Sarma, Nathan Speider, Macus Svedman & Cat Utah
Taking On Next-Generation Cyberattacks With Streaming Analytics by Joel Hans

Apache Kafka / Kafka Streams / Confluent Platform

Exactly-once Semantics are Possible: Here’s How Kafka Does it by Neha Narkhede
Confluent achieves Holy Grail of ‘exactly once’ delivery on Kafka messaging service by Ron Miller
Delivering Billions of Messages Exactly Once by Amir Abu Shareb
Stream Processing Metamorphosis – A Kafka’s tale by Joao Vasques
Exactly-once Support in Apache Kafka by Jay Krebs

Spark Streaming

Monitoring Real-Time Uber Data Using Apache APIs, Part 1: Spark Machine Learning by Carol McDonald
Monitoring Real-Time Uber Data Using Apache APIs, Part 2: Kafka and Spark Streaming by Carol McDonald

Apache Flink

Dynamically Configured Stream Processing: How BetterCloud Built an Alerting System with Apache Flink by David Hardwick, Sean Hester, Jason Brelloch and David Brelloch

Heron

Dhalion: self-regulating stream processing in Heron by vikdutt
Dhalion: Self-Regulating Stream Processing in Heron by Avrilia Floratou, Karthik Ramasamy, Ashin Agrawal, Bill Graham & Sriram Rao

StreamSets

How to Install StreamSets Data Collector on the MapR Sandbox by Pat Patterson

Apache NiFi / Hortonworks HDF

Kinetica – Ingestion Using Apache NiFi by Sunile Manjee
Apache NiFi as an Orchestration Engine by Prakash Singh
Real-Time SQL on Event Streams by Mark Payne

New Presentations

Exactly-once Semantics in Apache Kafka by Apurva Mehta & Gehrig Kunz
Bringing it All Together: Apache Metron (Incubating) as a Case Study of a Modern Streaming Architecture on Hadoop by Casey Castella
Cloud-Native Streaming and Event-Driven Microservices by Marius Bogoevici
Connecting the Drops with Apache NiFi & Apache MiNiFi by Aldrin Piri
Reflections on Almost Two Decades of Research into Stream Processing by Kyumars Sheykh Esmaili
Stateful Stream Processing with Apache Flink by Kostas Kloudas

New Videos

Stream All Things – Patterns of Modern Data Integration by Gwen Shapira
Introducing Exactly Once Semantics in Apache Kafka by Confluent
Kafka Streams For Java Enthusiasts by Slim Baltagi
Integrating Real-Time Video Data Streams with Spark and Kafka by Nick Piette
Scalable Stream Processing: Survey of Storm, Samza, Spark & Flink by Norbert Ritter

New Releases

Apache Kafka 0.11.0.0

Upcoming Events

3.7.2017 (Warsaw, PL) – Apache Flink – Stateful Stream Processing (dataArtisans) & CEP (GetInData) (Meetup)
4.7.2017 (Dubling, IR) – Stream Processing with Apache Kafka & Real-time Data Integration at Scale (Meetup)
11.7.2017 (Toronto, CA) – Apache NiFi: Enterprise data flow management and FBP with Joe Witt (Meetup)
20.7.2017 (online) – Building Microservice Architectures (Confluent Webinar)
16.9.2017 (McLean, US) – Spark Saturday DC (Meetup)

Please let me know if that is of interest. Please tweet your projects, blog posts, and meetups to @gschmutz to get them listed in next week’s edition!

gschmutz 20:10 on June 27, 2017
Tags: flink ( 66 ), kafka ( 75 ), nifi ( 68 ), spark-streaming ( 64 ), Stream Processing ( 69 ), streamsets ( 49 )

Last Week in Stream Processing & Analytics – 27.6.2017

This is the 72nd edition of my blog series blog series around Stream Processing and Analytics!

As every week I was also updating the following two lists with the presentations/videos of the current week:

As usual, find below the new blog articles, presentations, videos and software releases from last week:

News and Blog Posts

General

The SMACK Stack is the New LAMP Stack by Edward Hsu
Challenges Of Real Time Stream Processing In Big Data by Big Data Diaries

Apache Kafka / Kafka Streams / Confluent Platform

Kafka: The story so far by George Anadiotis
Log Compaction – Highlights in the Apache Kafka™ and Stream Processing Community – June 2017 by Yeva Byzek
Building a Real-Time Streaming ETL Pipeline in 20 Minutes by Yeva Byzek
Kafka with selective acknowledgments (kmq) performance & latency benchmark by Adam Warski
Publishing Avro to Kafka in R by Engineering Alice
NodeJs producing messages in and consuming messages from an Apache Kafka topic by Bertrand Szoghy
Connect Apache Kafka instances in CloudKarafka by Suci Lin
Offset Management For Apache Kafka With Apache Spark Streaming by Guru Medasani & Jordan Hambleton

Spark Streaming

Offset Management For Apache Kafka With Apache Spark Streaming by Guru Medasani & Jordan Hambleton
Integrating Kafka With Spark Structured Streaming by
Jatin Demla

StreamSets

Triggering Databricks Notebook Jobs from StreamSets Data Collector by Pat Patterson

Apache NiFi / Hortonworks HDF

Moving Zendesk Data into BigQuery with help from Apache NiFi’s Wait/Notify Processors by Dan Young
Part 4: SAM’s Stream Builder – Building Complex Stream Analytics Apps without Code by George Vetticaden & Sriharsha Chintalapani & Jungtaek Lim & Sanket Shah
Apache NiFi – Records and Schema Registries by Bryan Bende

New Presentations

Customer Event Hub – a modern Customer 360° view with DataStax Enterprise (DSE) by Guido Schmutz
Apache Kafka – Scalable Message Processing and more! by Guido Schmutz
Redesigning Apache Flink’s Distributed Architecture by Till Rohrmann
Development of Scalable Machine Learning Microservices with Apache Kafka Streams and H2O.ai by Kai Wähner
From Batch to Streaming ET(L) with Apache Apex by Thomas Wiese
Streaming patterns revolutionary architectures by Carol McDonald
Integration Patterns for Big Data Applications by Michael Häusler
Streaming analytics manager by Sriharsha Chintalapani & Arun Mahadevan
Visualizing Big Data in Realtime by Sasha Parfenov
Flink SQL & TableAPI in Large Scale Production at Alibaba by Xiaowei Jiang & Shaoxuan Wang
Moving from Big Data to Fast Data? Here’s How To Pick The Right Streaming Engine by Dean Wampler
A Real-time Processing System based on Spark streaming int he field of Telecommunications by Geng Wang & Dong Wang
Real Time Streaming Architecture at Ford by Ford Analytics
Next Generation Execution Engine for Apache Storm by Roshan Naik
Stateful processing of massive out-of-order streams with Apache Beam by Kenneth Knowles
Accelerate Value Capture from Your Big Data, IoT, and AI Initiatives with 1/10th the Effort by Nikhil Krishnan
Bringing Real-Time to the Enterprise with Hortonworks DataFlow by Cavan Loughran
Future Architecture of Streaming Analytics: Capitalizing on the Analytics of Things (AoT) by Thomas Henson
Kafka to the Maxka – (Kafka Performance Tuning) by Matt Andruff
Powering the Intelligent Edge: HPE’s Strategy and Direction for IoT & Big Data by Robert Patterson
Data Ingest Self Service and Management using Nifi and Kafka by Imran Amjad & Dave Torok
How Uber scaled its Real Time Infrastructure to Trillion events per day by Ankur Bansal & Mingmin Chen
Building a modern end-to-end open source Big Data reference application by Edgar Orendain
Introductions to Online Machine Learning Algorithms by Trevor Grant
Bullet: A Real Time Data Query Engine by Michael Natkovich & Akshai Sarma
Worldwide Scalable and Resilient Messaging Services by CQRS and Event Sourcing using Akka, Kafka Streams and HBase by Shingo Omura & Masaru Dobashi
When it absolutely, positively has to be there by Jeff Holman & Gwen Shapira
ntegrating and Analyzing Data from Multiple Manufacturing Sites using Apache NIFI and Apche Zeppelin to a central Hadoop data lake by Mark Baker

New Videos

Real Time Streaming Architecture at Ford by Ford Analytics
Next Generation Execution Engine for Apache Storm by Roshan Naik
Kafka to the Maxka – (Kafka Performance Tuning) by Matt Andruff
Bringing Real-Time to the Enterprise with Hortonworks DataFlow by Cavan Loughran
Future Architecture of Streaming Analytics: Capitalizing on the Analytics of Things (AoT) by Thomas Henson
Streaming analytics manager by Sriharsha Chintalapani & Arun Mahadevan
Connecting the Drops with Apache NiFi & MiNiFi by Aldrin Piri
Visualizing Big Data in Realtime by Sasha Parfenov
Easy, Scalable, Fault tolerant stream processing with Structured Streaming in Apache Spark by Tathagata Das
From Batch to Streaming ET(L) with Apache Apex by Thomas Wiese
Worldwide Scalable and Resilient Messaging Services by CQRS and Event Sourcing using Akka, Kafka Streams and HBase by Shingo Omura & Masaru Dobashi
Building a modern end-to-end open source Big Data reference application by Edgar Orendain
Bullet: A Real Time Data Query Engine by Michael Natkovich & Akshai Sarma
How Uber scaled its Real Time Infrastructure to Trillion events per day by Ankur Bansal & Mingmin Chen
Stateful processing of massive out-of-order streams with Apache Beam by Kenneth Knowles
Real Time and Batch Processing Platform for Security Telemetry by Srinivas Vippagunta & Vivek Madani
A Real-time Processing System based on Spark streaming int he field of Telecommunications by Geng Wang & Dong Wang
Batch and Streaming Analytics for Prescriptive & Predictive Solutions converted by Gurudev Karanth & Karthik Rajagopalan & Mithun Yarlagadda
MaaS Model as a Service Modern Streaming Data Science with Apache Metron Incubating by Casey Stella
Flink SQL & TableAPI in Large Scale Production at Alibaba by Xiaowei Jiang & Shaoxuan Wang
Realizing the promise of portable data processing with Apache Beam converted by Davor Bonaci
Real Time Data is Changing the Face of the Insurance Industry by Moniuqe Hesseling & Naresh Mudunuru & Denise Rogers
Data Ingest Self Service and Management using Nifi and Kafka by Imran Amjad & Dave Torok
Creating real time, data centric applications with Impala and Kudu by Todd Lipcon
Powering the Intelligent Edge: HPE’s Strategy and Direction for IoT & Big Data by Robert Patterson

New Releases

Apache Flink 1.3.1

New Book

Learning Spark Streaming – Best Practices for Scaling and Optimizing Apache Spark by O’Reilly Press

Upcoming Events

28.6.2017 (Munich, GE) – Rethinking Stream Processing with Apache Kafka (Meetup)
29.6.2017 (online) – Introducing Exactly Once Semantics in Apache Kafka (Confluent Meetup)
29.6.2017 (San Francisco, US) – Apache Flink on DC/OS – contribution kickoff! (Meetup)
3.7.2017 (Warsaw, PL) – Apache Flink – Stateful Stream Processing (dataArtisans) & CEP (GetInData) (Meetup)
4.7.2017 (Dubling, IR) – Stream Processing with Apache Kafka & Real-time Data Integration at Scale (Meetup)

Please let me know if that is of interest. Please tweet your projects, blog posts, and meetups to @gschmutz to get them listed in next week’s edition!

gschmutz 21:59 on June 19, 2017
Tags: apex ( 18 ), beam ( 25 ), flink ( 66 ), hdf ( 17 ), IoT ( 8 ), kafka ( 75 ), kafka-streams ( 23 ), nifi ( 68 ), spark-streaming ( 64 ), Stream Processing ( 69 ), streaming-analytics ( 67 )

Last Week in Stream Processing & Analytics – 19.6.2017

This is the 71st edition of my blog series blog series around Stream Processing and Analytics!

As every week I was also updating the following two lists with the presentations/videos of the current week:

As usual, find below the new blog articles, presentations, videos and software releases from last week:

News and Blog Posts

General

IBM Throws In with Hortonworks’ Hadoop by Alex Woodie
The future of Fast and Big Data Technologies by Dana Sandu
Real-Time Customer Service Will Soon Be the Rule by Joe McKendrick
Connected Intelligence in the IoT Edge by Rajeev Kozhikkattuhodi

Comparison

Streaming in Spark, Flink, and Kafka by Shivangi Gupta
Spark Streaming vs. Kafka Stream by Mahesh Chand Kandpa

Apache Kafka / Kafka Streams / Confluent Platform

Announcing public preview of Apache Kafka on HDInsight with Azure Managed disks by Raghav Mohan
Simplifying your microservices architecture with Kafka and KafkaStreams by Dan Lebrero

Spark Streaming

Apache Spark DStream by DataFlair
Exploring Spark Structured Streaming by Mahesh Chand Kandpal

Apache Beam

Beam 2.0 Q and A by Jesse Anderson

Apache NiFi / Hortonworks HDF

Developing Streaming Analytics Applications without writing a single line of code for Hortonworks DataFlow by Wei Wang

New Presentations

Stateful Stream Processing with Apache Flink by Tzu-L Gordon
The History and Future of the Blurring of Stream Processing & OLTP by John Hugg
From Batch to Streaming ET(L) with Apache Apex by Thomas Weise
Complex Event Processing with Flink: the state of FlinkCEP by Kostas Kloudas
Stream Analytics with SQL on Apache Flink by Fabian Hueske
Apache Spark and Apache Ignite: Where Fast Data Meets the IoT by Denis Magda
Stream All Things—Patterns of Modern Data Integration by Gwen Shapira
Connecting Apache Kafka With Mule ESB by Jitendra Bafna
Introducing Exactly Once Semantics in Apache Kafka by Matthias J. Sax

New Videos

Rethinking Stream Processing with Apache Kafka by Michael Noll
From Batch to Streaming ET(L) with Apache Apex by Thomas Weise
Integration Patterns for Big Data Applications by Michael Häusler
Experiences running Flink at Very Large Scale by Stephan Ewen
Challenges of Monitoring Distributed Systems by Nenad Bozic
Design Patterns for Calculating User Profiles in Real Time by Igor Mazor
The History and Future of the Blurring of Stream Processing & OLTP by John Hugg
Using Apache Beam to create a unified benchmarking framework by Ismaël Mejía
A Big Data Streaming Recipe by Konstantin Gregor
Balancing Heroes and Pokemon in Real Time by Fokko Driesprong & Vincent Warmerdam
Containerizing Distributed Pipes by Hagen Tönnies
Update on the t-digest: Finding Faults in Real Data by Ted Dunning
Mechanics of Data Pipelines by Sean Braithwaite
Hops: Multi-Tenancy and Streaming-First in an open-source SaaS platform by Jim Dowling
Complex Event Processing with Flink: the state of FlinkCEP by Kostas Kloudas
Stream Analytics with SQL on Apache Flink by Fabian Hueske
Hands-on with Apache NiFi and MiNiFi by Andrew Psaltis

Upcoming Events

20.6.2017 (Düsseldorf, GE) – Big Data & Stream Processing with Apache Spark
22.6.2017 (Canberra, Australia) – Data-in-Motion: Recent advances in Apache projects for streaming data (Meetup)
22.6.2017 (Zurich, CH) – Data stream processing at PSI (Meetup)
27.6.2017 (London, UK) – Stateful Stream Processing (Meetup)
28.6.2017 (Munich, GE) – Rethinking Stream Processing with Apache Kafka (Meetup)
3.7.2017 (Warsaw, PL) – Apache Flink – Stateful Stream Processing (dataArtisans) & CEP (GetInData) (Meetup)

Please let me know if that is of interest. Please tweet your projects, blog posts, and meetups to @gschmutz to get them listed in next week’s edition!

My week on Twitter 🎉: 1 New Follower, 1 Mention, 6 Favorited, 4 Retweets, 14.2K Retweet Reach. See yours with sumall.com/performancetwe… 1 day ago
Last Week in Stream Processing & Analytics –@14.8.2017 guidoschmutz.wordpress.com/2017/08/15/las… 1 day ago
RT @kurteichenwald: Peter Cvjetanovic, a white nationalist, is upset that this photo of him has gone viral. So be nice: dont retweet this t… 2 days ago
me too, will be speaking about Apache Kafka and the ecosystem :-) at #JavaOne :-) twitter.com/lucasjellema/s… 3 days ago
RT @lucasjellema: And finally I have heard back from my JavaOne abstracts. I've been invited to present a session: Real-Time UI with Apache… 3 days ago

August 2017
M	T	W	T	F	S	S
« Jul
	1	2	3	4	5	6
7	8	9	10	11	12	13
14	15	16	17	18	19	20
21	22	23	24	25	26	27
28	29	30	31