Last week in Stream Processing & Analytics 5/2/2016

This is the 12th installment of my blog series around Stream Processing and Analytics.

The most important event last week was probably the first Kafka Summit being held in San Francisco. At the summit, Confluent shared results from a recent survey that clearly shows the rise of Kafka across the enterprise and the growth of stream processing:

  • According to the results, Apache Kafka is most commonly used for stream processing (72% of respondents). In addition, nearly seven of ten (68%) Kafka users surveyed say they plan to incorporate more stream processing over the next 6 to 12 months. Of those:
    • 74% say they will add it to new applications in development now
    • 69% will add it to existing applications
    • 60% will build net-new applications using stream processing and Kafka

The survey also reveals how Kafka is being used:

  • Kafka powers a wide variety of applications today based on survey respondents, including application monitoring (60%), data warehousing (51%) and asynchronous applications (47%) to system monitoring (39%), recommendation/decisioning engines (35%), security/fraud detection (26%), Internet of Things applications (20%) and dynamic pricing applications (12%), to name a few.

We have been using Kafka for almost 3 years now and I have never regretted  choosing it. Unfortunately the journey to California for just that one day was a bit too far for me to attend, but I read that most/some of the presentation should be available on video later. Find below the presentations which are already available through SlideShare.

So that’s it for this week. As usual, find below the new blog articles, presentations, videos and software releases from last week:

News and Blog Posts


Apache Storm

Apache Spark Streaming

Apache Flink

Apache Apex

Apache Kafka

Apache NiFi / Hortonworks DataFlow




IBM Streaming Analytics

Microsoft Azure Stream Analytics


New Presentations

New Videos

Upcoming Events

Please let me know if that is of interest. Please tweet your projects, blog posts, and meetups to @gschmutz to get them listed in next week’s edition!