Last week in Stream Processing & Analytics 3/28/2016

This is the 7th installment of my blog series around Stream Processing and Analytics.

Due to the Easter Weekend there were not so many posts last week, guess that will change this week with Strata Hadoop San Jose conference just starting today.

Personally I have started giving Streamsets a try, after having played a little bit with Apache NiFi before. Both offer a nice solution for the handling of data flows, and I’m not yet in a position to judge which one does it better. But there some obvious differences and I guess it’s not wrong to say that the combination of both would offer a really good solution.

As usual, just find what I have noticed last week:

News and Blog Posts

General

Apache Storm

Apache Spark Streaming

Apache Flink

Apache Kafka

Goggle Cloud Dataflow / Apache Beam

Apache NiFi / Hortonworks DataFlow

StreamSets

New Presentations

New Videos

New Books

New Releases / Components

Upcoming Events

Please let me know if that is of interest. Please tweet your projects, blog posts, and meetups to @gschmutz to get them listed in next week’s edition!

Advertisements

Last week in Stream Processing & Analytics 3/21/2016

This is the 6th installment of my blog series around Stream Processing and Analytics.

This week I would like to quote two articles, one from Forbes Tech and another from Information Week.

In the 17 Predictions about the future of Big Data …  Forbes compiles 17 predictions from well known analysts, mentioning fast data as one of the next trends:

  • “real-time streaming insights into data will be the hallmarks of data winners going forward”
  • “autonomous agents and things will continue to be a huge trends”
  • “Fast Data and actionable data will replace big data”

According to this article, Forrester defines streaming analytics software as technology that “can filter, aggregate, enrich, and analyze a high throughput of data from multiple disparate live data sources and in any data format to identify simple and complex patterns to visualize business in real-time, detect urgent situations, and automate immediate actions.“.Forrester also identified key vendors and technology for streaming analytics, which are Apache Spark Streaming, Apache Storm, Data Torrent, IBM, Informatica, SAP, Software AG, SQLstream, Strim (WebAction), TIBCO, and Vitria.

I’m wondering why Oracle’s Stream Explorer product is not on Forrester’s radar. Especially because it can be used for both of the two Big Data’s priorities: Streaming Analytics and Self Service.

As usual, just find what I have noticed last week:

News and Blog Posts

General

Comparison

Apache Spark Streaming

Apache NiFi / Hortonworks DataFlow

Apache Kafka

Goggle Cloud Dataflow / Apache Beam

Hortonworks DataFlow / Apache NiFi

StreamSets

IBM Quarks

Microsoft Azure Stream Analytics

SAS Event Stream Processing

New Presentations

New Videos

New Releases / Components

none

Upcoming Events

Please let me know if that is of interest. Please tweet your projects, blog posts, and meetups to @gschmutz to get them listed in next week’s edition!

 

Last week in Stream Processing & Analytics 3/14/2016

This is the 5th installment of my blog series around Stream Processing and Analytics.

So what are the two most interesting topics to mention for last week?

  1. of course the release of the preview of Kafka StreamsKafka Streams is a Java library for building distributed stream processing apps using Apache Kafka and will be part of Kafka 0.10. Jay Kreps himself describes the goal of Kafka Streams as follows: “Our goal with Kafka Streams is to make stream processing easy & powerful enough that it can be a mainstream development paradigm.”
  2. did I already mention Kafka Streams 😉 Jay Kreps blog article on Kafka Streams is really a must-read (as always)!

As usual, just find what I have noticed last week:

News and Blog Posts

General

Apache Storm

Apache Spark Streaming

Apache Flink

Apache NiFi / Hortonworks DataFlow

Apache Kafka

Goggle Cloud Dataflow

StreamSets

Microsoft Stream Analytics

MapR Streams

New Presentations

New Book

New Videos

New Releases / Components

Upcoming Events

Please let me know if that is of interest. Please tweet your projects, blog posts, and meetups to @gschmutz to get them listed in next week’s edition!

 

Last week in Stream Processing & Analytics 3/7/2016

This is the forth installment of my blog series around Stream Processing and Analytics. So what were the 2 most interesting topics of last week:

First I really liked the slides of the Taylor Goetz’s presentation on the Future of Apache Storm. And Second there was the mentioning of adding timestamp to the Kafka message format in the latest Log Compaction blog article.

As usual, just find what I have noticed last week:

News and Blog Posts

General

Apache Storm

Apache Flink

Apache NiFi / Hortonworks DataFlow

Apache Kafka

Apache Apex

StreamSets

New Presentations

New Videos

New Releases / Components

Upcoming Events

Please let me know if that is of interest. Please tweet your projects, blog posts, and meetups to @gschmutz to get them listed in next week’s edition!