This week in Stream Processing & Streaming Analytics 2/13/2016

Update 14.2: Have added Google Dataflow / Apache Beam

Inspired by “This Week in Cassandra”, I will start collecting and documenting once a week the latest news in the world of “Stream Processing & Streaming Analytics” platforms and framework. I will look at new projects/subprojects, blog posts and new and upcoming features around Open Source, Oracle, IBM and others.

So far it’s not planned to do that in a live discussion, as the folks at DataStax do. But maybe that could be something for the future.

Before starting with the news of the last week, here are some classical / evergreens around the topic of Stream Processing / Streaming Analytics:

News and Blog Posts

General

Comparisons

Apache Storm

Apache Spark Streaming

Apache Samza

Apache Flink

Google Dataflow / Apache Beam

Apache NiFi

Apache Kafka / Confluent Platform

Oracle Stream Xplorer / Oracle Event Processing

Others

New Presentations

New Releases / Components

Upcoming Events

Please let me know if that is of interest. Please tweet your projects, blog posts, and meetups to @gschmutz to get them listed in next week’s edition!

 

Advertisements

Providing Oracle Stream Explorer environment using Docker

In the past week I have been experimenting with installing Oracle Stream Explorer into a Docker container, in order to simplify provisioning development/show case environments with a single docker run command. 

Docker is an open platform for developers and sysadmins to build, ship, and run distributed applications. Consisting of Docker Engine, a portable, lightweight runtime and packaging tool, and Docker Hub, a cloud service for sharing applications and automating workflows, Docker enables apps to be quickly assembled from components and eliminates the friction between development, QA, and production environments. As a result, IT can ship faster and run the same app, unchanged, on laptops, data center VMs, and any cloud.

You can find the corresponding docker project on my GitHub: https://github.com/gschmutz/docker-oracle-sx

Due to the Oracle licensing agreement, the Oracle software itself can not be provided in the GitHub project. So you first have to download the Java 7 SDK as well as Stream Explorer Runtime and the Stream Explorer User Experience using your own OTN login. Download the 3 artefacts into the downloads subfolder. 

After downloading these files into the downloads folder, you are ready to build the Docker image:

cd docker-oracle-sx
docker build -t gschmutz/docker-oracle-sx:12.1.3 .

This will take a while if run for the first time, as it downloads the oracle-linux base image first. At the end you should see a “Successfully build xxxxxxxx” message, indicating that the docker image has been built successfully.

Unfortunately the domain creation wizard cannot be run automatically, therefore the domain has been pre-created and is provided by the docker-oracle-sx project. This domain is named sx_domain and is copied into the docker image when building the container. 

Now let’s run the container:

docker run -d -p 9002:9002 gschmutz/docker-oracle-sx:12.1.3

With the -p option we are exposing the port 9002 from the docker container to the host machine. With that Oracle Stream Explorer is available under http://docker-host-ip:9002/sx. Connect with user wlevs and password welcome1

NewImage

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

The Oracle Event Processing Console is available under http://docker-host-ip:9002/wlevs.  

Happy stream exploring 🙂