On behalf of the Spring XD team, I am very pleased to announce the first milestone release of Spring XD 1.3

This release includes bug fixes and some enhancements:

• Hadoop distribution version updates to Apache Hadoop 2.7.1 and Hortonworks Data Platform 2.3. Pivotal Hadoop 2.1, 3.0 and Cloudera Hadoop 5.4
• Spark 1.3.1 Support
• Cassandra Sink
• Header Enricher Processor
• Bug fixes to the Flo Designer UI and Admin UI
• Gpfdist sink now supports update operations and full range of control file options
• Update to Spring Integration 4.2 which provides performance improvements when monitoring is enabled.
• Upgrade to Spring Data Gosling Release train
…

On behalf of the Spring XD team, I am very pleased to announce the general availability of Spring XD 1.2.1!

This release includes bug fixes and some small enhancements:

• Support for registering custom Kryo Serializers
• Configuration options to fine tune Kryo performance
• Update several dependencies to latest versions - Spring Integration, Boot, reactor, Groovy
• Add jars for Avro and Snappy compression to Sqoop job submission
• Fix admin UI access when security is enabled
• Improved pagination for containers and jobs

You can download the zip distribution or install on OSX using homebrew On RHEL/CentOS you can install using rpm…

Today, we are pleased to announce the general availability of Spring XD 1.2, Spring XD 1.1.3 and the release of Flo for Spring XD Beta.

• 1.2.0.GA: zip
• 1.1.3.RELEASE: zip
• Flo for Spring XD Beta

You can also install XD 1.2 using brew and rpm

The 1.2 release includes a wide range of new features and improvements. The release journey was an eventful one, mainly due to Spring XD’s popularity with so many different groups, each with their respective request priorities. However the Spring XD team rose to the challenge and it is rewarding to look back and review the amount of innovation delivered to…

On behalf of the Spring XD team, I am very pleased to announce that the Spring XD 1.2 Release Candidate is now available for download. You can also install using rpm

The 1.2 RC1 release includes bug fixes as well as several new features and enhancements.

• Apache Ambari plugin to automate the deployment of Spring XD to a Hadoop cluster. Read more in the release blog for the plugin.
• A new Analytics tab in the UI that allows you to easily view gauges, counters, field-value counters and aggregate counters.
• Performance improvements for the Kafka Message Bus that places it on par with the performance benchmark applications that ship with Kafka. An upcoming blog will discuss XD performance in more detail
• Improved HA support for the Rabbit Message Bus, XD containers connect to the Rabbit Broker that hosts the queue that is being consumed
• Support for the Sqoop metastore and other …

On behalf of the Spring XD team, I am very pleased to announce the first milestone release of Spring XD 1.2 and the 1.1.2 maintenance release.

Download Links:

• 1.1.2.RELEASE: zip
• 1.2.0.M1: zip

You can also install using brew and rpm

The full list of issues fixed for 1.1.2 is available in JIRA. Of note the 1.1.2 release provides PHD 3.0 support.

The 1.2 M1 release includes bug fixes as well and several new features and enhancements:

• PHD 3.0 support
• MongoDB Source, a community contribution from Abhinav Gandhi
• Module registry backed by HDFS
• Greenplum gpload as provided batch job. This allows for efficient loading from CSV files into Greenplum DB/HAWQ.
• gpfdist sink that adheres to the gpfdist protocol. This allows for streaming data in parallel into Greenplum DB/HAWQ.
• Zookeeper distributed queue based deployment for streams and jobs.
• Improved error handling for RabbitMQ with Dead Letter Queue and durable queue support for pub/sub named channels (tap: and topic:)
• Sqoop integration improvements…

On behalf of the Spring XD team, I am very pleased to announce the
first maintenance release of Spring XD 1.1.

Download Link: 1.1.1.RELEASE: zip and brew.

The 1.1.1 release includes bug fixes and some enhancements. The full list of tickets is available in our JIRA.

Here are some highlights.

• Improved performance and offset management when using Kafka message bus.
• Support for Spark Streaming's reliable receiver.
• Kryo serialization improvements.
• Option to clean up Rabbit queue/topics when deleting the stream.
• Add a Sqoop example

Feedback is very important, so please get in touch with…

Six months after the 1.0 GA release, the team is happy to announce the availability of Spring XD 1.1 GA.

Download Links:

• 1.1.0.RELEASE: zip, homebrew, yum.
• 1.0.4.RELEASE: zip.

Please read Sabby Anandan's blog for a general overview of Spring XD. Specific to 1.1, a ton of features have been added. Here are some that will give you the most bang for your big data buck.

• Stream Processing with Reactor, RxJava, Spark Streaming and Python
• Orchestrate Spark and Sqoop Batch Jobs
• Kafka based message bus, source and sink along with new general purpose high level Kafka APIs
• Batching and compression for RabbitMQ
• Easily develop, test, and package custom modules and upload them to the admin server.
• Containers group management when running XD on YARN
• Role based authorization of REST endpoints and LDAP/file based authentication
• Support for Pivotal, Hortonworks, and Cloudera Hadoop distributions.
…

On behalf of the Spring XD team, I am very pleased to announce that the Spring XD 1.1 Release Candidate is now available for download.

The 1.1 RC1 release includes several new features as well as bug fixes.

One theme in the 1.1 release is around Stream processing. The 1.1 M2 version introduced support for Reactor’s Stream API in processing modules. The 1.1 RC1 release adds support for stream processing using RxJava’s Observable API and Spark Streaming alongside the existing Spark job support. By providing a range of options, you can pick the functional programming model that best suits the…

On behalf of the Spring XD team, I am very pleased to announce the second milestone release of Spring XD 1.1 and the 1.0.3 maintenance release.

Download Links:

• 1.1.0.M2 RELEASE: zip, 1.0.3.RELEASE: zip

The 1.1 M2 release includes bug fixes and enhancements as well as several new features:

• Kafka based Message Bus. If Kafka is your middleware du jour, you will feel right at home.
• Batching and compression support for RabbitMQ provides significantly increased effective message rate throughput.
• Develop Processor modules using Project Reactor’s Stream API. The Stream API is based on the Reactive Streams specification that provides a standard for asynchronous stream processing with non-blocking backpressure. This allows you to use a functional programming model as the basis for processing event streams. Combined with XD’s support for Data Partitioning on the Message Bus…

On behalf of the Spring XD team, I am very pleased to announce the first milestone release of Spring XD 1.1 and the 1.0.2 maintenance release.

Download Links:

• 1.0.2.RELEASE: zip, 1.1.0.M1 RELEASE: zip

In addition to bug fixes, Spring XD 1.0.2 now supports Apache Hadoop 2.5.1. Pivotal PHD 2.1 and Cloudera CDH 5.1.3.

The 1.1 M1 release includes bug fixes and enhancements as well as several new features:

• Run a Spark Application as a batch job
• Python based processors and sinks
• Kafka source and sink
• HDFS sink supports writing to a Kerberized Hadoop Cluster
• LDAP Authentication
• Modules can be created using Java @Configuration classes as an alternative to XML
• Redis sink and JDBC Source
• Hadoop distribution updates. Support for Apache Hadoop 2,4.1/2.5.1 (default), Pivotal PHD 2.0/2.1, Cloudera CDH 5.2, and Hortonworks HDP 2.1. Apache Hadoop 2.2 support was removed
• Configurable location of Spring XD’s top level node in Zookeeper
…