Spring for Apache Hadoop 2.3 Milestone 2 released

Releases | Thomas Risberg | August 20, 2015 | ...

We are pleased to announce the Spring for Apache Hadoop 2.3 M2 milestone release.

The most important enhancements in this release:

  • New batch tasklets: Support for running a simple Spark app [SHDP-397] and for running a simple Sqoop2 Job [SHDP-506]
  • Better boot support: Add jobHistoryAddress to SpringHadoopProperties for Boot configuration [SHDP-517]
  • YARN: Support dots in yarn container group names [SHDP-515]

See the release changelog for details.

The new support for running a Spark job on YARN via a Spring Batch tasklet opens possibilities for integrating Spark tasks in a larger Spring Batch flow We will show a simple example of this at the upcoming SpringOne 2GX conference during our "Hadoop Workflows and Distributed YARN Apps using Spring technologies" presentation. In this presentation we'll also explore how Hadoop based apps can take advantage of a cloud-native development approach.

We continue to provide version specific artifacts with their respective transitive dependencies in the Spring IO milestone repository:

  • 2.3.0.M2 (default - Apache Hadoop stable 2.7.1)
  • 2.3.0.M2-hadoop26 (Apache Hadoop 2.6.0)
  • 2.3.0.M2-phd30 (Pivotal HD 3.0)
  • 2.3.0.M2-cdh5 (Cloudera CDH 5.4)
  • 2.3.0.M2-hdp23 (Hortonworks HDP 2.3)

Please provide feedback so we can prioritize the work on new features scheduled for 2.3 (see previous blog post for a list) and any additional feature requests. You can use JIRA issues or GitHub issues (see project page for links).

The project page is at - http://projects.spring.io/spring-hadoop/

Get the Spring newsletter

Stay connected with the Spring newsletter

Subscribe

Get ahead

VMware offers training and certification to turbo-charge your progress.

Learn more

Get support

Tanzu Spring offers support and binaries for OpenJDK™, Spring, and Apache Tomcat® in one simple subscription.

Learn more

Upcoming events

Check out all the upcoming events in the Spring community.

View all