Spring for Apache Hadoop 2.3 Milestone 2 released
We are pleased to announce the Spring for Apache Hadoop 2.3 M2 milestone release.
The most important enhancements in this release:
- New batch tasklets: Support for running a simple Spark app [SHDP-397] and for running a simple Sqoop2 Job [SHDP-506]
- Better boot support: Add jobHistoryAddress to SpringHadoopProperties for Boot configuration [SHDP-517]
- YARN: Support dots in yarn container group names [SHDP-515]
See the release changelog for details.
The new support for running a Spark job on YARN via a Spring Batch tasklet opens possibilities for integrating Spark tasks in a larger Spring Batch flow We will show a simple example of this at the upcoming SpringOne 2GX conference during our "Hadoop Workflows and Distributed YARN Apps using Spring technologies"…