The Spring Cloud Data Flow team is pleased to announce the milestone release 2.2.0.M1.
Along with some enhancements and bug fixes, here are some of the highlights of the release:
Metrics for Tasks
Metrics and monitoring continue to be one of the important themes for Spring Cloud Data Flow. Building upon the InfluxDB integration that we have for streams, in 2.2, we are adding support for Tasks, too. The core of the Micrometer integration landed in Spring Cloud Task’s 2.2.0 release-line, which by the way is a requirement if you are going to try out the Task-metrics and the SCDF integration.
For convenience, we have a sample application that builds on the compatible upstream versions of Spring Boot, Spring Batch, and Spring Cloud Task. With this application launched in SCDF, you are now able to instrument metrics with InfluxDB as the backend, and likewise visualize the statistics through Grafana dashboard as shown below.
A set of REST endpoints are now available to access the application logs of stream and task applications. Currently, this is available for applications running in Cloud Foundry and Kubernetes platforms. In the upcoming releases, we’ll have the Dashboard access to viewing the stream/task application logs along with the Local platform support.
Patching Database Drivers
The community members and the customers who attempted to patch Spring Cloud Data Flow with proprietary database drivers have had the option to clone and build the project locally. There’s another option, though. The procedure is now documented for both Maven and Gradle users.
To further improve the quality of software that we build and to have more confidence in what we ship, we have invested time to cycle through and overhaul the acceptance-tests. We are now continually running the acceptance-tests on Local, Pivotal Cloud Foundry, Kubernetes (GKE), and PKS.
Apache Kafka, RabbitMQ, File-ingest and ETL in K8s/CF, and Amazon Kinesis recipes are now available in the latest Spring Cloud Data Flow website. Given all the content is coded as markdown files, it is easy for the community to contribute, so feel free to start the dialog with pull-requests - we are looking forward to your contributions here