The Spring Blog

Engineering

Releases

News and Events

Spring Cloud Data Flow 1.2.1 released

May 25, 2017

On behalf of the Spring Cloud Data Flow team, I’m pleased to announce the release of Spring Cloud Data Flow and Spring Cloud Data Flow for Cloud Foundry 1.2.1.RELEASE. This release provides several improvements around OAuth2 authorization.

Here are the relevant links to documentation and getting started guides.

Local: Quick Start, Getting Started Guide
Cloud Foundry: Getting Started Guide

Spring Cloud Data Flow now provides role support for OAuth2, converging with the VIEW, CREATE, MANAGE roles that Data Flow supports when using the traditional security option. Considering the varying use-case requirements across organizations in regards to security roles, the out-of-the-box implementation will assign all the VIEW, CREATE, MANAGE roles to the OAuth authenticated user. However, this can be customized by providing your own AuthoritiesExtractor.

Spring Cloud Dalston SR1

Releases

Spencer Gibb

May 24, 2017

On behalf of the community, I am pleased to announce that the Service Release 1 (SR1) of the Spring Cloud Dalston Release Train is available today. The release can be found in Maven Central. It is mostly a bugfix and documentation update. You can check out the Dalston release notes for more information.

The following modules were updated as part of Dalston.SR1:

Module	Version
Spring Cloud Aws	1.2.1.RELEASE
Spring Cloud Bus	1.3.1.RELEASE
Spring Cloud Commons	1.2.2.RELEASE
Spring Cloud Config	1.3.1.RELEASE
Spring Cloud Consul	1.2.1.RELEASE
Spring Cloud Contract	1.1.1.RELEASE
Spring Cloud Netflix	1.3.1.RELEASE
Spring Cloud Security	1.2.1.RELEASE
Spring Cloud Sleuth	1.2.1.RELEASE
Spring Cloud Stream	Chelsea.SR2
Spring Cloud Vault	1.0.1.RELEASE
Spring Cloud Zookeeper	1.1.1.RELEASE

This Week in Spring - May 23rd, 2017

Engineering

Josh Long

May 23, 2017

Welcome to another installment of This Week in Spring! This week I’m in Amsterdam, NL and Essen, DE, talking to customers about cloud-native transformation. We’ve got a lot to cover so let’s get to it.

Spring Tool Suite lead Martin Lippert just announced a preview of Concourse Pipeline and Cloud Foundry manifest editing support releases as a language server. These language servers can be used by any IDE or text editor that supports them, including in this case Microsoft’s Visual Studio Code and later STS itself.
Spring Cloud Stream ninja Soby Chako just announced Spring Cloud Stream.SR2
Simon Baslé just announced the Reactor Bismuth release train M1
Stéphane Nicoll just announced Spring Boot 2.0M1! It’s finally here! Get the bits of the first major release towards a reactive Spring Boot 2.0. There’s so much good stuff, including an updated Gradle plugin, relaxed binding improvements, major dependency upgrades and so much more!
I think this article by Paweł Chudzik on poor man’s batch solutions - iterating over large datasets - was very interesting. The conclusion is obvious: if you want to scroll through a large amount of records then use a java.util.Stream<T> finder query in your Spring Data repository. That’s one obvious conclusion. May I also humbly recommend that you look at Spring Batch and have a rich man’s batch at poor man’s prices? :)
Want easier handling form encoded JSON in Spring MVC? Vote for this issue!
I liked this walk through on how to implement a forgot password flow with Spring Boot on the Code by Amir blog by Amir Boroumand.
Amir Boroumand also has a nice walkthrough on creating a REST API with Spring Boot
Our friends at JDriven are doing what appears to be an awesome (though I think Dutch-language) on MQTT and Spring Cloud Stream and Spring Cloud Data Flow
I liked this fairly approachable look at how to deploy Hashicorp Vault to Cloud Foundry by our very own Toshiaki Maki.
Want a bit of insight into what the future of Serverless looks for Spring? Check out the slides to the good Dr. Dave Syer’s presentation on Spring Cloud Function at Spring IO
WeaveWorks’ Scope is now available and supports Cloud Foundry
I liked this rant from Steve Yegge on why Kotlin is a nice language. Interesting reading!

New beta versions of Concourse pipeline and Cloud Foundry manifest editing support released for Visual Studio Code

Releases

Martin Lippert

May 18, 2017

Back in February 2017 we started to introduce new IDE-agnostic tooling support with our first beta version of the Cloud Foundry manifest editing support. As promised, we continue this journey with an improved version of the Cloud Foundry manifest editing support for Visual Studio Code and brand-new support for editing Concourse task and pipeline definitions - also as an extension to Visual Studio Code. This marks our second step towards implementing tooling in an IDE-agnostic way, adopting the language server protocol from Visual Studio Code.

Spring Cloud Stream Chelsea.SR2 Released

Releases

Soby Chacko

May 17, 2017

On behalf of the community, I am happy to announce the release of Spring Cloud Stream Chelsea.SR2. This is the second general availability release in the Chelsea release train, which fixes a number of issues over Chelsea.SR1.

The new release is available in Maven Central, and a detailed description of its features can be found in the reference documentation. For information about artifacts and most recent changes, please consult the release notes.

What is next:

After the release, we will start working on the next Spring Cloud Stream release train, named Ditmars, as well as expand the Spring Cloud Stream ecosystem. In parallel with developing the Ditmars release train, we will start work on the Elmhurst release train which will be based on Spring Framework 5 and Spring Boot 2.

Reactor Bismuth release train first milestone available

Releases

Simon Baslé

May 16, 2017

On behalf of the Reactor team, it is my pleasure to announce that Reactor hit an important milestone last week, making the Bismuth-M1 release train available.

This first milestone backs the newly released Spring Framework 5 RC1. It notably includes version 3.1.0.M1 of reactor-core, reactor-test and reactor-extra.

As the 3.1.x generation is slated to be the long term support branch (as is appropriate for a version that backs the Spring framework), focus has been on stabilizing and polishing the API. As such, expect some breaking changes from the 3.0.x versions ^[1].

Spring Boot 2.0.0 M1 Available Now

Releases

Stéphane Nicoll

May 16, 2017

On behalf of the team and everyone that contributed, I am pleased to announce that the first milestone of Spring Boot 2 has been released and is available from our milestone repository. This release closes over 300 issues and pull requests!

This first milestone builds on and requires Spring Framework 5.0.RC1. There are a number of nice refinements in Spring Framework 5 including extensive support for building reactive applications.

Highlights of this first milestone include:

A complete rewrite of the Gradle plugin (including a dedicated guide)
Support of reactive web applications development using WebFlux or WebFlux.fn: dedicated spring-boot-starter-webflux starter using Netty by default, support for @WebFluxTest for testing your reactive controller and reactive data support for MongoDB, Redis and Cassandra
Major dependencies upgrade across the portfolio: Spring Data Kay M3, Spring Security 5.0 M1, Spring Integration 5.0 M4, Spring AMQP 2.0 M4, Spring Session 2.0 M1 and Spring Batch 4.0 M2
Relaxed binding has been improved

This Week in Spring - May 16th, 2017

Engineering

Josh Long

May 16, 2017

Welcome to another installment of This Week in Spring! This week I am in Munich for the Spring Meetup; Berlin for OSDC; Krakow for Geecon; Barcelona for Spring I/O, and Eindhoven for NextBuild. If you’re around, say hi.

As usual, we’ve got a lot to cover so let’s get to it!

Dr. Mark Pollack just announced Spring Cloud Data Flow 1.2GA!, including the server editions for local, Kubernetes, YARN and Cloud Foundry. This new release is packed with good stuff. I particularly like the support for composed tasks, which lets me orchestrate a flow of tasks as a cohesive unit-of-work. This is ideal for complex ETL pipelines. It even includes support for sequential, parallel, and conditional sequence transitions. And, of course, all of this can be mixed-and-matched. Previously, to get this kind of power, you had to manually wire up remote partitioning in a Spring Batch job. Or setup some very complicated Spring Integration flow. And neither would’ve given me everything this does. It also includes support for better runtime visibility into what is happening, OAuth support, role-based access, and much more. This is a very cool release! Get the bits and try it out now!
Spring Boot 2.0M1 has just been released!
Spring Batch 4 keeps chugging along! The new milestone includes updates to the Java configuration API (new builders!) and dependdency updates.
Spring REST Docs lead Andy Wilkinson has just published a maintenance release
Spring Security lead Rob Winch just announced the first Milestone of the new 5.0 line. The new release includes OAuth 2.0 and OpenID connect 1.0 support as well as reactive integration!
never one to rest, Rob also announced Spring Session 2.0 M1 which integrates with Spring Framework 5.
there are exciting changes a brewin’ in the new Pivotal Spring education. Paul Chapman has the details here
Spring Data ninja Mark Paluch just announced Spring Data Kay M3. This release includes a raft of updates to the various data stores and improved support for reactive tailable cursors in MongoDB, among other things.
check out this example on how to introduce Zipkin into a traditional XML Spring app
Cereebro, a fine microservice dashboard that works with Spring Cloud, has just reached 1.0
BOSH, which lets you deploy and manage services, has just gotten considerably simpler!
check out this handy Reactive Thymeleaf example
I liked this presentation which introduces consumer driven contract testing
Alex Soto is back with a second installment on how to test Spring Boot applications using Arquillian
This Tensorflow integration for Spring Cloud Data Flow looks awesome
Not strictly Spring specific, but I liked this resource on how and where to apply Kotlin on the server side

Spring Cloud Data Flow 1.2 GA released

Releases

Mark Pollack

May 15, 2017

On behalf of the team, I am pleased to announce the general availability of Spring Cloud Data Flow 1.2 across a range of platforms

Here are the relevant links to documentation and getting started guides.

Local: Quick Start, Getting Started Guide
Cloud Foundry: Getting Started Guide
YARN: Getting Started Guide
Kubernetes: Getting Started Guide

Highlights of the 1.2 release:

Composed Tasks

This release introduces Composed Tasks ! This feature provides the ability to orchestrate a flow of tasks as a cohesive unit-of-work. A complex ETL pipeline may include executions in sequence, parallel, conditional transitions, or a combination of all of the above. The composed task feature comes with DSL primitives and an interactive graphical interface to quickly build these type of topologies more easily. You can read more about it from the reference guide.

An ETL job, for example, may include multiple steps. Each step in the topology can be built as a finite short-lived Spring Cloud Task application. The orchestration of multiple tasks as steps can be easily defined with the help of the Data Flow Task DSL.

task create simple-etl --definition "extractDbToHDFS &&
      <analysisInSpark || enrichAndLoadHawq> &&
      <populateMgmtDashboard || runRegulatoryReport || loadAnalyticsStore>"

This will first run extractDbToHDFS and then run analysisInSpark and enrichAndLoadHawq in parallel, waiting for the both of them to complete before running the three remaining tasks in parallel and waiting for them to all complete before ending the job. The graphical representation of this topology looks like the following.

Real-time Metrics and Monitoring

Real-time metrics are now part of the operational view of deployed streams. The applications that are part of a stream publish metrics contained in their Spring Boot /metrics actuator endpoint. This includes send and receive messages rates. A new server, the Spring Cloud Data Flow Metrics Collector, collects these metrics and calculates aggregate message rates. The Data Flow server queries the Metrics Collector to support showing message rates in the UI and in the shell. For more details about the architecture, refer to the Monitoring Deployed Applications Section in the reference guide.

The screenshot below shows the aggregate message rates for a time | log stream with three instances of the time and log applications. Each dot below the main application box shows the message rates for each individual application along with a guid value that can be used to identify the application on the platform where they are running.

Visualization of Input and Output Rates in Flo

The Runtime tab, shown below, also had improvements to show message rates and any other metrics exposed by the platform. For the script savvy users, the shell experience also includes these details via the runtime apps command.

Companion Artifact

The companion artifact support introduced in 1.2 M3 has had some improvements. The bulk registration workflow now eagerly resolves and downloads the metadata artifacts for all the out-of-the-box applications. This comes handy in the Shell or UI when reviewing the supported properties for each application.

OAUTH Improvements

This change will provide an additional option for REST-API users. Instead of providing a username:password combination via BasicAuth, users will now have the ability to retrieve an OAuth2 Access token from their OAuth2 provider directly and then provide the Access Token in the HTTP header, when invoking RESTful calls against a secured Spring Cloud Data Flow setup.

Role based access

Add role-based access control to define who has access to create, deploy, destroy, or view streams/tasks. This works seamlessly in coordination with the supported authentication methods.

Bug reporting

A new REST endpoint and About page in the Dashboard to collect server implementation details to the clipboard for use in bug reporting.

Spring Cloud Stream App Starters - Bacon.RELEASE

The Stream App Starters Bacon.RELEASE is now generally available which provides you a range of sources, processors, and sinks to get started creating stream. All the out-of-the-box stream applications build upon Spring Cloud Stream Chelsea.RELEASE and Spring Cloud Dalston.RELEASE foundation. There were several enhancements and bug-fixes to the existing applications and this release-train also brings new applications such as MongoDB-sink, Aggregator-processor, Header-Enricher-processor, and PGCopy-sink.

For convenience, we have generated the bit.ly links that includes the latest coordinates for docker and maven artifacts.

Spring Cloud Task App Starters - Belmont.RELEASE

The Task App Starters Belmont.RELEASE release is now complete. To support Composed Task feature in Spring Cloud Data Flow, we have added a new out-of-the-box application named Composed Task Runner. This is a task that executes others tasks in a directed graph as specified by a DSL that is passed in via the --graph command line argument.

The Belmont.RELEASE builds upon Spring Cloud Task 1.2 RELEASE and Spring Cloud Dalston.RELEASE foundation.

For convenience, we have generated the bit.ly links that includes the latest coordinates for docker and maven artifacts.

What’s Next?

An immediate goal is adding more automated integration tests and to expose this as an additional user facing feature. You can track that work here.

Beyond the 1.2.x line, we are going to start planning for the 2.0 version. Some general themes are support for deploying individual applications and keeping track of application deployment properties and metadata such as the application version. This functionality would build up into supporting a rich Continuous Delivery theme at the application level that also extends to "editing" streams at runtime. In addition, we are also looking into supporting functions, either "in-line" as Java code or compiled java.util.Function s to be a first class programming model for data processing a stream.

Feedback is important. Please reach out to us in StackOverflow and GitHub for questions and feature requests. We also welcome contributions! Any help improving the Spring Cloud Data Flow ecosystem is appreciated.

Spring Batch 4.0.0.M2 is now available

Releases

Michael Minella

May 15, 2017

We are pleased to announce that Spring Batch 4.0.0.M2 is now available via Github and the Pivotal download repository. This release represents the second milestone for the Spring Batch 4.0 release. Many thanks to all that contributed to this release.

What’s new?

This milestone continues the work laid out in Spring Batch 4.0.0.M1. Specific updates include:

Dependency updates
Continued java configuration improvements

Dependency updates

Spring Batch 4 will be the version included in Spring Boot 2 so we’re taking this time to syncronize our dependencies. With that, this release supports upgrades to the latest milestones of the Spring Data Kay release train and Spring Integration 5.

...

265