Ilayaperumal Gopinathan

Ilayaperumal Gopinathan

Ilayaperumal Gopinathan is a software engineer at the Spring team focusing on data-centric and event driven ecosystem. Prior to this, he was a co-lead on Spring Cloud Data Flow ecosystem of projects and a committer on Spring Cloud Stream, Spring XD. Ilaya also worked on products such as vFabric App Suite, Cloud Foundry, and Hyperic at VMware.

Blog posts by Ilayaperumal Gopinathan

From Spring Cloud Data Flow 2.11.x to 3.0

Engineering | October 07, 2024 | ...

Dear Spring Community,

With the recent announcement of Spring Framework 7.0 and Spring Boot 4.0, the Spring Cloud Data Flow team is pleased to announce the next major release, SCDF 3.0, to align with both Spring Framework 7.0 and Spring Boot 4.0.

This will bring the following SCDF ecosystem of projects in line with Spring Framework 7.0 and Spring Boot 4.0:

  • Spring Cloud Data Flow server components (SCDF core and Skipper servers)
  • Composed Task Runner, SCDF Shell, Single Step Batch Job, and Task Launcher
  • Spring Cloud Deployer Implementations for both Cloud Foundry and Kubernetes
  • Spring Cloud Data Flow UI
  • Spring Cloud Stream/Task workloads based on Spring Boot 4.0

Spring Cloud Data Flow 2.6.4 and 2.7.0 Released

Engineering | December 02, 2020 | ...

Spring Cloud Data Flow team is pleased to announce the release of 2.7.0 and 2.6.4

While the release 2.6.4 has the bug fixes, the 2.7.0 has the following updates along with the bug fixes and improvements :

SCDF dashboard re-design using VMware Clarity toolkit

SCDF dashboard is re-designed using VMware Clarity design system. This is a complete rewrite of SCDF dashboard GUI to get the benefits of the Clarity design.

Spring Boot 2.3. Update

SCDF server components are now updated to use Spring Boot 2.3.5 release.

Wavefront integration

Spring Cloud Data Flow dashboards for streams, tasks, SCDF server components and Kafka Streams dashboard are available in VMware Wavefront dashboards for integrations. The configurations required to set up the wavefront integration are simplified at the SCDF as well. More information on this can be found here

Spring Cloud Data Flow 2.7.0-M1 and 2.6.3 Released

Engineering | September 29, 2020 | ...

Spring Cloud Data Flow team is pleased to announce the release of 2.7.0-M1 and 2.6.3

While the release 2.6.3 has the bug fixes, the first milestone of 2.7.0 has the following enhancements:

SCDF dashboard re-design using VMware Clarity toolkit

SCDF dashboard is re-designed using VMware Clarity design system. This is a complete rewrite of SCDF dashboard GUI to get the benefits of the Clarity design.

Spring Boot 2.3.2 Update

SCDF server components are now updated to use Spring Boot 2.3.2 release.

Wavefront integration

Spring Cloud Data Flow dashboards for streams, tasks and SCDF server components…

Spring Cloud Data Flow 2.6.0-M1 Released

Engineering | June 11, 2020 | ...

Spring Cloud Data Flow team is pleased to announce the first milestone release of 2.6.0.

This 2.6.0-M1 adds some bug fixes and the following features:

  • Composed Task Runner as SCDF native module Composed Task Runner is now an integral part of SCDF itself and gets registered implicitly while the users who have the custom composed task runner can still override the native one. This enables us to integrate the composed tasks management within the context of Spring Cloud Data Flow. This change also allowed us to provide some additional user experiences when managing composed tasks. .

  • Improvements in task applications management This milestone added some improvements at the backend such as the ability to uniquely identify the task elements inside the composed task, adding task manifest as part of the last ran task definition, ability to cleanup task related resources as part of task definition cleanup along with the SCDF dashboard changes.

Spring Cloud Data Flow 2.5.0.RC1 Released

Engineering | April 23, 2020 | ...

Spring Cloud Data Flow team is pleased to announce the first milestone release of 2.5.0.RC1.

This first release candidate of 2.5.0 adds some bug fixes and the following features:

  • Support application metadata as part of the Container images. Before this release, we only supported application property whitelisting when using a maven artifact.

  • Support for Azure AD integration using OAuth 2.0. Spring Cloud Data Flow, Spring Cloud Skipper servers along with the Spring Cloud Data Flow shell can be configured to integrate with Azure AD for authentication and authorization.

  • Removal of Scheduler task launcher component when scheduling tasks. In Spring Cloud Data Flow 2.3.x, the scheduling of tasks was designed to have an intermediate scheduler task launcher component to enhance the continuous deployment user experience. Since this component added some additional complexities and overhead on Kubernetes, the 2.5.x release removed this intermediary task launcher. We also added a migration tool to migrate the schedules from 2.3.x and 2.4.x

Spring Cloud Data Flow 2.5.0.M1 Released

Engineering | March 20, 2020 | ...

Spring Cloud Data Flow team is pleased to announce the first milestone release of 2.5.0.M1.

The first milestone release of 2.5.0 consists of performance improvements addressed at application status retrieval for streams in Cloud Foundry. This also involves revamping the runtime application view page along with better pagination for streams at the SCDF dashboard. You can see more information on these improvements on the recently released SCDF 2.4.2 GA.

This milestone release also consists of some important bug fixes mentioned in here

Please note that Spring Cloud Data Flow 2.5.x is compatible…

Spring Cloud Data Flow 2.4.2 GA Released

Engineering | March 11, 2020 | ...

Spring Cloud Data Flow team is pleased to announce the GA release of 2.4.2.

In this release, along with some bug fixes, we primarily focused on the server/client-side performance improvements on the stream management.

The REST layer in Spring Cloud Data Flow server is refactored to accommodate better pagination and performance when retrieving the runtime application statuses of streams. In addition to that, the SCDF dashboard pages are re-worked based on these changes. The Runtime Applications page in the Dashboard has a new layout where the runtime applications are grouped by their streams. The Streams page is also refactored to efficiently retrieve the stream status, application…

Spring Cloud Data Flow 2.3.0.M1 and 2.2.1 GA Released

Engineering | September 06, 2019 | ...

The Spring Cloud Data Flow team is pleased to announce the milestone release 2.3.0.M1 and the release of 2.2.1 GA.

Along with the bug fixes and enhancements, the first milestone of 2.3.0 also has the following new features:

  • Improved Prometheus monitoring based on Prometheus RSocket. It uses persistent bidirectional (RSocket) connections between the Stream/Task applications and a Prometheus RSocket Proxy instance. When Prometheus scrapes the proxy instance, and the proxy, in turn, uses the connections to pull metrics from the applications.
  • Ability to pass OAuth Access Token as command-line arguments for Composed Tasks
  • Users can now specify a description of the stream when creating it. Thanks to Daniel Serleg for the contribution!
  • Spring Cloud Scheduler SPI is now merged into Spring Cloud Deployer. We’ll deprecate the explicit spring-cloud-scheduler project and its implementations on Cloud Foundry, K8s and have them available as part of spring-cloud-deployer

Spring Cloud Data Flow 2.2.0.M1 Released

Engineering | July 09, 2019 | ...

The Spring Cloud Data Flow team is pleased to announce the milestone release 2.2.0.M1.

Along with some enhancements and bug fixes, here are some of the highlights of the release:

Metrics for Tasks Metrics and monitoring continue to be one of the important themes for Spring Cloud Data Flow. Building upon the InfluxDB integration that we have for streams, in 2.2, we are adding support for Tasks, too. The core of the Micrometer integration landed in Spring Cloud Task's 2.2.0 release-line, which by the way is a requirement if you are going to try out the Task-metrics and the SCDF integration.

For convenience, we have a sample application that builds on the compatible upstream versions of Spring Boot, Spring Batch, and Spring Cloud Task. With this application launched in SCDF, you are now able to instrument metrics with InfluxDB as the backend, and likewise visualize the statistics…

Spring Cloud Data Flow 2.1.2 GA and 2.0.3 GA Released

Engineering | June 26, 2019 | ...

The Spring Cloud Data Flow team is pleased to announce the release of 2.1.2 GA and 2.0.3 GA of Data Flow.

This is a minor release with mostly bug fixes and documentation enhancements.

Here are the highlights of the releases:

  • Bug fixes on Spring Cloud Data Flow, Spring Cloud Data Flow UI and Spring Cloud Scheduler for CloudFoundry

  • Java Stream DSL now supports stream update operation

  • Spring Cloud Deployer now uses Maven Resolver instead of Aether for resolving the Maven artifacts

Along with the releases, we also have the Spring Cloud Data Flow website enhanced with

  • Responsive Design

  • More receipes and use cases discussion

  • Documentation fixes

Get ahead

VMware offers training and certification to turbo-charge your progress.

Learn more

Get support

Tanzu Spring offers support and binaries for OpenJDK™, Spring, and Apache Tomcat® in one simple subscription.

Learn more

Upcoming events

Check out all the upcoming events in the Spring community.

View all