Spring Team
Janne Valkealahti

Janne Valkealahti

Spring Data Hadoop Engineer

London, UK

Janne is a member of Spring Data team focusing on "Spring for Apache Hadoop", "Spring YARN" , "Spring Statemachine" and "Spring XD". After spending 10 years handling IT systems in a Finnish bank he joined SpringSource and has called London his home for past few years.
Blog Posts by Janne Valkealahti

Spring Statemachine Goes Reactive with 3.0.0.M1

I’m pleased to announce a first milestone release of a Spring Statemachine 3.0.0.M1 and with these words I can say that Statemachine is going reactive.

Statemachine itself would not need to be reactive for its own execution but as soon as machine steps outside of its controlled environment to execute user defined logic like Actions and Guards there is no guarantees that those features would not block.

Those using persisting features with a databases will benefit with reactive changes when that side of a world becomes more reactive. Essentially every time we need to take a step outside from a machine world we may hit blocking IO operations.

Read more...

Spring Cloud Data Flow 2.2.0 Released

The Spring Cloud Data Flow team is pleased to announce the GA release of 2.2.0.

In this GA release, Spring Cloud Data Flow team has worked on some of the key features including task application management, stability on the product by increasing the acceptance tests coverage across platforms (local, Kubernetes and Cloud Foundry), bug fixes and enhancements.

Task Application Management

It is now possible to stop and delete task executions using the SCDF Dashboard and the Shell.
We have added support for task application monitoring using micrometer integration. The core of the Micrometer integration landed in Spring Cloud Task’s 2.2.0 release-line, which by the way is a requirement if you are going to try out the Task-metrics and the SCDF integration.

Read more...

Spring Cloud Data Flow 2.1.0.M1 released

The Spring Cloud Data Flow team is pleased to announce the release of a 2.1.0 M1 milestone-release. Follow the Getting Started guides for running on Local, Cloud Foundry, and Kubernetes.

What’s new?

SCDF Helm Chart and Apache Kafka

With continued interest from the community, as of v2.0.2, we have now added support to toggle between RabbitMQ and Apache Kafka when using SCDF’s helm chart. Though the chart is in the PR status in Helm repository, you could still try it out and give us feedback.

Docker Compose and Apache Kafka

Read more...

Spring Statemachine 1.2.0 Released

We’re pleased to announce a release of Spring Statemachine 1.2.0.RELEASE. Artifacts are available either from Maven Central or from Spring Repository.

Let’s see what we did for this initial 1.2.x release

  • Usual bug fixes and small enhancements.
  • Support for UML submachines.
  • New Spring Data Repository abstraction keeping machine configurations in an external repository with built-in support for Redis, MongoDB and JPA.
  • New samples.
  • New support for state do actions.
  • New monitoring and tracing API’s.
  • Initial support for Spring Boot auto-config.
  • New transition and state error action concepts.
Read more...

Spring Statemachine 1.2.0.RC1 Released

We’re pleased to announce a release candicate of Spring Statemachine 1.2.0.RC1. Artifacts are available from Spring Repository.

What we got into this release:

  • Usual bug fixes and small enhancements
  • New api’s for tracing and monitoring
  • New monitoring sample
  • Full repository config support for Redis, MongoDB and JPA
  • Boot auto-config enhacements
  • Lot of documentation enhacements

Full changes as usual are available from changelog. We’re planning to fire up 1.2.0.RELEASE before xmas and possibly do a second release candicate if any major issues are found.

Read more...

Spring Cloud Data Flow for Apache YARN 1.1.0.RC1 released

On behalf of the Spring Cloud Data Flow team, I am pleased to announce the 1.1.0.RC1 release of Spring Cloud Data Flow for Apache YARN.

Spring Cloud Data Flow for Apache YARN allows one to use all the goodness of Spring Cloud Data Flow (like the Shell and UI) while targeting Apache YARN as a backend. Stream components are deployed as individual apps in Apache YARN, leveraging the power of the platform to handle scaling and health monitoring.

This first release candicate

  • Builds upon Spring Cloud Data Flow 1.1.0.RC1 and Spring Cloud Deployer 1.1.0.RC1.
  • Support for keeping multiple deployer versions in hdfs.
  • Preparation of supporting upgrades on Ambari when these become available with Ambari future versions.
Read more...

Spring Statemachine 1.2.0.M1 Released

We’re pleased to announce a first milestone release of Spring Statemachine 1.2.0.M1. Artifacts are available from Spring Repository.

What we got into this first milestone:

  • Usual bug fixes and small enhancements
  • Support for UML submachines
  • New Repository abstraction keeping machine configuration in an external repository
  • New support for state actions.
  • New transition error action concepts

There has been a support for complex state hierarchy from a day one but trouble was that everything had to be defined in a same state configuration. New submachine support adds a feature where a state can be associated with other machine which allows some level of re-use and makes configuration more clean.

Read more...

Spring Cloud Data Flow for Apache YARN 1.0.2 released

We are pleased to announce the release of Spring Cloud Data Flow for Apache YARN 1.0.2.RELEASE.

Spring Cloud Data Flow for Apache YARN provides support for orchestrating long-running (streaming) and short-lived (task/batch) data microservices on Apache YARN.

Apart from usual minor fixes, we have worked on the following themes.

  • Builds upon Spring Cloud Data Flow’s 1.0.1.RELEASE
  • Support for Apache Ambari 2.4
  • Adds Apache Ambari installation of Spring Cloud Data Flow for HDP 2.5 stack
  • UX improvements around Apache Ambari configuration settings and quicklinks
  • Adds support to interact with kerberized Apache Kafka cluster
  • Yarn deployer APIs and the auto-configuration improvements
  • Certification of partitioned batch-jobs running as short-lived Tasks in YARN
  • Improved documentation
Read more...

Spring Cloud Data Flow for Apache YARN 1.0.1 released

We are pleased to announce the release of Spring Cloud Data Flow for Apache YARN 1.0.1.RELEASE.

Spring Cloud Data Flow for Apache YARN provides support for orchestrating long-running (streaming) and short-lived (task/batch) data microservices on Apache YARN.

Apart from usual minor fixes, we have worked on the following themes.

  • Support for kerberos and integration to automated ambari kerberos setup.
  • Support for HDFS HA Namenode setup.
  • New extension to dataflow-shell adding hadoop fs basic commands.

For a complete list of changes and improvements, please refer to
1.0.1.RELEASE server release, 1.0.1.RELEASE deployer release, 1.0-2.RELEASE rpm release and 1.0-2.RELEASE ambari plugin release.

Read more...

Spring Cloud Data Flow for Apache YARN 1.0.0 released

We are pleased to announce the release of Spring Cloud Data Flow for Apache YARN 1.0.0.RELEASE.

Spring Cloud Data Flow for Apache YARN provides support for orchestrating long-running (streaming) and short-lived (task/batch) data microservices on Apache YARN.

This project was originally conceptualized with the goal to supplement the existing Spring XD users who have investments running streaming and batch data pipelines in a more traditional bare-metal setup. We wanted to provide migration path to help port over their existing investments and the tools and techniques to reap the benefits of microservices style architecture.

Read more...