Case Study: Remote File Ingest with Spring Cloud Data Flow

Engineering | David Turanski | September 29, 2020 | ...

This article is part of a blog series that explores the newly redesigned Spring Cloud Stream applications based on Java Functions. In this chapter, we explore how to use Spring Cloud Stream Applications and Spring Cloud Data Flow to implement a very common ETL use case: Ingesting files from a remote service. Specifically, we will look at how to ingest files from S3, SFTP, and FTP.

Here is what is included in the blog series to date:

Spring Cloud Data Flow 2.7.0-M1 and 2.6.3 Released

Engineering | Ilayaperumal Gopinathan | September 29, 2020 | ...

Spring Cloud Data Flow team is pleased to announce the release of 2.7.0-M1 and 2.6.3

While the release 2.6.3 has the bug fixes, the first milestone of 2.7.0 has the following enhancements:

SCDF dashboard re-design using VMware Clarity toolkit

SCDF dashboard is re-designed using VMware Clarity design system. This is a complete rewrite of SCDF dashboard GUI to get the benefits of the Clarity design.

Spring Boot 2.3.2 Update

SCDF server components are now updated to use Spring Boot 2.3.2 release.

Wavefront integration

Spring Cloud Data Flow dashboards for streams, tasks and SCDF server components…

This Week in Spring - September 29th, 2020

Engineering | Josh Long | September 29, 2020 | ...

This Week in Spring - September 22, 2020

Engineering | Josh Long | September 22, 2020 | ...

A Bootiful Podcast: Lightbend CTO Jonas Bonér on his epic, aspect-oriented, distributed, reactive work

Engineering | Josh Long | September 17, 2020 | ...

Hi, Spring fans! In this episode, Josh Long (@starbuxman) talks to his friend and Lightbend CTO Jonas Bonér (@jboner) about his epic, aspect-oriented, distributed, and reactive work over the decades, about the cooperation with the Spring team on the Reactive Streams, the Reactive Foundation, and more.

This Week in Spring - September 15th, 2020

Engineering | Josh Long | September 16, 2020 | ...

Hi, Spring fans! Welcome to another installment of This Week in Spring! It's been an absolutely nutty week! It's just Tuesday and I'm beat!

Over the weekend I completely refactored the pipeline I used for my just-published book Reactive Spring (which, by the way, is now available on Leanpub and on Amazon as digital and paperback editions) and turned it into the turnkey Asciidoctor pipeline I'd always wanted but - since I was traveling 650,000 miles a year, speaking at hundreds of conferences or events yearly, writing a 450-page book, releasing weekly blogs, recording a weekly podcast…

Get the Spring newsletter

Stay connected with the Spring newsletter

Subscribe

Get ahead

VMware offers training and certification to turbo-charge your progress.

Learn more

Get support

Tanzu Spring offers support and binaries for OpenJDK™, Spring, and Apache Tomcat® in one simple subscription.

Learn more

Upcoming events

Check out all the upcoming events in the Spring community.

View all