Leverage the Power of 45k, free, Hugging Face Models with Spring AI and Ollama

Engineering | Christian Tzolov | October 22, 2024 | ...

This blog post is co-authored by our great contributor Thomas Vitale.

Ollama now supports all GGUF models from Hugging Face, allowing access to over 45,000 community-created models through Spring AI's Ollama integration, runnable locally.

spring-ai-ollama-huggingface-gguf2

We'll explore using this new feature with Spring AI. The Spring AI Ollama integration can automatically pull unavailable models for both chat completion and embedding models. This is useful when switching models or deploying to new environments.

Setting Up Spring AI with Ollama

Install Ollama on your system: https://ollama.com/download.

Tip: Spring AI also supports running Ollama via Testcontainers or integrating with an external Ollama service via Kubernetes Service Bindings

This Week in Spring - October 22nd, 2024

Engineering | Josh Long | October 22, 2024 | ...

Hi, Spring fans! Welcome to another installment of This Week in Spring. I write this to you in an Uber speeding down the autobahn near Frankfurt, Germany. What a time to be alive! At the rate this driver's going, I won't have much time to write this before we've arrived, so let's dive right into it!

This Week in Spring - October 15th, 2024

Engineering | Josh Long | October 15, 2024 | ...

Hi, Spring fans! Welcome to another rip-roaring and ever-so-riveting installment of This Week in Spring! I'm in Amsterdam, at the moment, rounding out a week between Antwerp, Beglium, and Amsterdam, the Netherlands. Today I'm off to Dubai for the fantastic GITEX/DevSlam event. Then I return back to Europe for Voxxed Days Thessaloniki, in Greece. Should be a fun week!

It's certainly been a fun week! Let's dive right into it!

This Week in Spring - October 8th, 2024

Engineering | Josh Long | October 08, 2024 | ...

Hi, Spring fans! Welcome to another installment of This Week in Spring! I'm in Antwerp, Belgium, for the amazing Devoxx Belgium 2024 event! I am so happy to be back here, one of the best shows in the Java ecosystem!

We've got a lot to get into so let's dive right in!

From Spring Cloud Data Flow 2.11.x to 3.0

Engineering | Ilayaperumal Gopinathan | October 07, 2024 | ...

Dear Spring Community,

With the recent announcement of Spring Framework 7.0 and Spring Boot 4.0, the Spring Cloud Data Flow team is pleased to announce the next major release, SCDF 3.0, to align with both Spring Framework 7.0 and Spring Boot 4.0.

This will bring the following SCDF ecosystem of projects in line with Spring Framework 7.0 and Spring Boot 4.0:

  • Spring Cloud Data Flow server components (SCDF core and Skipper servers)
  • Composed Task Runner, SCDF Shell, Single Step Batch Job, and Task Launcher
  • Spring Cloud Deployer Implementations for both Cloud Foundry and Kubernetes
  • Spring Cloud Data Flow UI
  • Spring Cloud Stream/Task workloads based on Spring Boot 4.0

Supercharging Your AI Applications with Spring AI Advisors

Engineering | Christian Tzolov | October 02, 2024 | ...

In the rapidly evolving world of artificial intelligence, developers are constantly seeking ways to enhance their AI applications. Spring AI, a Java framework for building AI-powered applications, has introduced a powerful feature: the Spring AI Advisors.

The advisors can supercharge your AI applications, making them more modular, portable and easier to maintain.

If reading the post isn't convenient, you can listen to this experimental podcast, AI-generated from blog's content:

What are Spring AI Advisors?

At their core, Spring AI Advisors are components that intercept and potentially modify the flow of chat-completion requests and responses in your AI applications. The key player in this system is the AroundAdvisor

From Spring Framework 6.2 to 7.0

Engineering | Juergen Hoeller | October 01, 2024 | ...

Dear Spring community,

Spring Framework 6.2 is shaping up for general availability in November 2024, with particularly significant revisions in the core container and in our web support: see "What's New in Spring Framework 6.2". This release is designed for use with JDK 17-23 and Jakarta EE 9-10.

At the same time, we are planning toward 2025 already, and it is my pleasure to announce that our November 2025 release will be the start of a new major generation: Spring Framework 7.0!

We will upgrade our baseline to Jakarta EE 11 (Tomcat 11, Hibernate ORM 7, Hibernate Validator 9) and embrace the upcoming JDK 25 LTS, while retaining a JDK 17 baseline in alignment with the wider Java ecosystem. For Kotlin applications, we intend to base Spring Framework 7's support on Kotlin 2. Last but not least, our null-safety strategy is converging with the recently released JSpecify

Get the Spring newsletter

Stay connected with the Spring newsletter

Subscribe

Get ahead

VMware offers training and certification to turbo-charge your progress.

Learn more

Get support

Tanzu Spring offers support and binaries for OpenJDK™, Spring, and Apache Tomcat® in one simple subscription.

Learn more

Upcoming events

Check out all the upcoming events in the Spring community.

View all