Leverage the Power of 45k, free, Hugging Face Models with Spring AI and Ollama
This blog post is co-authored by our great contributor Thomas Vitale.
Ollama now supports all GGUF models from Hugging Face, allowing access to over 45,000 community-created models through Spring AI's Ollama integration, runnable locally.
We'll explore using this new feature with Spring AI. The Spring AI Ollama integration can automatically pull unavailable models for both chat completion and embedding models. This is useful when switching models or deploying to new environments.
Setting Up Spring AI with Ollama
Install Ollama on your system: https://ollama.com/download.
Tip: Spring AI also supports running Ollama via Testcontainers or integrating with an external Ollama service via Kubernetes Service Bindings…