Spring AI now supports NVIDIA's Large Language Model API, offering integration with a wide range of models. By leveraging NVIDIA's OpenAI-compatible API, Spring AI allows developers to use NVIDIA's LLMs through the familiar Spring AI API.

We'll explore how to configure and use the Spring AI OpenAI chat client to connect with NVIDIA LLM API.

• The demo application code is available in the nvidia-llm GitHub repository.
• The SpringAI / NVIDIA integration documentation.

Prerequisite

• Create NVIDIA account with sufficient credits.
• Select your preferred LLM model from NVIDIA's offerings. Like the meta/llama-3.1-70b-instruct in the screenshot below.
• From the model's page, obtain the API key for your chosen model.
…

Hi, Spring fans! In this episode I talk to Gradle and Develocity engineer and Spring community legend Eric Haag

Hi, Spring fans! Welcome to another installment of This Week in Spring! It's Tuesday and work is well underway to prepare for the huge SpringOne event in Las Vegas in just a few short week's time! I'm elated! So, let's get this roundup on the road so I can get back to the preparation frenzy...

• Spring AI Embraces OpenAI's Structured Outputs: Enhancing JSON Response Reliability
• A Bootiful Podcast: Spring Cloud Dataflow, Spring Cloud Task, and Spring Batch legend Glenn Renfro
• in last week's installment of Spring Tips, I looked at using Spring Boot and HTMX together
• I love this: a bunch of opensource projects are working on a common set of annotations to convey nullability and null-restricted types in Java
• I love this: IntelliJ IDEA has a new feature: multi-project workspaces…

OpenAI recently introduced a powerful feature called Structured Outputs, which ensures that AI-generated responses adhere strictly to a predefined JSON schema. This feature significantly improves the reliability and usability of AI-generated content in real-world applications. Today, we're excited to announce that Spring AI (1.0.0-SNAPSHOT) has fully integrated support for OpenAI's Structured Outputs, bringing this capability to Java developers in a seamless, Spring-native way.

Following diagram shows how the new Structured Outputs feature extends the OpenAI Chat API:

Note: Spring AI already provides a powerful, Model-agnostic Structured Output utilities that can be use with various AI models including the OpenAI. The OpenAI Structured Outputs feature offers an additional, consistent, but a model specific solution, currently available only to the gpt-4o, gpt-4o-mini and later models.

…

Hi, Spring fans! In this installment, I talk to Spring Cloud Dataflow, Spring Cloud Task, and Spring Batch legend Glenn Renfro

It's August! Egads, has that come quickly! AUGUST. The eigth month of the year, and we're almost done with the first week, in fact! It's not that I'm not grateful to be here, but, yah, wow that was quick. And, of course, the month of my all time double dutch favorite conference, SpringOne, happening August 26th, 2024! Will I see you there?

• In last week's installment of A Bootiful Podcast, I talk to Micrometer teammate Jonatan Ivanov
• In last week's installment of Spring Tips, I had special guest contributor and Spring Security lead Rob Winch
• Spring AI with Groq - a blazingly fast AI inference engine
• I love this blog from the MongoDB developer blog called Discover Your Ideal Airbnb: Implementing a Spring Boot & Atlast Search with Kotlin Sync Driver
• Spring AI enables quick delivery of Intelligent apps in javaspring-ai-enables-quick-delivery-of-intelligent-apps-in-java
• Supporting ProblemDetails in Spring
• …

Hi, Spring fans! HTMX is the progressive hypertext sensation that's sweeping the process of web app creation, and - thanks to a nice integration by Spring community legend Wim Deblauwe, it's easier than ever to use it with Spring Boot and Thymeleaf. And, it's the topic of today's installment!

#java #springboot #html #htmx #http #html5

Hi, Spring fans! In this installment we talk to observability legend Jonatan Ivanov about the latest and greatest in the wide and wonderful world of observability. (Turns out a library that's used by countless projects including and beyond the Spring ecosystem keeps quite busy!)

Hi, Spring fans! In this installment I have special guest Spring Security lead Rob Winch give us a master class in how the method security support works and some of its new features. Come for the security, stay for the incredible opportunity to look over a senior engineer's shoulders as he explains the nuances of API design!

#springboot #springsecurity #springframework #java #security #apidevelopment #softwaredevelopment #architecture