Ollama

install

Install with Docker

• https://ollama.com/blog/ollama-is-now-available-as-an-official-docker-image

CPU only

docker run -d -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama

GPU

docker run -d --gpus=all -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama

• http://localhost:11434

Run a model

docker exec -it ollama ollama run deepseek-r1:1.5b
# docker exec -it ollama ollama run xxxx

• model list

https://ollama.com/library/deepseek-r1

Spring AI with Ollama

• https://docs.spring.io/spring-ai/reference/api/chat/ollama-chat.html

<dependency>
   <groupId>org.springframework.ai</groupId>
   <artifactId>spring-ai-starter-model-ollama</artifactId>
</dependency>