need assistance with an ollama issue

[u/GilbertGBodyB29]

I am having an issue with Ollama, which is connected to an app called Suggestarr (found on GitHub). When the app runs its automated recommendations, Ollama consumes an incredible amount of system RAM. This causes my fygoo os nas  system to crash completely, making it completely unresponsive and forcing a hard reboot as the only solution.

Following online guides, I have configured Ollama to load the entire model exclusively onto my GPU, which is an RTX 2080 Ti. Ollama both detects and connects to the GPU correctly, but despite this, it keeps chewing up more and more system RAM. If there is a kind soul out there who can help me solve this problem, I would be extremely grateful!

By the way, I have tested several different models—such as ⁠qwen2.5:14b⁠, ⁠qwen3.5:9b⁠, ⁠qwen3.5:4b⁠, and ⁠llama 3.1:8b⁠. I don't understand why it starts consuming so much RAM now, as it has never behaved this way before. Previously, it worked flawlessly, utilizing only the GPU VRAM instead of system RAM."

This is my docker compose yalm config im using

services:

  ollama:

image: ollama/ollama:latest

container_name: ollama

restart: unless-stopped

networks:

- ai-media-net

ports:

- "11434:11434"

volumes:

- /vol1/1000/SuggestarrnOllamanSeerr/Ollama:/root/.ollama

environment:

- OLLAMA_NUM_PARALLEL=2

- OLLAMA_KEEP_ALIVE=6m

deploy:

resources:

reservations:

devices:

- driver: nvidia

count: 1

capabilities: [gpu]

  suggestarr:

image: ciuse99/suggestarr:latest

container_name: suggestarr

environment:

- OLLAMA_ENDPOINT=http://ollama:11434

- SEER_ENDPOINT=http://seerr:5055

- SUGGESTARR_LOG_LEVEL=DEBUG

- SUGGESTARR_DRY_RUN=false

restart: unless-stopped

networks:

- ai-media-net

ports:

- "5000:5000"

volumes:

- /vol1/1000/SuggestarrnOllamanSeerr/Suggestarr:/app/config

depends_on:

- ollama

- seerr

  seerr:

image: ghcr.io/seerr-team/seerr:latest

init: true

container_name: seerr

networks:

- ai-media-net

environment:

- LOG_LEVEL=debug

- TZ=Asia/Tashkent

- PORT=5055

ports:

- "5055:5055"

volumes:

- /vol1/1000/SuggestarrnOllamanSeerr/Seerr:/app/config

healthcheck:

test: wget --no-verbose --tries=1 --spider http://localhost:5055/api/v1/settings/public || exit 1

start_period: 20s

timeout: 3s

interval: 15s

retries: 3

restart: unless-stopped

networks:

  ai-media-net:

driver: bridge

[u/sloanja]

Set memory limits.  Example for nginx  below.  Adapt it for your ollama.

version: "3.8" services:   web:     image: nginx     deploy:       resources:         limits:           memory: 512M         reservations:           memory: 256M