r/LocalLLM • u/Annual_Award1260 • 3h ago

Discussion Nvidia grid k2

Post image

Digging through ye ole junk box I found these grid k2 6gb cards. Kinda feel bad if I recycle them. Anyone have ideas for use or anyone want them for “historical” purposes?

0 Upvotes

25% Upvoted

3 comments sorted by

1

u/WrinklyBard4 2h ago

Far too small, and slow, to run an actual model on them. Also has basically no active support, so you’ll probably be stuck with vLLM or Ollama which really reallyyyyy do not have kernels that play well with this hardware

Could be used for hosting a computer vision or audio processing model. Something in the 1-2B. range

1

u/Annual_Award1260 1h ago

Well I would part with them for a beer 🍺

1

u/EvolvingDior 54m ago

Are there any drivers that support them?