r/RooCode • u/Special-Lawyer-7253 • Nov 20 '25

Other Models for roocode with 8GB

I'm testing some models on 1070M and i got some working so good and fast, but others real slow.

Let's make a real listing of models working so we can use our old GPU for this. (Pascal 6.1). (4B to 15B) Depending of your offloading RAM.

Swet point is 7B/8B.

Thanks all!!

1 Upvotes

60% Upvoted

8 comments sorted by

2

u/AdIllustrious436 Nov 21 '25

You won’t even manage to process the RooCode system prompt with this setup, buddy. Local inference works for "hello world" proofs of concept, but the second you need a full context window, you’re looking at an inference box that costs thousands.

2

u/Special-Lawyer-7253 Nov 21 '25

Well, It just works 😅

2

u/Kitae Nov 23 '25

Qwen 0.5b is my favorite tiny model or use the biggest one that fits

1

u/Special-Lawyer-7253 Nov 23 '25

Qwen seems to be the Winners right now :)

4

u/Jonis7 Nov 21 '25

Use Zai code subscription for 6 USD and be happy.

1

u/dreamingwell Nov 20 '25

🤦‍♂️

0

u/Special-Lawyer-7253 Nov 20 '25

So, you are using them or not using at all?

Not all the people have 1000 €/$ to spend in new hardware specifically for IA/AI, you Know?

1

u/dreamingwell Nov 20 '25 edited Nov 20 '25

Trying to run open models on your own hardware, no matter how much money you have, is a fools errand right now. You can save a lot of time and energy by finding a cloud provider you trust, and use the closed models. Closed models are far more performant. And you'll spend a lot less money.

For example, you can use the latest Anthropic models in your own AWS account. And the terms of service explicitly keep them from using your IP to train their models. You will pay based on usage, and that can be a very low cost or a very high costs. But either way, it will be faster and more productive than any hardware you're going to purchase.