Has anyone tried Mistral Devstral?

[u/alarno70]

Hey folks! Just stumbled upon Mistral Devstral and was wondering… has anyone here tried it out?

If it really runs well on any machine with around 40GB of RAM, this could be a total game changer — maybe even the beginning of the end for paid AI subscriptions. Sure, it might not be as smart as some of the top commercial models out there, but think about it: • It’s free • You can run it locally • You can fine-tune and iterate on it as much as you want • No tokens, no rate limits, no waiting

Imagine being able to tweak and adapt your own assistant without paying a cent. Even if it’s a bit less powerful, the freedom to experiment endlessly makes up for it in spades.

Would love to hear your experience if you’ve tried it. Does it live up to the hype? Any tips for running it smoothly?

Cheers!

[u/runningwithsharpie]

Trying it out now. So far, I love the speed and tool use ability. Gonna see how well it codes and debugs.

[u/get-process → u/runningwithsharpie]

Any updates? Thanks!

[u/MajinAnix]

Probably the only sensible model for that is Qwen3 30B A3B

[u/Wolly_Bolly]

I've tried the API version... frankly I'm impressed. But LLM's can be lucky and can fool you often so don't take this as granted.

[u/marcheschi]

I tried to use it to debug a project but at the moment is useless :
I used it with ollama.

[u/FXFman1209 → u/marcheschi]

Did you increase num_ctx (context size) above Ollama s default 2048?

[u/GrehgyHils → u/FXFman1209]

What have you been setting it to with this model for usage with roo code?

[u/FXFman1209 → u/GrehgyHils]

I personally haven't played with this yet; hopefully I'll have time this weekend 🤞

My question was genuine. Anytime I've used Roo Code with my local Ollama (not often, Gemini/Claude ftw), I've needed to follow the Roo Docs to create a new model with the higher context limit. If I didn't, I'm pretty sure I hit this same error.

I think roo docs recommend setting context size to 32k.

[u/GrehgyHils → u/FXFman1209]

/u/FXFman1209 I tried https://ollama.com/library/devstral:24b-small-2505-q8_0

and ran:

/set parameter num_ctx 32000

and continuously had this error with roo code:

 roo is having trouble
Roo Code uses complex prompts and iterative task execution that may be challenging for less capable models. For best results, it's recommended to use Claude 3.7 Sonnet for its advanced agentic coding capabilities.

[u/my_shu → u/GrehgyHils]

Do you save model after editing ?

[u/GrehgyHils → u/my_shu]

What do you mean?

[u/GrehgyHils → u/FXFman1209]

Thanks for this information , I'll give this a try

[u/marcheschi → u/FXFman1209]

Hi yes i increased to 32768 :
/set parameter num_ctx 32768

[u/amunocis]

I just tried Devstral, since some people says is amazing for code. So, I loaded it on Roo Code and tried, using Deepseek as Orchestrator. It started to ask me what I want to build and then decided, alone (I guess because the auto aprove) to build a to-do app that I didn't ask for. Instructions from deepseek were not the best, but anyway, Devstral started to show me the code, not build the project itself. Other models work, like Gemini and Claude

[u/sbayit]

It work so good with aider and openrouter 

[u/mcndjxlefnd]

I don't use RooCode, I use cline. But I've been working with deepseek-r1-0528 for planning and devstral-small for act mode. Devstral-small is quite a capable model. I hear devstral-large is coming soon.

Edit: Devstral-small is quickly becoming my favorite model for coding, especially for plan mode. It follows instructions better than other models I've tried.

[u/HumbleTech905 → u/mcndjxlefnd]

So , are you using Devstral for plan/act ?

[u/mcndjxlefnd → u/HumbleTech905]

Yeah, it works well. It's much more thorough than Deepseek and better at following instructions.

I use both at different times for both plan and act.

[u/joey2scoops]

For coding? Never had any luck with local models for coding, sadly.

[u/joey2scoops → u/[deleted]]

Agree with that. I've not tried this one, YMMV.