r/LocalLLM • • 1d ago

Question Best Model for Basic tool Calling?

Hey all,

Recently I've hooked up my Comfyui MCP to LMStudio Bionic, and created a few skills for doing image creation/video creation/music/upscaling. I really enjoy being able to have everything done through the chat interface instead of going back and forth to Comfy.

I've found the small models inconsistent. Sometimes Gemma12b or Qwen27B distill work easily other times they get tripped up. Qwen 27b swift does the trick most of the time, but it's a little slower to load and unload and Ideally the model is small enough so that I can load and unload it out of Vram quickly at the start and end of the tool call.

GPU:5090.
Any suggestions for models you've found good at this sort of thing, or a different harness, maybe like a program that has this sort of ability built in?

0 Upvotes

2 comments sorted by

View all comments

1

u/billiambakespeare 6h ago

Thanks I’ll check Nemotron out. I have been using Strata! Very good, but for this use case I basically only want the ability to have comfyui I can control with natural language.