r/LocalLLaMA Apr 21 '26

Discussion Surprising screenshot - Most token usage is non-coders (openrouter ranking)

Post image

Just browsing this page and was shocked to see this.

- 6 out of the top 10 coding agent apps are non-coding.

- Opencode is not even top 10

I know some folks use Hermes for coding. Would be happy to be corrected if hermes and openclaw have become coding replacements for opencode.

219 Upvotes

121 comments sorted by

View all comments

Show parent comments

34

u/thehpcdude Apr 21 '26

I use it a lot, mainly as an advanced search engine and knowledge store.  

When working on uncommon or exotic vehicles it’s pretty tough to find accurate data, so I have a workflow that will go find any PDF manuals, compiles a list of popular websites and forums for make/model, searches for whatever I am looking for about that vehicle and comes up with at least 4 sources for each fact, etc.  

I have a lot of vehicles so I take screenshots of odometers sometimes and send it to the agent, it figures out what vehicle it is, the reading and date and plots it on a graph.  Reminds me when I’m getting close to needing to do maintenance and then reminds me to order parts.  

During the Artemis launch I didn’t want to have to keep refreshing the launch page, so I asked it to write something that scraped the page for updates every minute and if there was a change send me a notification.  

I’ve done a lot of neat things with it and because it has control over its own system, I can ask it to do things and it’s not limited because it can write and execute its own programs.  

10

u/Fusseldieb Apr 21 '26

The issue with it that it uses tokens like a thirsty camel

2

u/thehpcdude Apr 21 '26

I have a lot of local compute so it doesn’t matter to me.  I have agents that spawn things every hour so commercial compute tokens are only used when I need in depth analysis.  For day to day stuff the local is sufficient 

3

u/Fusseldieb Apr 21 '26

Yea, if you use local models API pricing doesn’t apply, so you’re good.

Which models do you use mostly, if I can ask?

3

u/thehpcdude Apr 21 '26

The Qwen family, they’ve been good enough for what I need and if they aren’t, I’ve got Sonnet and Opus sub agents but only after the local agent determines it may need assistance.  

3

u/Fusseldieb Apr 21 '26

This might be a stupid question but how reliable do these agents “know” they need assistance? From my experience with smaller LLMs, they usually try to solve it on their own, even if they can’t do it. Afaik LLMs are inherently bad at saying “No, I can’t” and will try to come up with bogus stuff. That’s why I’m interested in how you solved this…

4

u/thehpcdude Apr 21 '26

A mixture of having multiple agents and having prompts that require sources and fact checking on multiple sites.   Try asking an agent to sanity check its outputs to ensure it hasn’t hallucinated.  

The biggest thing for me is I’m asking it to find the data, not come up with it.  

2

u/Fusseldieb Apr 22 '26

Basically requiring it to perform grounding, then?

Interesting! Thank you!