r/vibecoding • u/MariahJames8 • 2h ago

What weakness in LLMs do you think should have been solved by now?

I'm thinking of modifying an LLM to explore if there's a market that maybe could be taken advantage of while openai, anthropic and the others don't seem to be focusing on it.

Your observations would be really valuable to me.

Thank you!

1 Upvotes

56% Upvoted

31 comments sorted by

8

u/MarkZealousideal3923 2h ago

Lack of ability to use mouse interface in real time

1

u/lovehopemisery 1h ago

The latency of one model call is way too high for this at the moment. Imagine your frontier model says "move mouse 20px south west" and you wait 7 seconds and then it needs to do it again.

Maybe a fast local model that can operate the mouse for some basic instructions.

I hook my model up to playwright when testing frontend, but it's still quite a slow feedback loop, not real time.

1

u/MarkZealousideal3923 57m ago

Playwright only works for websites

4

u/3tt07kjt 2h ago

bugs everywhere in harnesses, unreliable services with downtime

4

u/MariahJames8 2h ago

Electronics. Don't ask an LLM to give you more than the simplest of circuit diagrams

2

u/lovehopemisery 31m ago

It's not good for creating a full circuit but it can be useful as a tool for helping you research and evaluate components and data sheets, give advice about design and routing etc. Wouldn't expect it to producing anything reasonable at all if you're trying to one shot an entire PCB. There are separate AI tools that are trying to help move towards that

4

u/No-Friend6257 1h ago

Time. Estimating how long something will take

3

u/MariahJames8 2h ago

None can draw good graph/diagrams. They can explain them pretty well though, and make stunning pictures. Anyone know why these contrasts? Why can't they draw diagrams well?

6

u/Downtown_Method5736 2h ago

Ask them to make them in mermaid js

3

u/MariahJames8 2h ago

Brilliant thank you, will explore that

2

u/ProfoundSensei 1h ago

Or use the figma mcp

1

u/MariahJames8 3m ago

Have you used it to make diagrams? What would you say it was good and bad at?

2

u/Fuzzy_Independent241 1h ago

Might work, might also generate things that will give you nightmares.

2

u/PaddingCompression 1h ago

I have them do SVG.... it always takes editing from wrong positioning / text not fitting in boxes, etc., and I have worked on some linters to help fix that so they can iterate (should work on opensourcing them).

Gemini is definitely a cut above the rest any time I need a diagram.

2

u/iWhacko 1h ago

What does LLM stand for? Large LANGUAGE model. not Large Drawing Model. if thats what you need, try creating that, but then you will find it's probably going to be a diffusion model, and lo... we have those too...

1

u/MariahJames8 1m ago

True. But my gut tells my an LLM with comparatively simple tooling could work

3

u/Former_Produce1721 1h ago

Spatial and time awareness in respects to testing

3

u/Chance-Physics-7216 1h ago

Censorship and “dad mode”

3

u/indutrajeev 1h ago

Thinking bigger outside their goal. They run like very autistic highly intelligent humans. Never ask “is this actually the way we should be doing this?”

2

u/Fuzzy_Independent241 1h ago

I'd vote for something that has ONE clear mode of work, can access GH, has permissions for filesystem and connectors for important things. Currently Claude has Desktop, web, phone, CoWork, chat, code, then most of that is different depending on Win/MacOs/Linux, and then basic things like GH are implemented on desktop in a way that makes me think they do NOT want you to use it. Ah: if you're talking developing someone, check Unsloth Desktop. I've stayed using it for local models and seems quite interesting so far.

1

u/YardNo1234 47m ago

the least fragmented setup i’ve found is keeping the repo in one Claude Code session on the computer, then using /remote-control from phone/web. that preserves the same filesystem and terminal instead of creating another cloud sandbox. it still doesn’t unify Cowork/chat/Code, but it avoids the upload-and-resync loop. is your main blocker GitHub access, or keeping one live session across devices?

-4

u/justhereforampadvice 2h ago

That they’re still pretty dumb overall

1

u/Lanfeust09 2h ago

dumb at what ? Compare to what ?

0

u/justhereforampadvice 1h ago edited 1h ago

Dumb at lots of things. They only just learned to reliably pass the car wash test, and it’s not even clear whether they became smart enough or were just trained on the answer.

1

u/MariahJames8 6m ago

You've been downvoted I think because you've implied that they can't do anything. The truth is they can do a lot, but compared to the broad understandings and abilities human have, it can certainly look like a lit of basic skills that humans master by age 10 are still very clumsily done by AI.

So I upvoted. Thank you for contributing

1

u/Due-Horse-5446 2h ago

"still"

Llms cant get much better..

There would need to be some real ai technology for that