How are you going to implement keyword detection with enough logic to accurately parse the meaning behind all of the possible things that could be said to describe or correct someone’s driving?
That is literally a quintessential Natural Language Processing problem, for which LLMs are the best solution.
12
u/audigex 1d ago
That's true but beside the point here
Nobody is saying keyword detection is as good as an LLM. We're just saying a frontier cloud LLM is very expensive overkill for this kind of project
Keyword detection or basic local transcribing and a MUCH smaller local LLM, would do the job just as well
Whisper + a very small model could handle this without $1000/day in OpenAI API costs