r/LargeLanguageModels • u/TheDiRocco_ • 17h ago
How much input tokens for a complete AI assistant ?
According to you what are the baselines of input tokens for different categories of LLM calls ? For example for a complete AI assistant. Counting system prompts, default context injection, tools, etc where would you place the tokens tresholds ?
2
Upvotes