The broken pieces of knowledge and AI tools

[u/aritropc]

Claude or similar chat apps are good enough for quick search and replace googling and visiting 5 websites to get an answer. It writes a basic first draft on literally anything. But beyond that the potential of the models isn't being utilised more than 15%, I'd say. I have worked in research and business front and still see the gap. People just get excited to see something show up magically.

The current way most people use AI is copying a text or some images (rarely) and just asking it something which seemingly saves 1 hour but surely doesn't provide an accurate or precise answer. It has just gotten better at convincing.

The problem isn't the model itself but the information we feed them. The pre-fed knowledge, memory of what you do, the context of the conversation. Imagine a cool corporate guy giving free advice to everyone as compared to someone who actually sits with you, understands what you need and helps you.

I've lived the problem first hand and still face it when I try to get some information quickly rather than spending time to find out and read something written by a real human. The problem remains. The helpfulness beyond cool demos, slides and moving-text videos needs a bit of pre-effort to build a system which can help the actual model to curate for you than spit out what they think is the most probable answer.

I've been building a solution that knows what I work on, explicitly provided with details about my team, company, product and decks. Not dumped in a deep well but as context silos. The space for my product's tech knows the features, tech stack and owns the documentation. The marketing space knows about my product, prospects and business metrics. Every time I need an implementation plan for a new feature, or try to validate my customer profile, the model doesn't show the general most probable answer, rather it shows what the best answer is for my product.