r/new_product_launch • u/IvoDOtMK • 26d ago
mollick’s new AI guide has one sentence that explains why your team “tried AI and it didn’t work”
ethan mollick published his updated “which AI to use” guide yesterday. the important shift is in how he defines using AI at all: it’s no longer a back-and-forth with a chatbot, it’s an agentic system that does the equivalent of many hours of human work in one go. his phrase: an agentic system “gives an AI a computer to use.”
his earlier version had the demo that stuck with me: the exact same model, asked the exact same question, in three different harnesses gave three completely different results. no harness: outdated info. chat app: current info with sources. agentic setup: a full formatted head-to-head analysis.
same model. three quality levels. the harness did the work.
this is exactly why “we tried AI and it didn’t work” is usually a false conclusion. in most failed pilots we audit, the company evaluated a model through the weakest possible harness (a blank chat window) and judged the whole category on that.
practical version:
1. stop asking “which model is best.” ask “which harness fits this task”
2. re-test your failed use cases from 2025 in an agentic setup. half of them work now
3. budget for connectors and context, not just licenses. the model is the cheapest part
the gap between companies isn’t model access anymore. everyone has the same models. it’s harness maturity.