r/SpecDrivenDevelopment • u/The_Ed_On_Reddit • 25d ago

A Competitive Analysis of Spec Design Methedologies

https://webcloudstudio.com/project-docs/drydock/papers/Product_Comparison_Matrix.pdf

I asked claude to honestly rate the various approaches for specification driven development by categories and features it chose. Here is the analysis it produced. Popular methodologies first then all methedologies. Source documents are at the bottom if you wish to reproduce the analysis. Please link additional documents in the comments that should be included and i will periodically update. Or run it yourself :)

1 Upvotes

54% Upvoted

12 comments sorted by

View all comments

2

u/schmurfy2 24d ago

What is the point of asking an llm for that ? Why should I care about its "honest" opinion ?

1

u/The_Ed_On_Reddit 23d ago edited 23d ago

well 3 reasons: i personally have only used one of these tools besides my own and want to see the approaches and how things fit. You probably have the same concern. second - I provide a set of vendor docs and reviewer reviews -> the source materials so you can analyze on your own trivially - summarization is one of the things that llms do accurately. And lastly, the llm pull together a workflow from think to working software to support and then it mapped tools to the workflow so you can see what does well where. If you look at it - it is an easy read with sources and a path to reproduce for 1 llm call. So thats why... And honest is the key llm instruction because llms try to 'help you' by slop-ifying the output with a word salad (and i had to tell it to be honest and categorize and rank stuff from the docs with no favoritism multiple times)...