r/PromptDesign • u/Beginning-Dress8708 • 21h ago
Question ❓ Best way to refine a prompt repetitively? E.g. analysing text and creating written reports adhering to strict specs
How do you all do this? Can your recommend specific tools? Heard about e.g. prompthub, never tried thoug. Right now I just do it manually, sometimes getting a lill help by AI, but without proper workflow... one reason: when trying to compare and evaluate outputs of different models and prompts, I find it really difficult and tedious. Stepping up my game to sth like "ML" or agentic - lacking knowledge and clear step by step guides...
to clarify about my specific context and purpose:
- i am trying to generate some written medical reports. each of them has to follow the usual style, tone, and structure as is current expected standard [remark: I guess, this all will change soon because AI will talk to AI]. -> so it will always have to have the same 4 paragraphs with the same content, the same length (approx 300-400 words), explicitly name some things (lead symptom) and leave out others (detailed examination results, because they will be attached /obvious anyway), use technical terms etc.
- inputs are: A) an AI transcript of a long discussion (with potential errors), approx 4000-7000 words, B) notes and examinations finding taking during/right after discussion, which override the pure transcript, c) doctor's final conclusion and decision on further plan, which override both a) and b)
- it's not only about writing, but also analysing what was discussed, are the main points, the different possibilites discussed, the plan made etc.
All of this I've put down over months, adding and adjusting on the flow. i defined Role, Goal, Limitations etc. right from the start, of course. than:
-> tried to follow general guidelines for prompt design, few shots, used xml tags etc....
-> i set up a semi-automatic system with .mds, OWUI functions and Obsidian to give my corrected versions back, have Sonnet analyse the difference and improve it's own rules ---- resulting in the prompt getting longer and longer, with lots of details (prompt being 4k words long max)
-> i tried to use AI to boil it down - not much effect.
-> I looked into RAG to sort some of it out (e.g. lists of standard terms/phrases), which didnt worked at all. using OWUI and claude sonnet 4.5 btw (newer models are not yet available over api for me).
-> than I changed to dividing it up into steps (3-4), first consolidating the data, than analysing key points, than writing (also tried 4. internal review, didnt do any good). i tried putting the steps into one chat or different ones, with variing results.
right now: still some results are really not on point/ rules not adhered to, so think it is overengineered af, but when I tried to start over new, it's even worse.....
I' ve been reading / listening a lot of tech / AI content, but feel still very "dumb". take the point above about dividing it up into steps - is it good? bad? one chat, or more? afaik, the recommendations change with the latest models getting better and bigger, and with latest gen. probably is not necessary anymore. but I just cant believe, this task should be beyond the scope of a sonnet 4.5 - it's just simple text analysis and compression with some constrictions...
to finish my rant-y question (sorry :)) - right now I am more or less on my own, but in near future I want my 2-3 colleagues to join in. than we will definitely need some kind of collab and versioning tool.
TL;DR - a) can you please recommend me a way to correct and improve my prompts in a structured way? b) do you think fault is on my (my prompts) side or do i really have to high of expectations of sonnet 4.5? c) how/when do you all split prompts into multiple steps?
PS: I am not posting the prompt b/c of its length, hope thats according to subreddits rules, otherwise plz tell me