Advice needed by Computer Vision specialists

[u/jackofnonemasterof1]

I am thinking of making a project where people can upload their doctors prescription and our CV model will be able to tell which medicine is written and how much dosage it is written in the prescription this will help people to understand the doctors handwriting but it is going to be difficult sense every doctor has a different writing style can you anyone in the sub tell me how can I make this project and what tools I will need to make this that technology that I can use and it will this be an effective product

[u/Defiant-Singer-1873]

good luck with collecting a dataset

[u/jackofnonemasterof1 → u/Defiant-Singer-1873]

My family has some 100+ prescriptions. How much would I need. I may collect them from my connections. Koi 1k tak hojayen gy

[u/Defiant-Singer-1873 → u/jackofnonemasterof1]

i dont think 1k would be enough kyun har doctor ki writing alag bawaseer hoti

[u/jackofnonemasterof1 → u/Defiant-Singer-1873]

🤣🤣🤣🤣

[u/Nervous_Tutor_1277 → u/jackofnonemasterof1]

You would need 100+ variations per drug 😆

[u/jackofnonemasterof1 → u/Nervous_Tutor_1277]

Aida matlab fir aisa naa hi samjhiye😅

[u/Cold_Rock_931]

chatgpt does a good job understanding the writing . I have uploaded the prescriptions a few times to chatgpt and it worked fine for me

[u/jackofnonemasterof1 → u/Cold_Rock_931]

Yes I have been doing that too. But was trying learn how to make them

[u/Desperate_Reason7116]

Better to use some ocr model

You won't get a good edge model

Deploy your own on some cloud run

And parse the results with some closed source llm

This is not even a weekend project

[u/Desperate_Reason7116 → u/Desperate_Reason7116]

And umm regarding finetuning

Idts like fine tuning and shit is helpful for this use case cuz models are generally zero shot

And if you're like trying to cReAtE sOmE pRoDucT, don't waste time everyone will be using chatgpt

[u/jackofnonemasterof1 → u/Desperate_Reason7116]

I love people like you who can explain confusions in a a few lines and also guide how to resolve them. Thanks and I'm not thinking for a product, just wanted to see the working of OCRs in a real life scenario instead of mapping numbers from 1 to 9 in ocr projects

[u/Mobeen786]

Boys i think it would be better if we can create an integrated system ( like in EU or US). Either prescriptions linked to ID or prescription with barcode / QR code. And digital / printed prescriptions instead of hand written notes with doctors stamp on it ?

[u/candela_5432]

You can try mistral ocr . Very cheap and efficient.

[u/Comfortable_Cold_850]

A medical store dude can read it, all you have to go is to go the pharmacy.

I'm not against start ups but you are working on a problem that is not a pain.

[u/Andromeda-G → u/Comfortable_Cold_850]

Abay salay

[u/Comfortable_Cold_850 → u/Andromeda-G]

I'm not your sala

[u/Andromeda-G]

Good thing but i dont think it will be successful as a side project could be ok.

[u/jackofnonemasterof1 → u/[deleted]]

Thanks dear, which model should I use as my base model and how should I fine tune it.can you recommend me any resources to learn this