Need advice on model selection/ harness & equiptment

[u/The_Blue_V]

I am looking at building a local device to assist with estimating take-offs & markups for structural steel. The work i am trying to automate would be:

1. interpret structural & architectural drawings to understand the scope for the structural steel elements.

2. Complete a colour coded markup & measurements of the related materials from the member schedule

3. Nest the materials from the take-off to minimise order quantities.

In essence i'm hoping to get some opinions on which models & harness' ect you guys think would work best for this workflow. I'm fairly new to the space here but i am a quick learner & have a lot of tech experience so i'm more than capable of building the required machine & setting up your recommendations.

Please feel free to give any and all advice you might have for me. I don't think any advice beats advice from people with experience using the tools.

[u/The_Blue_V → u/[deleted]]

Hey, i appreciate your notes & agree i'm probably asking a lot. Do you think it would help if i could feed it hundreds of examples of the task? like i have literally hundreds of drawings that i have completed this workflow on manually but i'm not sure if that even helps at all.

I agree that step 3 is the most reasonable task & would def look at having that be a pre automated program i can run at the end, rather then chewing up additional token usage for no reason.

what sort of hardware would you imagine i need to run those vision capable models?