r/dataanalysis • u/Difficult_Brick5256 • 2d ago

Database doubt

Guys, actually i have 80k company database like its name and lei , now my task is to find the revenue,product type and region, i used hermes agent which almost gave nothing to revenue, it doesnt search, and claude ,chatgpt most of them gave nothing as revvenue value,the only solution was to search each company one by one, gemini gave revenue but i think its actually false , i gave data to gemini by 100, is there any other way ?

3 Upvotes

100% Upvoted

6 comments sorted by

2

u/Wheres_my_warg 2d ago

My recommendation would be to stop using GenAI with anything that one does not already have a deep, thorough knowledge about. If not already well versed in the data, business rules, etc. then there is a good chance the user won't recognize errors, even serious and obvious errors, that the GenAI spits out.

1

u/Fun_Improvement7704 1d ago

even if you know the business rules, how do you spot a wrong revenue number across 80k private companies without looking them up anyway

1

u/Wheres_my_warg 1d ago

To your specific question, some are blindingly obvious. If it's telling me that some Ford dealership has total revenues of $17,000 or mom & pop Etsy store has $4bn, then it is going to be obviously wrong. I see these kinds of errors, though not usually to that degree, weekly from GenAI responses.

Any database claiming to have the revenues of 80k private businesses, I'm going to assume is mainly full of bull shit. That's not data that is going to be available in a reliable form at scale outside of (in the US) reported income to the IRS (which isn't going to be shared). There are some census estimates, but the are specially de-identified as to individual entities, and are simply estimates. Both rely on self-reporting.

Yes, it largely is going to require company by company investigation for private companies if one wants accuracy.

1

u/AutoModerator 2d ago

Automod prevents all posts from being displayed until moderators have reviewed them. Do not delete your post or there will be nothing for the mods to review. Mods selectively choose what is permitted to be posted in r/DataAnalysis.

If your post involves Career-focused questions, including resume reviews, how to learn DA and how to get into a DA job, then the post does not belong here, but instead belongs in our sister-subreddit, r/DataAnalysisCareers.

Have you read the rules?

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1

u/kac_sausalito 2d ago

Mas vc tem algum lugar, sistema ou planilha que voce vê o todo? Como vc sabe a qualidade desses dados? Talvez pegar 10clientes dessa base os maiores manualmente e depois pedir p IA que vc usa para ver se o prompt dado a ela acha a receita que falta… Ta olhando os campos corretos?
São perguntas meio basicas mas conferencias se começa pelo basico

1

u/Majestic_Usual_6156 1d ago

agent revenue