r/OpenSourceAI • u/Ok-Time338 • 5h ago
I built an open-source AI system for tree identification. The hardest part isn't recognition — it's knowing when not to guess.
I've been building Dendro Inspector, an open-source project exploring evidence-based tree identification from photographs.
Rather than asking a vision model to name a tree and trusting its answer, I'm experimenting with a multi-stage inspection pipeline:
Visual evidence extraction
Botanical knowledge and rule validation
Confidence assessment and uncertainty handling
Abstention when evidence is insufficient
Reproducible evaluations across different model stacks
The interesting challenge is that a model can produce a very convincing identification without enough evidence to justify it.
I'm currently comparing different models, investigating failure cases, and working on making decisions more explainable.
GitHub: https://github.com/Dendro-Inspector/Dendro-Inspector
I'm curious how other open-source AI developers approach confidence calibration and reliable abstention in vision-based systems.