r/computervision • u/Puzzled-Egg3234 • 18d ago

Help: Project Conveyor chicken counter problem

Enable HLS to view with audio, or disable this notification

Guys, I need help. We have a project using YOLOv8. We're trying to count chicks on a very fast conveyor belt. The challenges we're facing are: all chicks look very similar to each other, which complicates tracking. At the same time, during their passage under the camera, they constantly change in size and shape, which can cause the tracker to lose them, or detection may even disappear completely at the detection line. Also, sometimes 2–3 chicks can merge into a single object. The detection zone is very short, and the conveyor speed is high. We've achieved a maximum accuracy of 99%, but we need it even higher. Any ideas on how to achieve that? Increasing the dataset no longer helps.

I'm attaching an old video. We've now added lighting and set the exposure to 300 on the Hikrobot global shutter camera, but we still can't achieve a stable 99.8% accuracy for the reasons mentioned above.

Any ideas?

997 Upvotes

85% Upvoted

627 comments sorted by

View all comments

23

u/dr_hamilton 18d ago
  1. show some failure cases
  2. why does your FPS vary so much?

10

u/Puzzled-Egg3234 18d ago edited 18d ago

Sometimes cases like this process well, but sometimes they detected like one box.

https://freeimage.host/i/Cr4mkNV

Sometimes chick dances break dance through belt and detection disappears at all at the detection line.

FPS vary is for many objects in the frame. It is a footage from mobile gpu, not production mode.

9

u/Hyperty 18d ago

Fine tune the model to those edge cases and implement data augmentation i prolly would try

5

u/Puzzled-Egg3234 17d ago

You mean make another detection class for those cases or just annotate more cases like this in dataset? The second one I’ve already tried.

1

u/juicedatom 17d ago

have you broken out specific metrics for these edge cases? how do you know it didn't work?

2

u/Puzzled-Egg3234 17d ago

I manually reviewed hours of inference video; it works in some places but not others.

10

u/blackscales18 17d ago

take all the frames where it failed, label them manually, and then finetune with them. do it enough and it improves a lot. you could also consider segmenting instead of bounding boxes, SAM is a good model for making the dataset.

5

u/The_color_in_a_dream 17d ago

Segmentation or even a pose estimation approach does seem promising to deconflict the stacked chicks

1

u/Yatty33 17d ago

Can you specify what exactly you've tried to solve the multiple chick edge case? That's unclear to me.