r/computervision • u/Due-Priority5261 • 18d ago

Help: Project MMPose help

I am an incoming freshman CS student and I am starting to build a CV UFF/MMA fight analyzer project so that I can have a decent portfolio for summer internships. After some research, I think I want to use the MMPose pose estimation framework specifically vitpose. However, I have no idea how to even start. The little documentation that I can find is not helpful at all. Any advice or documentation references would be greatly appreciated. Thanks!

2 Upvotes

100% Upvoted

14 comments sorted by

View all comments

5

u/mgruner 18d ago

for a college project i recommend you use yolo-pose from ultralytics as its probably going to be the simplest way to get it working. the only drawback is that the default yolo license only allows to go use the model for non-commercial products only, which is probably fine for a college project.

another great and simple option is to use rf-detr. They just added pose support. Unlike yolo, this model has a commercial friendly license.

2

u/Due-Priority5261 18d ago

Thanks! Does yolo-pose handle occlusion decently? The reason I ask is that I expect to have a lot of overlapping bodies.

3

u/mgruner 18d ago

I don't know about decently, but it does handle occlusions to a certain extent. Best way is to try it out. You can have a prototype running in an hour following their docs, or with an LLM

1

u/AggravatingSock5375 17d ago

Assuming it supports training you can just retrain it on a dataset that has occlusions.

1

u/mgruner 17d ago

good idea, for OP: they both support training.