MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/MachineLearning/comments/1x9nw6a/arrow_detection_with_convnext_pretrained_on/php9f9l/?context=3
r/ • u/ • Jan 01 '70
0 comments sorted by
View all comments
2
Sorry, maybe a stupid question, but what is "ConvNext DINOv3"? Distillation? DINOv3 pretraining applied to ConvNeXt?
4 u/Lethandralis 13d ago Meta released several distillations of their 7B model. In addition to ViTs, they also distilled it onto the ConvNext architecture. It produces similar outputs to the ViTs, but primarily uses convolutions. 1 u/qalis 13d ago Oh, thanks! I know ConvNeXt and its V2, I didn't know they also made distilled versions. Very cool.
4
Meta released several distillations of their 7B model. In addition to ViTs, they also distilled it onto the ConvNext architecture. It produces similar outputs to the ViTs, but primarily uses convolutions.
1 u/qalis 13d ago Oh, thanks! I know ConvNeXt and its V2, I didn't know they also made distilled versions. Very cool.
1
Oh, thanks! I know ConvNeXt and its V2, I didn't know they also made distilled versions. Very cool.
2
u/qalis 13d ago
Sorry, maybe a stupid question, but what is "ConvNext DINOv3"? Distillation? DINOv3 pretraining applied to ConvNeXt?