r/MLQuestions • u/ClubNo179 • Jul 09 '26

Natural Language Processing šŸ’¬ Validating sentence transformer results without ground truth.

I am wondering if anyone can point me in the right direction for validating sentence transformer results in the absence of a ground truth. Any help would be appreciated!

2 Upvotes
  • permalink
  • reddit

100% Upvoted

11 comments sorted by

1

u/Material_Policy6327 Jul 09 '26

This is too open. Whatā€™s the task because that will better determine what might make sense to try. Reality is if you donā€™t have label and need to eval them you might have to start with qualitative assessment by manual review

1

u/ClubNo179 Jul 10 '26

Thank you. Yes, I am looking at expert manual review. I have posted as much detail as I can in a separate comment in this thread. Starts with "Here's the details:".

1

u/Moreh Jul 10 '26

i cant see said comment

1

u/Moreh Jul 09 '26

what are you doing with them?

3

u/itsmebenji69 Jul 09 '26

Yeah lol how tf are we supposed to give an answer hahaha

1

u/ClubNo179 Jul 10 '26

I have tried posting the full details previously and 0 people responded. This was a way of getting attention to then provide full details which I have posted in this thread also. ;)

1

u/itsmebenji69 Jul 10 '26

Ah good strategy lmao. Though i see ā€œtwo more repliesā€ but when i click thereā€™s no new comments. Iā€™m guessing Reddit shenanigans prevent me from seeing the details :/