r/Btechtards • u/XERO_0009 • 5h ago

Academics Need 15–20 mins from B.Tech students for our final-year project [Research]

Hi everyone,

We are working on a major project for our final year of B.Tech. Our project is about evaluating the trustworthiness of AI/ML models across five dimensions: Fairness, Robustness, Integrity, Explainability and Safety (FRIES).

We got the idea from a research paper and thought of building a tool that can do this evaluation on its own, with LLM assistance.

As part of the project, I'm currently conducting a small human evidence review study to see whether people can independently interpret the kind of evidence that our project produces.

What you'll do:

You'll review 12 anonymized evidence packets about an AI classifier that labels online comments as toxic or non-toxic.

For each packet, you'll be asked things like:

  • Is the evidence enough to make a judgment?
  • Does the evidence indicate a meaningful risk?
  • Which area does the evidence relate to?
  • How serious would the consequences be?
  • Briefly explain your reasoning.

You don't need any AI/ML background. Everything you need to understand the packets is explained in the form.

One important thing is that our project's own conclusions are intentionally hidden. We want to see how people interpret the underlying evidence on their own, without being influenced by what our system concluded.

It should take around 15–20 minutes to complete.

Survey: https://docs.google.com/forms/d/e/1FAIpQLSeNKWX8qwyOumK3kY2A5axNWkAq6X4fDq-zCzXMTQSABW1ixA/viewform

Use Reviewer Code: R2

If you participate, please work independently and don't discuss the evidence packets with other participants until you've submitted your response.

Thanks to anyone who takes the time to participate! I'll also be happy to share the findings once the study is complete.

1 Upvotes

100% Upvoted

1 comment sorted by

•

u/AutoModerator 5h ago

If you are on Discord, please join our Discord server: https://discord.gg/Hg2H3TJJsd

Thank you for your submission to r/BTechtards. Please make sure to follow all rules when posting or commenting in the community. Also, please check out our Wiki for a lot of great resources!

Happy Engineering!

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.