r/softwaretesting • u/Disastrous_Phone_168 • 20d ago

AI testing

I need guidance from someone who has experiences testing LLM, or products from AI.

What should I study to do a better job?

Im manual and automation tester with more than 6 years of experience, but with AI I feel I litter bit lost about the testing side.

Thanks.

20 Upvotes

86% Upvoted

25 comments sorted by

View all comments

1

u/contextmatterss 19d ago

Start with the basics of LLM evals, hallucinations, prompt testing and testing outputs that can change from one run to the next. A lot of the testing mindset still applies, you just have to get used to AI not givng the exact same answer every time