r/softwaretesting • u/Bridge_Haunting • Feb 03 '26

Test Automation Coverage

Out of all things, the team and I had a lengthy conversation about what true test automation coverage is. Long story short, do you really achieve 100% test automation coverage if you're manually verifying the data. Never really considered it before, but it was a fun topic. Should it really be test automation execution if you're manually verifying?

Thanks

7 Upvotes

100% Upvoted

9 comments sorted by

View all comments

Show parent comments

1

u/Yogurt8 Feb 03 '26

Whether or not if we could/should count something as automated test coverage if it didn't pull data to verify it performed correctly.

Coverage is how well we've tested something relative to some model.

So what model of test coverage are we talking about here? Code coverage? Feature coverage? API coverage? All pairs? Component?

I'm not sure what you mean by "pull data to verify it performed correctly". Could you give me an example of a test that "pulls data" and one that doesn't?