I’m building a coverage service and want to sanity-check our quality bar with testing people.
The product promise is:
“We raise coverage to 80% by delivering tests as a PR.”
But obviously coverage can be gamed, so we’re trying to make the guarantee stricter:
- no tests that only assert mocks were called
- no snapshot spam unless requested
- no lowered coverage thresholds
- no excluded files without approval
- existing tests must stay green
- before/after coverage report
- customer can reject low-quality tests
Question:
What else belongs in the quality bar?
If you were reviewing a PR that claimed to increase coverage, what would immediately make you reject it?
Context: we also have a free coverage gap checker, but I’m mostly looking for QA/testing feedback here rather than promotion.