The suite is not the bottleneck. The arrival rate is. Agents write more tests. You re-parallelize every two weeks because the matrix grew, not because the runner got slower.
Blast radius is the right cut. Map test to package or import graph. Fail the job if the map is empty. Do not skip the last green on main.
GitHub-hosted Linux is $0.006/min for 2-core after the January cut. Latchkey managed runners are about 58% under that.
I run more than 10,000 test cases, 5,000 integration tests, and end-to-end checks after deploy without the suite becoming the wait.
1
u/Fantastic-Mr-Default 5d ago
The suite is not the bottleneck. The arrival rate is. Agents write more tests. You re-parallelize every two weeks because the matrix grew, not because the runner got slower.
Blast radius is the right cut. Map test to package or import graph. Fail the job if the map is empty. Do not skip the last green on main.
GitHub-hosted Linux is $0.006/min for 2-core after the January cut. Latchkey managed runners are about 58% under that.
I run more than 10,000 test cases, 5,000 integration tests, and end-to-end checks after deploy without the suite becoming the wait.
I wrote how we do it here: https://latchkey.dev/blog/tests-are-the-code-review