test-runner: fix rerun ambiguous test failures #2286

Job	Run time
Build slim tarball	1m 38s
x86_64-darwin: with shared libraries	2m 9s
aarch64-linux: with shared libraries	2m 4s
x86_64-linux: with shared libraries	2m 4s
aarch64-darwin: with shared libraries	2m 7s
	10m 2s

Provide feedback