test_runner: fix suite rerun #3299

Job	Run time
Build slim tarball	2m 26s
aarch64-linux: with shared libraries	1h 21m 53s
x86_64-linux: with shared libraries	1h 57m 38s
x86_64-darwin: with shared libraries	2h 7m 8s
aarch64-darwin: with shared libraries	2h 6m 47s
	7h 35m 52s

Provide feedback