test_runner: support test order randomization #3192

Job	Run time
Build slim tarball	1m 19s
x86_64-darwin: with shared libraries	3m 53s
aarch64-darwin: with shared libraries	3m 55s
aarch64-linux: with shared libraries	3m 46s
x86_64-linux: with shared libraries	3m 50s
	16m 43s

Provide feedback