test_runner: support test order randomization #3204

Job	Run time
Build slim tarball	1m 35s
x86_64-darwin: with shared libraries	1h 12m 53s
aarch64-darwin: with shared libraries	1h 21m 36s
x86_64-linux: with shared libraries	49m 0s
aarch64-linux: with shared libraries	35m 39s
	4h 0m 43s

Provide feedback