test_runner: support test order randomization #3282

Job	Run time
Build slim tarball	2m 26s
aarch64-linux: with shared libraries	35m 1s
x86_64-darwin: with shared libraries	1h 34m 6s
x86_64-linux: with shared libraries	44m 58s
aarch64-darwin: with shared libraries	51m 17s
	3h 47m 48s

Provide feedback