Skip to content
Test Shared libraries

test_runner: support test order randomization #3275

Sign in to view logs

test_runner: support test order randomization

test_runner: support test order randomization #3275

Triggered via pull request February 10, 2026 22:34
@pmarchinipmarchini
synchronize #61747
pmarchini:test_runner/deterministic-test-randomizer
Status Failure
Total duration 1h 16m 16s
Artifacts 1

test-shared.yml

on: pull_request
Build slim tarball
2m 8s
Build slim tarball
Matrix: build
Fit to window
Zoom out
Zoom in

Annotations

8 errors
aarch64-linux: with shared libraries
Process completed with exit code 2.
aarch64-linux: with shared libraries: test/test-runner/test-output-randomize-output-cli.mjs#L0
--- stderr --- node:internal/modules/run_main:107 triggerUncaughtException( ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: + actual - expected '✔ g.cjs this should pass (*ms)\n' + '✔ e.cjs this should pass (*ms)\n' + '✔ i.cjs this should pass (*ms)\n' + + '✔ j.cjs this should pass (*ms)\n' + - '✔ a.cjs this should pass (*ms)\n' + '✔ b.cjs this should pass (*ms)\n' + + '✔ f.cjs this should pass (*ms)\n' + + '✔ c.cjs this should pass (*ms)\n' + '✔ h.cjs this should pass (*ms)\n' + + '✔ a.cjs this should pass (*ms)\n' + - '✔ f.cjs this should pass (*ms)\n' + '✔ d.cjs this should pass (*ms)\n' + - '✔ c.cjs this should pass (*ms)\n' + - '✔ j.cjs this should pass (*ms)\n' + 'ℹ Randomized test order seed: 12345\n' + 'ℹ tests 10\n' + 'ℹ suites 0\n' + 'ℹ pass 10\n' + 'ℹ fail 0\n' + at assertSnapshot (/home/runner/work/_temp/node-v26.0.0-nightly2026-02-10ed6de84552-slim/test/common/assertSnapshot.js:107:12) at async spawnAndAssert (/home/runner/work/_temp/node-v26.0.0-nightly2026-02-10ed6de84552-slim/test/common/assertSnapshot.js:142:3) at async file:///home/runner/work/_temp/node-v26.0.0-nightly2026-02-10ed6de84552-slim/test/test-runner/test-output-randomize-output-cli.mjs:8:1 { generatedMessage: true, code: 'ERR_ASSERTION', actual: '✔ g.cjs this should pass (*ms)\n' + '✔ e.cjs this should pass (*ms)\n' + '✔ i.cjs this should pass (*ms)\n' + '✔ j.cjs this should pass (*ms)\n' + '✔ b.cjs this should pass (*ms)\n' + '✔ f.cjs this should pass (*ms)\n' + '✔ c.cjs this should pass (*ms)\n' + '✔ h.cjs this should pass (*ms)\n' + '✔ a.cjs this should pass (*ms)\n' + '✔ d.cjs this should pass (*ms)\n' + 'ℹ Randomized test order seed: 12345\n' + 'ℹ tests 10\n' + 'ℹ suites 0\n' + 'ℹ pass 10\n' + 'ℹ fail 0\n' + 'ℹ cancelled 0\n' + 'ℹ skipped 0\n' + 'ℹ todo 0\n' + 'ℹ duration_ms *\n', expected: '✔ g.cjs this should pass (*ms)\n' + '✔ e.cjs this should pass (*ms)\n' + '✔ i.cjs this should pass (*ms)\n' + '✔ a.cjs this should pass (*ms)\n' + '✔ b.cjs this should pass (*ms)\n' + '✔ h.cjs this should pass (*ms)\n' + '✔ f.cjs this should pass (*ms)\n' + '✔ d.cjs this should pass (*ms)\n' + '✔ c.cjs this should pass (*ms)\n' + '✔ j.cjs this should pass (*ms)\n' + 'ℹ Randomized test order seed: 12345\n' + 'ℹ tests 10\n' + 'ℹ suites 0\n' + 'ℹ pass 10\n' + 'ℹ fail 0\n' + 'ℹ cancelled 0\n' + 'ℹ skipped 0\n' + 'ℹ todo 0\n' + 'ℹ duration_ms *\n', operator: 'strictEqual', diff: 'simple' } Node.js v26.0.0-pre Command: out/Release/node /home/runner/work/_temp/node-v26.0.0-nightly2026-02-10ed6de84552-slim/test/test-runner/test-output-randomize-output-cli.mjs
x86_64-linux: with shared libraries
Process completed with exit code 2.
x86_64-linux: with shared libraries: test/test-runner/test-output-randomize-output-cli.mjs#L0
--- stderr --- node:internal/modules/run_main:107 triggerUncaughtException( ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: + actual - expected '✔ g.cjs this should pass (*ms)\n' + '✔ e.cjs this should pass (*ms)\n' + '✔ i.cjs this should pass (*ms)\n' + + '✔ j.cjs this should pass (*ms)\n' + - '✔ a.cjs this should pass (*ms)\n' + '✔ b.cjs this should pass (*ms)\n' + + '✔ f.cjs this should pass (*ms)\n' + + '✔ c.cjs this should pass (*ms)\n' + '✔ h.cjs this should pass (*ms)\n' + + '✔ a.cjs this should pass (*ms)\n' + - '✔ f.cjs this should pass (*ms)\n' + '✔ d.cjs this should pass (*ms)\n' + - '✔ c.cjs this should pass (*ms)\n' + - '✔ j.cjs this should pass (*ms)\n' + 'ℹ Randomized test order seed: 12345\n' + 'ℹ tests 10\n' + 'ℹ suites 0\n' + 'ℹ pass 10\n' + 'ℹ fail 0\n' + at assertSnapshot (/home/runner/work/_temp/node-v26.0.0-nightly2026-02-10ed6de84552-slim/test/common/assertSnapshot.js:107:12) at async spawnAndAssert (/home/runner/work/_temp/node-v26.0.0-nightly2026-02-10ed6de84552-slim/test/common/assertSnapshot.js:142:3) at async file:///home/runner/work/_temp/node-v26.0.0-nightly2026-02-10ed6de84552-slim/test/test-runner/test-output-randomize-output-cli.mjs:8:1 { generatedMessage: true, code: 'ERR_ASSERTION', actual: '✔ g.cjs this should pass (*ms)\n' + '✔ e.cjs this should pass (*ms)\n' + '✔ i.cjs this should pass (*ms)\n' + '✔ j.cjs this should pass (*ms)\n' + '✔ b.cjs this should pass (*ms)\n' + '✔ f.cjs this should pass (*ms)\n' + '✔ c.cjs this should pass (*ms)\n' + '✔ h.cjs this should pass (*ms)\n' + '✔ a.cjs this should pass (*ms)\n' + '✔ d.cjs this should pass (*ms)\n' + 'ℹ Randomized test order seed: 12345\n' + 'ℹ tests 10\n' + 'ℹ suites 0\n' + 'ℹ pass 10\n' + 'ℹ fail 0\n' + 'ℹ cancelled 0\n' + 'ℹ skipped 0\n' + 'ℹ todo 0\n' + 'ℹ duration_ms *\n', expected: '✔ g.cjs this should pass (*ms)\n' + '✔ e.cjs this should pass (*ms)\n' + '✔ i.cjs this should pass (*ms)\n' + '✔ a.cjs this should pass (*ms)\n' + '✔ b.cjs this should pass (*ms)\n' + '✔ h.cjs this should pass (*ms)\n' + '✔ f.cjs this should pass (*ms)\n' + '✔ d.cjs this should pass (*ms)\n' + '✔ c.cjs this should pass (*ms)\n' + '✔ j.cjs this should pass (*ms)\n' + 'ℹ Randomized test order seed: 12345\n' + 'ℹ tests 10\n' + 'ℹ suites 0\n' + 'ℹ pass 10\n' + 'ℹ fail 0\n' + 'ℹ cancelled 0\n' + 'ℹ skipped 0\n' + 'ℹ todo 0\n' + 'ℹ duration_ms *\n', operator: 'strictEqual', diff: 'simple' } Node.js v26.0.0-pre Command: out/Release/node /home/runner/work/_temp/node-v26.0.0-nightly2026-02-10ed6de84552-slim/test/test-runner/test-output-randomize-output-cli.mjs
aarch64-darwin: with shared libraries
Process completed with exit code 2.
aarch64-darwin: with shared libraries: test/test-runner/test-output-randomize-output-cli.mjs#L0
--- stderr --- node:internal/modules/run_main:107 triggerUncaughtException( ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: + actual - expected '✔ g.cjs this should pass (*ms)\n' + '✔ e.cjs this should pass (*ms)\n' + + '✔ j.cjs this should pass (*ms)\n' + - '✔ i.cjs this should pass (*ms)\n' + - '✔ a.cjs this should pass (*ms)\n' + '✔ b.cjs this should pass (*ms)\n' + '✔ h.cjs this should pass (*ms)\n' + + '✔ c.cjs this should pass (*ms)\n' + '✔ f.cjs this should pass (*ms)\n' + + '✔ a.cjs this should pass (*ms)\n' + + '✔ i.cjs this should pass (*ms)\n' + '✔ d.cjs this should pass (*ms)\n' + - '✔ c.cjs this should pass (*ms)\n' + - '✔ j.cjs this should pass (*ms)\n' + 'ℹ Randomized test order seed: 12345\n' + 'ℹ tests 10\n' + 'ℹ suites 0\n' + 'ℹ pass 10\n' + 'ℹ fail 0\n' + at assertSnapshot (/Users/runner/work/_temp/node-v26.0.0-nightly2026-02-10ed6de84552-slim/test/common/assertSnapshot.js:107:12) at async spawnAndAssert (/Users/runner/work/_temp/node-v26.0.0-nightly2026-02-10ed6de84552-slim/test/common/assertSnapshot.js:142:3) at async file:///Users/runner/work/_temp/node-v26.0.0-nightly2026-02-10ed6de84552-slim/test/test-runner/test-output-randomize-output-cli.mjs:8:1 { generatedMessage: true, code: 'ERR_ASSERTION', actual: '✔ g.cjs this should pass (*ms)\n' + '✔ e.cjs this should pass (*ms)\n' + '✔ j.cjs this should pass (*ms)\n' + '✔ b.cjs this should pass (*ms)\n' + '✔ h.cjs this should pass (*ms)\n' + '✔ c.cjs this should pass (*ms)\n' + '✔ f.cjs this should pass (*ms)\n' + '✔ a.cjs this should pass (*ms)\n' + '✔ i.cjs this should pass (*ms)\n' + '✔ d.cjs this should pass (*ms)\n' + 'ℹ Randomized test order seed: 12345\n' + 'ℹ tests 10\n' + 'ℹ suites 0\n' + 'ℹ pass 10\n' + 'ℹ fail 0\n' + 'ℹ cancelled 0\n' + 'ℹ skipped 0\n' + 'ℹ todo 0\n' + 'ℹ duration_ms *\n', expected: '✔ g.cjs this should pass (*ms)\n' + '✔ e.cjs this should pass (*ms)\n' + '✔ i.cjs this should pass (*ms)\n' + '✔ a.cjs this should pass (*ms)\n' + '✔ b.cjs this should pass (*ms)\n' + '✔ h.cjs this should pass (*ms)\n' + '✔ f.cjs this should pass (*ms)\n' + '✔ d.cjs this should pass (*ms)\n' + '✔ c.cjs this should pass (*ms)\n' + '✔ j.cjs this should pass (*ms)\n' + 'ℹ Randomized test order seed: 12345\n' + 'ℹ tests 10\n' + 'ℹ suites 0\n' + 'ℹ pass 10\n' + 'ℹ fail 0\n' + 'ℹ cancelled 0\n' + 'ℹ skipped 0\n' + 'ℹ todo 0\n' + 'ℹ duration_ms *\n', operator: 'strictEqual', diff: 'simple' } Node.js v26.0.0-pre Command: out/Release/node /Users/runner/work/_temp/node-v26.0.0-nightly2026-02-10ed6de84552-slim/test/test-runner/test-output-randomize-output-cli.mjs
x86_64-darwin: with shared libraries
Process completed with exit code 2.
x86_64-darwin: with shared libraries: test/test-runner/test-output-randomize-output-cli.mjs#L0
--- stderr --- node:internal/modules/run_main:107 triggerUncaughtException( ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: + actual - expected '✔ g.cjs this should pass (*ms)\n' + '✔ e.cjs this should pass (*ms)\n' + '✔ i.cjs this should pass (*ms)\n' + + '✔ j.cjs this should pass (*ms)\n' + - '✔ a.cjs this should pass (*ms)\n' + '✔ b.cjs this should pass (*ms)\n' + + '✔ f.cjs this should pass (*ms)\n' + + '✔ c.cjs this should pass (*ms)\n' + '✔ h.cjs this should pass (*ms)\n' + + '✔ a.cjs this should pass (*ms)\n' + - '✔ f.cjs this should pass (*ms)\n' + '✔ d.cjs this should pass (*ms)\n' + - '✔ c.cjs this should pass (*ms)\n' + - '✔ j.cjs this should pass (*ms)\n' + 'ℹ Randomized test order seed: 12345\n' + 'ℹ tests 10\n' + 'ℹ suites 0\n' + 'ℹ pass 10\n' + 'ℹ fail 0\n' + at assertSnapshot (/Users/runner/work/_temp/node-v26.0.0-nightly2026-02-10ed6de84552-slim/test/common/assertSnapshot.js:107:12) at async spawnAndAssert (/Users/runner/work/_temp/node-v26.0.0-nightly2026-02-10ed6de84552-slim/test/common/assertSnapshot.js:142:3) at async file:///Users/runner/work/_temp/node-v26.0.0-nightly2026-02-10ed6de84552-slim/test/test-runner/test-output-randomize-output-cli.mjs:8:1 { generatedMessage: true, code: 'ERR_ASSERTION', actual: '✔ g.cjs this should pass (*ms)\n' + '✔ e.cjs this should pass (*ms)\n' + '✔ i.cjs this should pass (*ms)\n' + '✔ j.cjs this should pass (*ms)\n' + '✔ b.cjs this should pass (*ms)\n' + '✔ f.cjs this should pass (*ms)\n' + '✔ c.cjs this should pass (*ms)\n' + '✔ h.cjs this should pass (*ms)\n' + '✔ a.cjs this should pass (*ms)\n' + '✔ d.cjs this should pass (*ms)\n' + 'ℹ Randomized test order seed: 12345\n' + 'ℹ tests 10\n' + 'ℹ suites 0\n' + 'ℹ pass 10\n' + 'ℹ fail 0\n' + 'ℹ cancelled 0\n' + 'ℹ skipped 0\n' + 'ℹ todo 0\n' + 'ℹ duration_ms *\n', expected: '✔ g.cjs this should pass (*ms)\n' + '✔ e.cjs this should pass (*ms)\n' + '✔ i.cjs this should pass (*ms)\n' + '✔ a.cjs this should pass (*ms)\n' + '✔ b.cjs this should pass (*ms)\n' + '✔ h.cjs this should pass (*ms)\n' + '✔ f.cjs this should pass (*ms)\n' + '✔ d.cjs this should pass (*ms)\n' + '✔ c.cjs this should pass (*ms)\n' + '✔ j.cjs this should pass (*ms)\n' + 'ℹ Randomized test order seed: 12345\n' + 'ℹ tests 10\n' + 'ℹ suites 0\n' + 'ℹ pass 10\n' + 'ℹ fail 0\n' + 'ℹ cancelled 0\n' + 'ℹ skipped 0\n' + 'ℹ todo 0\n' + 'ℹ duration_ms *\n', operator: 'strictEqual', diff: 'simple' } Node.js v26.0.0-pre Command: out/Release/node /Users/runner/work/_temp/node-v26.0.0-nightly2026-02-10ed6de84552-slim/test/test-runner/test-output-randomize-output-cli.mjs

Artifacts

Produced during runtime
Name Size Digest
tarballs
47.8 MB
sha256:c598e7d319d35fb39dd94fa62d2b5bff40e6b065fc2301997b551b7d488c267c