Skip to content
Test Shared libraries

test_runner: support test order randomization #3201

Sign in to view logs

test_runner: support test order randomization

test_runner: support test order randomization #3201

Triggered via pull request February 9, 2026 08:09
@pmarchinipmarchini
synchronize #61747
pmarchini:test_runner/deterministic-test-randomizer
Status Failure
Total duration 1h 5m 57s
Artifacts 1

test-shared.yml

on: pull_request
Build slim tarball
1m 34s
Build slim tarball
Matrix: build
Fit to window
Zoom out
Zoom in

Annotations

12 errors
aarch64-linux: with shared libraries
Process completed with exit code 2.
aarch64-linux: with shared libraries: test/parallel/test-process-env-allowed-flags-are-documented.js#L114
--- stderr --- node:internal/assert/utils:146 throw error; ^ AssertionError [ERR_ASSERTION]: The following options are documented as allowed in NODE_OPTIONS in /home/runner/work/_temp/node-v26.0.0-nightly2026-02-09351efb6a9e-slim/doc/api/cli.md: --test-random-seed --test-randomize but are not in process.allowedNodeEnvironmentFlags 2 !== 0 at Object.<anonymous> (/home/runner/work/_temp/node-v26.0.0-nightly2026-02-09351efb6a9e-slim/test/parallel/test-process-env-allowed-flags-are-documented.js:114:8) at Module._compile (node:internal/modules/cjs/loader:1811:14) at Object..js (node:internal/modules/cjs/loader:1942:10) at Module.load (node:internal/modules/cjs/loader:1532:32) at Module._load (node:internal/modules/cjs/loader:1334:12) at wrapModuleLoad (node:internal/modules/cjs/loader:255:19) at Module.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:154:5) at node:internal/main/run_main_module:33:47 { generatedMessage: false, code: 'ERR_ASSERTION', actual: 2, expected: 0, operator: 'strictEqual', diff: 'simple' } Node.js v26.0.0-pre Command: out/Release/node /home/runner/work/_temp/node-v26.0.0-nightly2026-02-09351efb6a9e-slim/test/parallel/test-process-env-allowed-flags-are-documented.js
aarch64-linux: with shared libraries: test/parallel/test-cli-node-cli-manpage-options.mjs#L0
--- stderr --- node:internal/modules/run_main:107 triggerUncaughtException( ^ AssertionError [ERR_ASSERTION]: The following flag (present in `doc/api/cli.md`) is missing in the `doc/node.1` file: "--test-random-seed" at file:///home/runner/work/_temp/node-v26.0.0-nightly2026-02-09351efb6a9e-slim/test/parallel/test-cli-node-cli-manpage-options.mjs:48:14 at process.processTicksAndRejections (node:internal/process/task_queues:104:5) { generatedMessage: false, code: 'ERR_ASSERTION', actual: undefined, expected: undefined, operator: 'fail', diff: 'simple' } Node.js v26.0.0-pre Command: out/Release/node /home/runner/work/_temp/node-v26.0.0-nightly2026-02-09351efb6a9e-slim/test/parallel/test-cli-node-cli-manpage-options.mjs
aarch64-darwin: with shared libraries
Process completed with exit code 2.
aarch64-darwin: with shared libraries: test/parallel/test-process-env-allowed-flags-are-documented.js#L114
--- stderr --- node:internal/assert/utils:146 throw error; ^ AssertionError [ERR_ASSERTION]: The following options are documented as allowed in NODE_OPTIONS in /Users/runner/work/_temp/node-v26.0.0-nightly2026-02-09351efb6a9e-slim/doc/api/cli.md: --test-random-seed --test-randomize but are not in process.allowedNodeEnvironmentFlags 2 !== 0 at Object.<anonymous> (/Users/runner/work/_temp/node-v26.0.0-nightly2026-02-09351efb6a9e-slim/test/parallel/test-process-env-allowed-flags-are-documented.js:114:8) at Module._compile (node:internal/modules/cjs/loader:1811:14) at Object..js (node:internal/modules/cjs/loader:1942:10) at Module.load (node:internal/modules/cjs/loader:1532:32) at Module._load (node:internal/modules/cjs/loader:1334:12) at wrapModuleLoad (node:internal/modules/cjs/loader:255:19) at Module.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:154:5) at node:internal/main/run_main_module:33:47 { generatedMessage: false, code: 'ERR_ASSERTION', actual: 2, expected: 0, operator: 'strictEqual', diff: 'simple' } Node.js v26.0.0-pre Command: out/Release/node /Users/runner/work/_temp/node-v26.0.0-nightly2026-02-09351efb6a9e-slim/test/parallel/test-process-env-allowed-flags-are-documented.js
aarch64-darwin: with shared libraries: test/parallel/test-cli-node-cli-manpage-options.mjs#L0
--- stderr --- node:internal/modules/run_main:107 triggerUncaughtException( ^ AssertionError [ERR_ASSERTION]: The following flag (present in `doc/api/cli.md`) is missing in the `doc/node.1` file: "--test-random-seed" at file:///Users/runner/work/_temp/node-v26.0.0-nightly2026-02-09351efb6a9e-slim/test/parallel/test-cli-node-cli-manpage-options.mjs:48:14 at process.processTicksAndRejections (node:internal/process/task_queues:104:5) { generatedMessage: false, code: 'ERR_ASSERTION', actual: undefined, expected: undefined, operator: 'fail', diff: 'simple' } Node.js v26.0.0-pre Command: out/Release/node /Users/runner/work/_temp/node-v26.0.0-nightly2026-02-09351efb6a9e-slim/test/parallel/test-cli-node-cli-manpage-options.mjs
x86_64-linux: with shared libraries
Process completed with exit code 2.
x86_64-linux: with shared libraries: test/parallel/test-process-env-allowed-flags-are-documented.js#L114
--- stderr --- node:internal/assert/utils:146 throw error; ^ AssertionError [ERR_ASSERTION]: The following options are documented as allowed in NODE_OPTIONS in /home/runner/work/_temp/node-v26.0.0-nightly2026-02-09351efb6a9e-slim/doc/api/cli.md: --test-random-seed --test-randomize but are not in process.allowedNodeEnvironmentFlags 2 !== 0 at Object.<anonymous> (/home/runner/work/_temp/node-v26.0.0-nightly2026-02-09351efb6a9e-slim/test/parallel/test-process-env-allowed-flags-are-documented.js:114:8) at Module._compile (node:internal/modules/cjs/loader:1811:14) at Object..js (node:internal/modules/cjs/loader:1942:10) at Module.load (node:internal/modules/cjs/loader:1532:32) at Module._load (node:internal/modules/cjs/loader:1334:12) at wrapModuleLoad (node:internal/modules/cjs/loader:255:19) at Module.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:154:5) at node:internal/main/run_main_module:33:47 { generatedMessage: false, code: 'ERR_ASSERTION', actual: 2, expected: 0, operator: 'strictEqual', diff: 'simple' } Node.js v26.0.0-pre Command: out/Release/node /home/runner/work/_temp/node-v26.0.0-nightly2026-02-09351efb6a9e-slim/test/parallel/test-process-env-allowed-flags-are-documented.js
x86_64-linux: with shared libraries: test/parallel/test-cli-node-cli-manpage-options.mjs#L0
--- stderr --- node:internal/modules/run_main:107 triggerUncaughtException( ^ AssertionError [ERR_ASSERTION]: The following flag (present in `doc/api/cli.md`) is missing in the `doc/node.1` file: "--test-random-seed" at file:///home/runner/work/_temp/node-v26.0.0-nightly2026-02-09351efb6a9e-slim/test/parallel/test-cli-node-cli-manpage-options.mjs:48:14 at process.processTicksAndRejections (node:internal/process/task_queues:104:5) { generatedMessage: false, code: 'ERR_ASSERTION', actual: undefined, expected: undefined, operator: 'fail', diff: 'simple' } Node.js v26.0.0-pre Command: out/Release/node /home/runner/work/_temp/node-v26.0.0-nightly2026-02-09351efb6a9e-slim/test/parallel/test-cli-node-cli-manpage-options.mjs
x86_64-darwin: with shared libraries
Process completed with exit code 2.
x86_64-darwin: with shared libraries: test/parallel/test-process-env-allowed-flags-are-documented.js#L114
--- stderr --- node:internal/assert/utils:146 throw error; ^ AssertionError [ERR_ASSERTION]: The following options are documented as allowed in NODE_OPTIONS in /Users/runner/work/_temp/node-v26.0.0-nightly2026-02-09351efb6a9e-slim/doc/api/cli.md: --test-random-seed --test-randomize but are not in process.allowedNodeEnvironmentFlags 2 !== 0 at Object.<anonymous> (/Users/runner/work/_temp/node-v26.0.0-nightly2026-02-09351efb6a9e-slim/test/parallel/test-process-env-allowed-flags-are-documented.js:114:8) at Module._compile (node:internal/modules/cjs/loader:1811:14) at Object..js (node:internal/modules/cjs/loader:1942:10) at Module.load (node:internal/modules/cjs/loader:1532:32) at Module._load (node:internal/modules/cjs/loader:1334:12) at wrapModuleLoad (node:internal/modules/cjs/loader:255:19) at Module.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:154:5) at node:internal/main/run_main_module:33:47 { generatedMessage: false, code: 'ERR_ASSERTION', actual: 2, expected: 0, operator: 'strictEqual', diff: 'simple' } Node.js v26.0.0-pre Command: out/Release/node /Users/runner/work/_temp/node-v26.0.0-nightly2026-02-09351efb6a9e-slim/test/parallel/test-process-env-allowed-flags-are-documented.js
x86_64-darwin: with shared libraries: test/parallel/test-cli-node-cli-manpage-options.mjs#L0
--- stderr --- node:internal/modules/run_main:107 triggerUncaughtException( ^ AssertionError [ERR_ASSERTION]: The following flag (present in `doc/api/cli.md`) is missing in the `doc/node.1` file: "--test-random-seed" at file:///Users/runner/work/_temp/node-v26.0.0-nightly2026-02-09351efb6a9e-slim/test/parallel/test-cli-node-cli-manpage-options.mjs:48:14 at process.processTicksAndRejections (node:internal/process/task_queues:104:5) { generatedMessage: false, code: 'ERR_ASSERTION', actual: undefined, expected: undefined, operator: 'fail', diff: 'simple' } Node.js v26.0.0-pre Command: out/Release/node /Users/runner/work/_temp/node-v26.0.0-nightly2026-02-09351efb6a9e-slim/test/parallel/test-cli-node-cli-manpage-options.mjs

Artifacts

Produced during runtime
Name Size Digest
tarballs
47.8 MB
sha256:91ce98bda799f1a5978d94bbcc5100b4d27878353ca877878ce00b9fd2f0c538