test_runner: differentiate todo and failure styles #2778
Triggered via pull request
January 28, 2026 15:58
MoLow
Status
Cancelled
Total duration
1h 54m 15s
Artifacts
1
test-shared.yml
on: pull_request
Build slim tarball
1m 32s
Matrix: build
Annotations
9 errors
|
aarch64-darwin: with shared libraries
Process completed with exit code 2.
|
|
aarch64-darwin: with shared libraries:
test/test-runner/test-output-dot-reporter.mjs#L0
--- stderr ---
node:internal/modules/run_main:107
triggerUncaughtException(
^
AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
+ actual - expected
... Skipped lines
'........XX...X..XXX.\n' +
'X.....XXX...........\n' +
'.X.........X...XXX.X\n' +
'X.....XXXXXXX...XXXX\n' +
'X\n' +
...
'\n' +
+ 'β sync fail todo (*ms) # TODO\n' +
- 'β sync fail todo (*ms) # TODO\n' +
' Error: thrown from sync fail todo\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
...
' *\n' +
+ 'β sync fail todo with message (*ms) # this is a failing todo\n' +
- 'β sync fail todo with message (*ms) # this is a failing todo\n' +
' Error: thrown from sync fail todo with message\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
at assertSnapshot (/Users/runner/work/_temp/node-v26.0.0-nightly2026-01-284e66591a5b-slim/test/common/assertSnapshot.js:66:12)
at async spawnAndAssert (/Users/runner/work/_temp/node-v26.0.0-nightly2026-01-284e66591a5b-slim/test/common/assertSnapshot.js:101:3)
at async file:///Users/runner/work/_temp/node-v26.0.0-nightly2026-01-284e66591a5b-slim/test/test-runner/test-output-dot-reporter.mjs:7:1 {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: '........XX...X..XXX.\n' +
'X.....XXX...........\n' +
'.X.........X...XXX.X\n' +
'X.....XXXXXXX...XXXX\n' +
'X\n' +
'\n' +
'Failed tests:\n' +
'\n' +
'β sync fail todo (*ms) # TODO\n' +
' Error: thrown from sync fail todo\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
'β sync fail todo with message (*ms) # this is a failing todo\n' +
' Error: thrown from sync fail todo with message\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
'β sync throw fail (*ms)\n' +
' Error: thrown from sync throw fail\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
'β async throw fail (*ms)\n' +
' Error: thrown from async throw fail\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
'οΉ£ async skip fail (*ms) # SKIP\n' +
' Error: thrown from async throw fail\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
'β async assertion fail (*ms)\n' +
' AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:\n' +
' \n' +
' true !== false\n' +
' \n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' * {\n' +
' generatedMessage: true,\n' +
" code: 'ERR_ASSERTION',\n" +
' actual: true,\n' +
' expected: false,\n' +
" operator: 'strictEqual',\n" +
" diff: 'simple'\n" +
' }\n' +
'β reject fail (*ms)\n' +
' Error: rejected from reject fail\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
'β +sync throw fail (*ms)\n' +
' Error: thrown from subtest sync throw fail\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
'β subtest sync throw fail (*ms)\n' +
" '1 subtest failed'\n" +
'β sync throw non-error fail (*ms)\n' +
' Symbol(thrown symbol from sync throw non-error fail)\n' +
'β sync skip option is false fail (*ms)\n' +
' Error: this should be executed\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
'β callback fail (*ms)\n' +
' Error: callback failure\n' +
' *\n' +
|
|
aarch64-linux: with shared libraries
Process completed with exit code 2.
|
|
aarch64-linux: with shared libraries:
test/test-runner/test-output-dot-reporter.mjs#L0
--- stderr ---
node:internal/modules/run_main:107
triggerUncaughtException(
^
AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
+ actual - expected
... Skipped lines
'........XX...X..XXX.\n' +
'X.....XXX...........\n' +
'.X.........X...XXX.X\n' +
'X.....XXXXXXX...XXXX\n' +
'X\n' +
...
'\n' +
+ 'β sync fail todo (*ms) # TODO\n' +
- 'β sync fail todo (*ms) # TODO\n' +
' Error: thrown from sync fail todo\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
...
' *\n' +
+ 'β sync fail todo with message (*ms) # this is a failing todo\n' +
- 'β sync fail todo with message (*ms) # this is a failing todo\n' +
' Error: thrown from sync fail todo with message\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
at assertSnapshot (/home/runner/work/_temp/node-v26.0.0-nightly2026-01-284e66591a5b-slim/test/common/assertSnapshot.js:66:12)
at async spawnAndAssert (/home/runner/work/_temp/node-v26.0.0-nightly2026-01-284e66591a5b-slim/test/common/assertSnapshot.js:101:3)
at async file:///home/runner/work/_temp/node-v26.0.0-nightly2026-01-284e66591a5b-slim/test/test-runner/test-output-dot-reporter.mjs:7:1 {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: '........XX...X..XXX.\n' +
'X.....XXX...........\n' +
'.X.........X...XXX.X\n' +
'X.....XXXXXXX...XXXX\n' +
'X\n' +
'\n' +
'Failed tests:\n' +
'\n' +
'β sync fail todo (*ms) # TODO\n' +
' Error: thrown from sync fail todo\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
'β sync fail todo with message (*ms) # this is a failing todo\n' +
' Error: thrown from sync fail todo with message\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
'β sync throw fail (*ms)\n' +
' Error: thrown from sync throw fail\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
'β async throw fail (*ms)\n' +
' Error: thrown from async throw fail\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
'οΉ£ async skip fail (*ms) # SKIP\n' +
' Error: thrown from async throw fail\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
'β async assertion fail (*ms)\n' +
' AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:\n' +
' \n' +
' true !== false\n' +
' \n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' * {\n' +
' generatedMessage: true,\n' +
" code: 'ERR_ASSERTION',\n" +
' actual: true,\n' +
' expected: false,\n' +
" operator: 'strictEqual',\n" +
" diff: 'simple'\n" +
' }\n' +
'β reject fail (*ms)\n' +
' Error: rejected from reject fail\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
'β +sync throw fail (*ms)\n' +
' Error: thrown from subtest sync throw fail\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
'β subtest sync throw fail (*ms)\n' +
" '1 subtest failed'\n" +
'β sync throw non-error fail (*ms)\n' +
' Symbol(thrown symbol from sync throw non-error fail)\n' +
'β sync skip option is false fail (*ms)\n' +
' Error: this should be executed\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
'β callback fail (*ms)\n' +
' Error: callback failure\n' +
' *\n' +
|
|
x86_64-darwin: with shared libraries
Process completed with exit code 2.
|
|
x86_64-darwin: with shared libraries:
test/test-runner/test-output-dot-reporter.mjs#L0
--- stderr ---
node:internal/modules/run_main:107
triggerUncaughtException(
^
AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
+ actual - expected
... Skipped lines
'........XX...X..XXX.\n' +
'X.....XXX...........\n' +
'.X.........X...XXX.X\n' +
'X.....XXXXXXX...XXXX\n' +
'X\n' +
...
'\n' +
+ 'β sync fail todo (*ms) # TODO\n' +
- 'β sync fail todo (*ms) # TODO\n' +
' Error: thrown from sync fail todo\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
...
' *\n' +
+ 'β sync fail todo with message (*ms) # this is a failing todo\n' +
- 'β sync fail todo with message (*ms) # this is a failing todo\n' +
' Error: thrown from sync fail todo with message\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
at assertSnapshot (/Users/runner/work/_temp/node-v26.0.0-nightly2026-01-284e66591a5b-slim/test/common/assertSnapshot.js:66:12)
at async spawnAndAssert (/Users/runner/work/_temp/node-v26.0.0-nightly2026-01-284e66591a5b-slim/test/common/assertSnapshot.js:101:3)
at async file:///Users/runner/work/_temp/node-v26.0.0-nightly2026-01-284e66591a5b-slim/test/test-runner/test-output-dot-reporter.mjs:7:1 {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: '........XX...X..XXX.\n' +
'X.....XXX...........\n' +
'.X.........X...XXX.X\n' +
'X.....XXXXXXX...XXXX\n' +
'X\n' +
'\n' +
'Failed tests:\n' +
'\n' +
'β sync fail todo (*ms) # TODO\n' +
' Error: thrown from sync fail todo\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
'β sync fail todo with message (*ms) # this is a failing todo\n' +
' Error: thrown from sync fail todo with message\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
'β sync throw fail (*ms)\n' +
' Error: thrown from sync throw fail\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
'β async throw fail (*ms)\n' +
' Error: thrown from async throw fail\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
'οΉ£ async skip fail (*ms) # SKIP\n' +
' Error: thrown from async throw fail\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
'β async assertion fail (*ms)\n' +
' AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:\n' +
' \n' +
' true !== false\n' +
' \n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' * {\n' +
' generatedMessage: true,\n' +
" code: 'ERR_ASSERTION',\n" +
' actual: true,\n' +
' expected: false,\n' +
" operator: 'strictEqual',\n" +
" diff: 'simple'\n" +
' }\n' +
'β reject fail (*ms)\n' +
' Error: rejected from reject fail\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
'β +sync throw fail (*ms)\n' +
' Error: thrown from subtest sync throw fail\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
'β subtest sync throw fail (*ms)\n' +
" '1 subtest failed'\n" +
'β sync throw non-error fail (*ms)\n' +
' Symbol(thrown symbol from sync throw non-error fail)\n' +
'β sync skip option is false fail (*ms)\n' +
' Error: this should be executed\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
' *\n' +
'β callback fail (*ms)\n' +
' Error: callback failure\n' +
' *\n' +
|
|
x86_64-linux: with shared libraries
Canceling since a higher priority waiting request for Test Shared libraries-todo-style exists
|
|
x86_64-linux: with shared libraries
The operation was canceled.
|
|
Test Shared libraries
Canceling since a higher priority waiting request for Test Shared libraries-todo-style exists
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
tarballs
|
50.6 MB |
sha256:c3152bcb83c04c73bcfd07138585843e1183621bf95761b9638141aab903ff0f
|
|