Description
Version
v18.12.1
Platform
Darwin Kernel Version 22.1.0 root:xnu-8792.41.9~2/RELEASE_ARM64_T8103 arm64
Subsystem
node:test
What steps will reproduce the bug?
In my project I have a folder named 'test' with two files inside.
The first file (Unit one) contains describe and test with different variations of skip. All the asserts are intentionally failed.
import { describe, it, test } from 'node:test';
import { strict as assert } from 'node:assert';
describe('Unit one: group one', { skip: true }, () => {
it('test one', () => {
assert.strictEqual(1, 10);
})
})
describe.skip('Unit one: group two', () => {
it('test two', () => {
assert.strictEqual(1, 10);
})
})
test('Unit one: test three', { skip: true }, () => {
assert.strictEqual(1, 10);
})The second file contains describe and test with correct asserts (Unit two).
import { describe, it, test } from 'node:test';
import { strict as assert } from 'node:assert';
describe('Unit two: group one', () => {
it('test one', () => {
assert.strictEqual(1, 1);
})
})
test('Unit two: test two', () => {
assert.strictEqual(1, 1);
})Additionally, if I have the only file with combination of both skipped and ordinary describe and test (Unit three). This file was run separately.
import { describe, it, test } from 'node:test';
import { strict as assert } from 'node:assert';
describe('Unit three: group one', () => {
it('test one', () => {
assert.strictEqual(1, 1);
})
})
test('Unit three: test two', { skip: true }, () => {
assert.strictEqual(1, 1);
})
describe.skip('Unit three: group three', () => {
it('test one', () => {
assert.strictEqual(1, 1);
})
})
test('Unit three: test three', () => {
assert.strictEqual(1, 1);
})How often does it reproduce? Is there a required condition?
Every time when I use node --test
What is the expected behavior?
When I run node --test, I expect to see information about skipped tests in the final TAP result.
What do you see instead?
When I run node --test with 'test' folder, contains of the first and the second files, there are no skipped tests.
TAP version 13
# Subtest: /Users/deni/Desktop/web-tools/test/one.mjs
ok 1 - /Users/deni/Desktop/web-tools/test/one.mjs
---
duration_ms: 47.325042
...
# Subtest: /Users/deni/Desktop/web-tools/test/two.mjs
ok 2 - /Users/deni/Desktop/web-tools/test/two.mjs
---
duration_ms: 44.268208
...
1..2
# tests 2
# pass 2
# fail 0
# cancelled 0
# skipped 0
# todo 0
# duration_ms 55.691167
When I run the third file alone I have the same result without skipped tests as well
ok 1 - /Users/deni/Desktop/web-tools/test/three.mjs
---
duration_ms: 47.394208
...
1..1
# tests 1
# pass 1
# fail 0
# cancelled 0
# skipped 0
# todo 0
# duration_ms 54.821583
Additional information
On the contrary, if I run node test/one.mjs I have correct TAP result with information about skipped tests.
# Subtest: Unit one: group one
ok 1 - Unit one: group one # SKIP
---
duration_ms: 0.565083
...
# Subtest: Unit one: group two
ok 2 - Unit one: group two # SKIP
---
duration_ms: 0.044209
...
# Subtest: Unit one: test three
ok 3 - Unit one: test three # SKIP
---
duration_ms: 0.052666
...
1..3
# tests 3
# pass 0
# fail 0
# cancelled 0
# skipped 3
# todo 0
# duration_ms 4.347417
As well as I run node test/three.mjs
TAP version 13
# Subtest: Unit three: group one
# Subtest: test one
ok 1 - test one
---
duration_ms: 0.1995
...
1..1
ok 1 - Unit three: group one
---
duration_ms: 1.209541
...
# Subtest: Unit three: test two
ok 2 - Unit three: test two # SKIP
---
duration_ms: 0.05375
...
# Subtest: Unit three: group three
ok 3 - Unit three: group three # SKIP
---
duration_ms: 0.042459
...
# Subtest: Unit three: test three
ok 4 - Unit three: test three
---
duration_ms: 0.043833
...
1..4
# tests 4
# pass 2
# fail 0
# cancelled 0
# skipped 2
# todo 0
# duration_ms 4.859