Skip to content

Run Status in Rules Report, engine v0.15 #1639

@mhungria

Description

@mhungria

Standard

CDISC SDTM/SDTMIG

Reference Rule ID(s)

CG0225, CG0034, ...

Conformance Rule ID(s) (if published in CORE)

CORE-000140, CORE-000168, ...

JIRA Ticket

No response

CLI Command Used (if applicable)

python3 core.py validate -s SDTMIG -v 3.4 -dv 2.1 -dxp .../tempv/data/define.xml -vx y -dp .../tempv/data/unit-test-coreid-CG0555-negative.xlsx --filetype json -o .../tempv/data/val_reports/bash_coreval_CG0555_negative_01_data_mhungria_SDTMIGv3.4_2026-02-25 --output-format JSON --output-format XLSX -l info -p verbose_output

Rule YAML

Attach any sample test data file(s)

unit-test-coreid-CG0555-negative.xlsx

define.xml

Attach any output report and/or log file(s)

bash_coreval_CG0555_negative_01_data_mhungria_SDTMIGv3.4_2026-02-25.json

Image Image

Expected output

For rules involving cross-datasets checks, when one of the datasets is not present, I would expect the run status for a rule be SKIPPED instead of EXECUTION ERROR.
Please note I just provided a couple of rule references even when in the enclosed execution there are many more. The only dataset included in the data is pp.

Release v0.15 documentation:
The possible rule run statuses are:
SUCCESS - The rule ran, data was validated, and no issues were reported.
SKIPPED - The rule was unable to be run for one of the following reasons:
Column not found in data
Domain not found
Schema validation is off
Outside scope
ISSUE REPORTED - The rule ran, data was validated, and issues were reported
EXECUTION ERROR - The validation failed for an unknown reason caused by rule evaluation or execution. Error details are found in the Issue Details tab.

Any Additional Information

Thanks for the new release v0.15!

Note: executing on a linux box.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions