wildcard is not working for grouping_variables

[marisawyckmans]

Standard

FDA BR SDTMIG

Reference Rule ID(s)

FB3001

Conformance Rule ID(s) (if published in CORE)

CORE-000699

JIRA Ticket

https://jira.cdisc.org/projects/CORERULES/issues/CORERULES-9309

CLI Command Used (if applicable)

NAP

Rule YAML

Authorities:
  - Organization: FDA
    Standards:
      - Name: SDTMIG
        References:
          - Citations:
              - Cited Guidance: Standard units should be consistent within the same assessment
                  (having the same --TESTCD, --CAT, --SCAT, --SPEC, --METHOD
                  values).
                Document: FDA
                Section: FDAB030
            Origin: FDA Business Rules
            Rule Identifier:
              Id: FB3001
              Version: '1'
            Version: '1.5'
        Version: '3.2'
      - Name: SDTMIG
        References:
          - Citations:
              - Cited Guidance: Standard units should be consistent within the same assessment
                  (having the same --TESTCD, --CAT, --SCAT, --SPEC, --METHOD
                  values).
                Document: FDA
                Section: FDAB030
            Origin: FDA Business Rules
            Rule Identifier:
              Id: FB3001
              Version: '1'
            Version: '1.5'
        Version: '3.3'
      - Name: SDTMIG
        References:
          - Citations:
              - Cited Guidance: Standard units should be consistent within the same assessment
                  (having the same --TESTCD, --CAT, --SCAT, --SPEC, --METHOD
                  values).
                Document: FDA
                Section: FDAB030
            Origin: FDA Business Rules
            Rule Identifier:
              Id: FB3001
              Version: '1'
            Version: '1.5'
        Version: '3.4'
      - Name: SENDIG
        References:
          - Citations:
              - Cited Guidance: Standard units should be consistent within the same assessment
                  (having the same --TESTCD, --CAT, --SCAT, --SPEC, --METHOD
                  values).
                Document: FDA
                Section: FDAB030
            Origin: FDA Business Rules
            Rule Identifier:
              Id: FB3001
              Version: '1'
            Version: '1.5'
        Version: '3.0'
      - Name: SENDIG
        References:
          - Citations:
              - Cited Guidance: Standard units should be consistent within the same assessment
                  (having the same --TESTCD, --CAT, --SCAT, --SPEC, --METHOD
                  values).
                Document: FDA
                Section: FDAB030
            Origin: FDA Business Rules
            Rule Identifier:
              Id: FB3001
              Version: '1'
            Version: '1.5'
        Version: '3.1'
      - Name: SENDIG
        References:
          - Citations:
              - Cited Guidance: Standard units should be consistent within the same assessment
                  (having the same --TESTCD, --CAT, --SCAT, --SPEC, --METHOD
                  values).
                Document: FDA
                Section: FDAB030
            Origin: FDA Business Rules
            Rule Identifier:
              Id: FB3001
              Version: '1'
            Version: '1.5'
        Version: 3.1.1
      - Name: SENDIG-GENETOX
        References:
          - Citations:
              - Cited Guidance: Standard units should be consistent within the same assessment
                  (having the same --TESTCD, --CAT, --SCAT, --SPEC, --METHOD
                  values).
                Document: FDA
                Section: FDAB030
            Origin: FDA Business Rules
            Rule Identifier:
              Id: FB3001
              Version: '1'
            Version: '1.5'
        Version: '1.0'
      - Name: SENDIG-DART
        References:
          - Citations:
              - Cited Guidance: Standard units should be consistent within the same assessment
                  (having the same --TESTCD, --CAT, --SCAT, --SPEC, --METHOD
                  values).
                Document: FDA
                Section: FDAB030
            Origin: FDA Business Rules
            Rule Identifier:
              Id: FB3001
              Version: '1'
            Version: '1.5'
        Version: '1.1'
      - Name: SENDIG-DART
        References:
          - Citations:
              - Cited Guidance: Standard units should be consistent within the same assessment
                  (having the same --TESTCD, --CAT, --SCAT, --SPEC, --METHOD
                  values).
                Document: FDA
                Section: FDAB030
            Origin: FDA Business Rules
            Rule Identifier:
              Id: FB3001
              Version: '1'
            Version: '1.5'
        Version: '1.2'
      - Name: SENDIG-AR
        References:
          - Citations:
              - Cited Guidance: Standard units should be consistent within the same assessment
                  (having the same --TESTCD, --CAT, --SCAT, --SPEC, --METHOD
                  values).
                Document: FDA
                Section: FDAB030
            Origin: FDA Business Rules
            Rule Identifier:
              Id: FB3001
              Version: '1'
            Version: '1.5'
        Version: '1.0'
Check:
  all:
    - name: --STRESU
      operator: is_inconsistent_across_dataset
      value:
        - --TESTCD
        - --CAT
        - --SCAT
        - --SPEC
        - --METHOD
        - --STAT
Core:
  Id: CORE-000699
  Status: Published
  Version: '1'
Description: Standard units should be consistent within the same assessment
  (having the same --TESTCD, --CAT, --SCAT, --SPEC, --METHOD values)
Executability: Fully Executable
Grouping_Variables:
  - --TESTCD
  - --CAT
  - --SCAT
  - --SPEC
  - --METHOD
Outcome:
  Message: Standards units are inconsistent within the same test (category,
    sub-category, specimen and method)
  Output Variables:
    - --STRESU
    - --TESTCD
    - --CAT
    - --SCAT
    - --SPEC
    - --METHOD
    - --STAT
Rule Type: Record Data
Scope:
  Classes:
    Include:
      - FINDINGS
      - FINDINGS ABOUT
  Domains:
    Include:
      - ALL
Sensitivity: Group

Attach any sample test data file(s)

test data available on sharepoint

Attach any output report and/or log file(s)

Expected output

wildcard should be accepted so variables are recognized and rule can work across all Findings domains

Any Additional Information

It seems the wildcard is not working for the grouping_variables property, as rule does not recognize the grouping_variables. FB3001 could benefit from grouping_variables to meaningfully reduce the number of output records, but it would need the wildcard since rule is applicable for all Findings domains. Thanks for looking into this!

[alexfurmenkov]

@marisawyckmans can you please share original dataset you used?
and if we run

python core.py -s SDTM -v 3.4 -d /path/to/datasets

we will get error, since STDM is not suppoted value for standard option, it can be one of the adam, sdtmig, sendig, tig, usdm. Please provide updated command also.

[marisawyckmans]

@alexfurmenkov
test datasets (negative test data) are here: https://cdisc.sharepoint.com/sites/CORERules/Shared%20Documents/Forms/AllItems.aspx?id=%2Fsites%2FCORERules%2FShared%20Documents%2FunitTesting%2FFDA%20Business%20Rules%2FFB3001%2Fnegative%2Fdata&viewid=ecd009a9%2Db73b%2D415b%2D9e41%2Df9d04a69edf4

I'm running the rule in the rule editor, and I'm not using the CLI. This command (python core.py -s SDTM -v 3.4 -d /path/to/datasets) is template text that was present on the ticket by default and I overlooked to remove it; apologies.