Skip to content

Add Connect spec validation task#44

Draft
matthiasdv wants to merge 4 commits intomainfrom
feat/add-spec-validation-test
Draft

Add Connect spec validation task#44
matthiasdv wants to merge 4 commits intomainfrom
feat/add-spec-validation-test

Conversation

@matthiasdv
Copy link
Collaborator

@matthiasdv matthiasdv commented Sep 24, 2025

Add a task to check the drift / diff between our spec files and Wombat components:

task test:spec

Sample output:

=== VALIDATION RESULTS ===

❌ output/amqp_0_9: 1 issues found
   🟡 [WARNING] exchange_declare.arguments: Required field missing from connect spec

✅ output/amqp_1: OK
❌ output/aws_dynamodb: 6 issues found
   🟡 [WARNING] credentials.profile: Required field missing from connect spec
   🟡 [WARNING] credentials.from_ec2_role: Required field missing from connect spec
   🟡 [WARNING] credentials.role: Required field missing from connect spec
   🟡 [WARNING] credentials.role_external_id: Required field missing from connect spec
   🟡 [WARNING] batching: Required field missing from connect spec
   🟡 [WARNING] backoff: Required field missing from connect spec

❌ output/aws_kinesis: 6 issues found
   🟡 [WARNING] credentials.profile: Required field missing from connect spec
   🟡 [WARNING] credentials.from_ec2_role: Required field missing from connect spec
   🟡 [WARNING] credentials.role: Required field missing from connect spec
   🟡 [WARNING] credentials.role_external_id: Required field missing from connect spec
   🟡 [WARNING] batching: Required field missing from connect spec
   🟡 [WARNING] backoff: Required field missing from connect spec

❌ output/aws_kinesis_firehose: 6 issues found
   🟡 [WARNING] credentials.profile: Required field missing from connect spec
   🟡 [WARNING] credentials.from_ec2_role: Required field missing from connect spec
   🟡 [WARNING] credentials.role: Required field missing from connect spec
   🟡 [WARNING] credentials.role_external_id: Required field missing from connect spec
   🟡 [WARNING] batching: Required field missing from connect spec
   🟡 [WARNING] backoff: Required field missing from connect spec

❌ output/aws_s3: 6 issues found
   🔴 [ERROR] metadata.metadata.exclude_prefixes: Type mismatch: connect=string, benthos=array
   🟡 [WARNING] credentials.profile: Required field missing from connect spec
   🟡 [WARNING] credentials.from_ec2_role: Required field missing from connect spec
   🟡 [WARNING] credentials.role: Required field missing from connect spec
   🟡 [WARNING] credentials.role_external_id: Required field missing from connect spec
   🟡 [WARNING] batching: Required field missing from connect spec

[...]

=== SUMMARY ===
Total components validated: 70
Components with issues: 48
Total issues found: 145

❌ Validation failed with errors

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant