Airflow 3 update

[stijndehaes]

I see that this repo hasn't had many releases since the 2.5.0 release, I was wondering if there were any plans to bring this up to date with Airlfow 3.0?

[potiuk]

Not for now - but we are working on go-task-sdk for Airflow 3.1 (which is different kind of API) - you can also take the openapi interface of Airflow REST API - from the repo and generate your client on your own. There are some openapi generators available.

[stijndehaes]

Thanks for the response, in that case I will generate the client from the OpenApi Spec :)

[jsnb-devoted]

We are interested in this because hoping to use terraform with Airflow 3. I think that would require the go client be published.

I was able to generate the client with this command:

npx @openapitools/openapi-generator-cli generate -i https://airflow.apache.org/docs/apache-airflow/3.0.2/_specs/v1-rest-api-generated.yaml -g go -o ./airflow-client --additional-properties=packageName=airflow,packageVersion=3.0.2,withGoCodegenComment=true,hideGenerationTimestamp=true --git-user-id=<username> --git-repo-id=<repo name> --package-name=airflow

At first glance it looks like there are some errors specifically around consts being redefined. For example:

I haven't gotten any further than that but thought I'd share in case you already solved for this.

[potiuk]

We are interested in this because hoping to use terraform with Airflow 3. I think that would require the go client be published.

Then contributions to revive go-client would be very welcome and if you would like to contribute to it you are most welcome. I think in order to release it it would have to be on-par with python client:

• integration with breeze release-management command to consistently generate reproducible go client binaries ready to relaase
• CI tooling to build and test the generated client end-to-end
• documentation on how to release the client is updated and describes step-by-step instructions for relese manager how to produce it and for both users and PMC members to verify it.

I think if those criteria are met and we run it for a while and do a test-drive of those by release manager, we could consider publishing go-client. All that can be done with PRs contributing those changes to Airflow - and if you think you would like to work on it @jsnb-devoted or @stijndehaes - or maybe find (pay?) someone to do so, that would be awesome.

You can take this document as a starting point - it explains the instructions, shows the breeze commands to build it - https://github.com/apache/airflow/blob/main/dev/README_RELEASE_PYTHON_CLIENT.md

Eventually having similar "README_RELEASE_GO_CLIENT.md is a prerequisite to bring go client to our relese schedule - and I se no reason why community members who want to make it happen would not be able to contribute it.

[potiuk]

Also python client tests run in CI: https://github.com/apache/airflow/blob/main/.github/workflows/ci-image-checks.yml#L384