Add environment variables to data-tasks supporting resource request tracking feature#4379
Merged
olevski merged 8 commits intorelease-2.15.0from Mar 4, 2026
Merged
Conversation
olevski
requested changes
Mar 4, 2026
Member
olevski
left a comment
olevski
left a comment
There was a problem hiding this comment.
Eike this looks good. But lets do this:
- Merge the stuff in data services
- Tag a data services release
- Update the data services in this repo with the new release
- Deploy once more here to check everything is ok
Then we merge.
Also I think we should have a switch in the values file to turn this off. I think we discussed something like that. In case things get out of hand and the DB fills up too quickly.
I would even keep this flag turned off by default first and then we flip it to ON by default later.
eikek
force-pushed
the
eikek/env-vars-data-tasks
branch
from
d88f20b to
27c6673
Compare
olevski
reviewed
Mar 4, 2026
eikek
force-pushed
the
eikek/env-vars-data-tasks
branch
2 times, most recently
from
545a1fd to
af25160
Compare
Collaborator
|
You can access the deployment of this PR at https://ci-renku-4379.dev.renku.ch |
eikek
force-pushed
the
eikek/env-vars-data-tasks
branch
from
8fece65 to
2a6e9af
Compare
olevski
requested changes
Mar 4, 2026
Member
olevski
left a comment
olevski
left a comment
There was a problem hiding this comment.
Two small last fixes. With this the K8S_CONFIGS_ROOT env variable will truly work.
olevski
approved these changes
Mar 4, 2026
Collaborator
|
Tearing down the temporary RenkuLab deployment for this PR. |
olevski
pushed a commit
that referenced
this pull request
Mar 4, 2026
* Add env var for resource usage and set service account for data-task * Update data services to 0.71.0
olevski
added a commit
that referenced
this pull request
Mar 5, 2026
* chore(deps): bump urllib3 from 2.6.0 to 2.6.3 in /global-images/datascience (#4304) * chore(deps): bump urllib3 in /global-images/datascience Bumps [urllib3](https://github.com/urllib3/urllib3) from 2.6.0 to 2.6.3. - [Release notes](https://github.com/urllib3/urllib3/releases) - [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst) - [Commits](urllib3/urllib3@2.6.0...2.6.3) --- updated-dependencies: - dependency-name: urllib3 dependency-version: 2.6.3 dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump numpy from 2.3.5 to 2.4.0 in /global-images/datascience in the python group across 1 directory (#4298) * feat: add option to disable ClusterRoles * add docs * feat: add session alerts (#4267) --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Alessandro Degano <a.degano@gmail.com> Co-authored-by: Wes Johnson <515042+wesjdj@users.noreply.github.com> Co-authored-by: Rok Roškar <roskarr@ethz.ch> Co-authored-by: Tasko Olevski <16360283+olevski@users.noreply.github.com> * chore: more v1 cleanup (#4335) * chore(gateway): remove now unused configuration Following update of renku-gateway, these two entries are now not required anymore. * chore: remove enableV1Services from minimal deployment example --------- Co-authored-by: Tasko Olevski <16360283+olevski@users.noreply.github.com> * chore: remove v1 documentation (#4354) * chore: remove v1 acceptance tests (#4353) * chore: Disable Gitlab connection for CI deployments * feat: Upgrade Keycloak to 25.0.0 * fix: remove secret for client renku-cli (#4371) Fixes `renku-cli` being re-created on every `helm upgrade` because the client has no secret now. * feat: add support for using OAuth 2.0 integrations with data connectors (#4367) Add support for using OAuth 2.0 integrations with data connectors. This allows users to connect Renku with their Google and Dropbox accounts and use Google Drive and Dropbox in their sessions as mounts. * feat: move git-https-server to amalthea (#4363) * fix: mismatched service account in helm chart (#4366) * feat(chart): add logging format (#4374) * feat: upgrade csi-rclone to 0.6.0 (#4384) * feat: Upgrade Buildpacks Builder Version 0.3.1 (#4380) * docs: add user page about google drive and dropbox (#4385) * feat: add capacity reservation (#4364) * docs: add the renku social card (#4387) * feat: update search page (#4369) * upgrade renku-ui to 4.19.0 * upgrade renku-data-service to 0.70.0 * chore: update tests and UI memory --------- Co-authored-by: Flora Thiebaut <flora.thiebaut@sdsc.ethz.ch> * feat: resource request tracking (#4379) * Add env var for resource usage and set service account for data-task * Update data services to 0.71.0 * feat(helm): disable internal gitlab by default (#4391) --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Alessandro Degano <a.degano@gmail.com> Co-authored-by: Wes Johnson <515042+wesjdj@users.noreply.github.com> Co-authored-by: Rok Roškar <roskarr@ethz.ch> Co-authored-by: Tasko Olevski <16360283+olevski@users.noreply.github.com> Co-authored-by: Samuel Gaist <samuel.gaist@idiap.ch> Co-authored-by: Flora Thiebaut <flora.thiebaut@sdsc.ethz.ch> Co-authored-by: Mohammad Alisafaee <mohammad.alisafaee@epfl.ch> Co-authored-by: Salim Kayal <salim.kayal@idiap.ch> Co-authored-by: Andrea Cordoba <43388408+andre-code@users.noreply.github.com> Co-authored-by: eikek <701128+eikek@users.noreply.github.com>
ciyer
pushed a commit
that referenced
this pull request
Mar 6, 2026
* chore(deps): bump urllib3 from 2.6.0 to 2.6.3 in /global-images/datascience (#4304) * chore(deps): bump urllib3 in /global-images/datascience Bumps [urllib3](https://github.com/urllib3/urllib3) from 2.6.0 to 2.6.3. - [Release notes](https://github.com/urllib3/urllib3/releases) - [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst) - [Commits](urllib3/urllib3@2.6.0...2.6.3) --- updated-dependencies: - dependency-name: urllib3 dependency-version: 2.6.3 dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> * chore(deps): bump numpy from 2.3.5 to 2.4.0 in /global-images/datascience in the python group across 1 directory (#4298) * feat: add option to disable ClusterRoles * add docs * feat: add session alerts (#4267) --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Alessandro Degano <a.degano@gmail.com> Co-authored-by: Wes Johnson <515042+wesjdj@users.noreply.github.com> Co-authored-by: Rok Roškar <roskarr@ethz.ch> Co-authored-by: Tasko Olevski <16360283+olevski@users.noreply.github.com> * chore: more v1 cleanup (#4335) * chore(gateway): remove now unused configuration Following update of renku-gateway, these two entries are now not required anymore. * chore: remove enableV1Services from minimal deployment example --------- Co-authored-by: Tasko Olevski <16360283+olevski@users.noreply.github.com> * chore: remove v1 documentation (#4354) * chore: remove v1 acceptance tests (#4353) * chore: Disable Gitlab connection for CI deployments * feat: Upgrade Keycloak to 25.0.0 * fix: remove secret for client renku-cli (#4371) Fixes `renku-cli` being re-created on every `helm upgrade` because the client has no secret now. * feat: add support for using OAuth 2.0 integrations with data connectors (#4367) Add support for using OAuth 2.0 integrations with data connectors. This allows users to connect Renku with their Google and Dropbox accounts and use Google Drive and Dropbox in their sessions as mounts. * feat: move git-https-server to amalthea (#4363) * fix: mismatched service account in helm chart (#4366) * feat(chart): add logging format (#4374) * feat: upgrade csi-rclone to 0.6.0 (#4384) * feat: Upgrade Buildpacks Builder Version 0.3.1 (#4380) * docs: add user page about google drive and dropbox (#4385) * feat: add capacity reservation (#4364) * docs: add the renku social card (#4387) * feat: update search page (#4369) * upgrade renku-ui to 4.19.0 * upgrade renku-data-service to 0.70.0 * chore: update tests and UI memory --------- Co-authored-by: Flora Thiebaut <flora.thiebaut@sdsc.ethz.ch> * feat: resource request tracking (#4379) * Add env var for resource usage and set service account for data-task * Update data services to 0.71.0 * feat(helm): disable internal gitlab by default (#4391) --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Alessandro Degano <a.degano@gmail.com> Co-authored-by: Wes Johnson <515042+wesjdj@users.noreply.github.com> Co-authored-by: Rok Roškar <roskarr@ethz.ch> Co-authored-by: Tasko Olevski <16360283+olevski@users.noreply.github.com> Co-authored-by: Samuel Gaist <samuel.gaist@idiap.ch> Co-authored-by: Flora Thiebaut <flora.thiebaut@sdsc.ethz.ch> Co-authored-by: Mohammad Alisafaee <mohammad.alisafaee@epfl.ch> Co-authored-by: Salim Kayal <salim.kayal@idiap.ch> Co-authored-by: Andrea Cordoba <43388408+andre-code@users.noreply.github.com> Co-authored-by: eikek <701128+eikek@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
For allowing the data tasks to list k8s resources, some env var settings have been copied from the data-service deployment.
See SwissDataScienceCenter/renku-data-services#1207
/deploy