Use matrices for tier2 tests, compare against last stable version and publish results#30
Draft
Use matrices for tier2 tests, compare against last stable version and publish results#30
Conversation
Refactor workflow to use environment variable for CI base path and streamline job dependencies.
Collaborator
|
Also, the changes in GEOS-ESM/swell#677 are imminent, suite names for marine ones should be changed. We should do another PR for tier1 names (e.g., 3dvar -> 3dvar_marine). |
Collaborator
|
Oops, I clicked on send too soon. Would this approach keep the |
Collaborator
Author
|
This wouldn't change how the stable version works, which is that it gets removed if the current build is stable. I may revert the change that uses the stable build, it seems like we want to have more manual control over it. I also can't figure out why it's choosing to skip over the comparison tests completely when they are requirements for the final steps |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR updates the tier2 tests to use the matrix structure introduced in #29. It also enables comparison testing against the latest stable run of tier2 tests. We can update swell to use the build of JEDI from the latest stable tier2 tests, which will allow the build to be automatically updated if it passes with zero diff. The
publish_comparisonstask introduced in GEOS-ESM/swell#702 will post the results to dataportal if it isn't zero diff.This is a draft for now, I haven't tested this as I want to get #29 in before overwriting the test branch