Add slurm/pbs job submission capability to lake-landice remapping#179
Draft
mathomp4 wants to merge 1 commit intofeature/sdrabenh/gcm_v12from
Draft
Add slurm/pbs job submission capability to lake-landice remapping#179mathomp4 wants to merge 1 commit intofeature/sdrabenh/gcm_v12from
mathomp4 wants to merge 1 commit intofeature/sdrabenh/gcm_v12from
Conversation
- Add job configuration with NPE=1 (serial execution with MPI for MAPL) - Set walltime based on tile resolution: 30min for <=C360, 1hr for higher res - Create job script template with SLURM/PBS directives matching remap_upper.py - Add interactive vs batch mode detection (PBS_JOBID/SLURM_JOB_ID) - Refactor command execution to use esma_mpirun wrapper - Submit jobs via qsub (NAS) or sbatch (NCCS) when not in interactive session - Remove obsolete run_and_log method - Maintain backward compatibility: interactive mode behaves as before This brings lake-landice remapping in line with upper_air and catch remapping, allowing it to run in batch queues on both NAS and NCCS.
mathomp4
added
the
0 diff
Contributor
|
I tried to test with our testing script and seems some merge or this PR broke the testing script...: |
Member
Author
Well nuts. I'll try and give it a go soon. It seemed simple... |
Contributor
|
If you can show me the folder with the error message, I may find a way to fix it @biljanaorescanin |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This brings lake-landice remapping in line with upper_air and catch remapping, allowing it to run in batch queues on both NAS and NCCS.
The weird thing is, @sshakoor1 did this at some point but it got lost? Not sure. But this is Claude trying to bring it back
This needs to be fully tested and looked over. Probably by me and @weiyuan-jiang and @biljanaorescanin
I'm keeping draft until tested.