Skip to content

Archive experiments #55

@bpiwowar

Description

@bpiwowar

On some clusters, some partitions are faster... but time-limited. It would be good to have an archive option, where experiments and their jobs would be moved (when successful) to another location. Optionally, this folder can be used as a recovery when deleted from the main location.

In details:

  1. Add backup_folder in WorkspaceSettings with a path attribute (so that we can add later others)
  2. Whenever a job finishes, copy all the files except experimaestro related (except the dynamic outputs file which should be preserved). Have a submit option (backup=False) that prevents this behavior.
  3. If at some point a job was deleted but can be recovered, copy it back from backup (and add .done to mark it as done when copy is over)
  4. Add CLI options (e.g. orphans) to include backup (true by default); add also this to the TUI interface

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions