Skip to content

slurm: environment improvements #371

@d4l3k

Description

@d4l3k

The current slurm scheduler specifies the working directory via the image field of the Role. This doesn't match how any of the other schedulers work since local_cwd has been switched to use the current working directory. We should update the slurm scheduler to be more inline with the other schedulers.

  • make slurm_scheduler use cwd instead of the image path

The current behavior was around the assumption that users would specify the image as part of the args but that doesn't match how users use TorchX today

slurm also automatically inherits the local conda/virtualenv so not much needs to be done here

would be nice to also support logs though

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requestmodule: runnerissues related to the torchx.runner and torchx.scheduler modulesslurmslurm scheduler

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions