This repository was archived by the owner on Jul 4, 2025. It is now read-only.
This repository was archived by the owner on Jul 4, 2025. It is now read-only.
planning: prioritize GPUs with CUDA_VISIBLE_DEVICES #1679
Closed
Description
Problem
We don't define a logic to prioritize GPUs yet.
https://docs.nvidia.com/cuda/cuda-c-programming-guide/index.html#env-vars
Success Criteria
- Need to support prioritize GPUs
Tasklist
Linked Bugs
- requires priority for multi-GPU bug: some models failed to load if many GPU are selected #1458
Metadata
Metadata
Assignees
Labels
Type
Projects
Status