Loading...
Loading...
Use before running local GPU workloads such as PyTorch, SGLang serving, Ray clusters, CUDA benchmarks, or scripts that use GPUs; instructs agents to wrap commands with gpu-lease run so CUDA_VISIBLE_DEVICES is set through a lease.
npx skill4agent add reyoung/gpu-lease gpu-lease/var/run/gpu-lease.sock--socketGPU_LEASE_SOCKETgpu-lease run--count--waitgpu-lease run --count 2 --wait -- python train.py --batch-size 8gpu-lease run --ids 0,1 -- python train.py --batch-size 8gpu-lease runCUDA_VISIBLE_DEVICESgpu-lease rungpu-lease run --count 1 --wait -- python -m torch.distributed.run --nproc_per_node=1 train.py
gpu-lease run --count 2 --wait -- python -m sglang.launch_server --model-path ./model
gpu-lease run --count 4 --wait -- ray start --head --num-gpus=4