Search Results: vllm-deployment

Found 3 Skills

AI & Machine Learningg1joshi/agent-skills

mistral

Mistral AI efficient open models. Use for efficient AI.

jetson-llm-serve

Stand up vLLM or SGLang serving on Jetson, using upstream vLLM on Thor and Orin JetPack 7.2+, and NVIDIA-AI-IOT vLLM on older Orin.

🇺🇸|EnglishTranslated

AI & Machine Learningnvidia/skills

jetson-package

Pick Jetson-compatible containers, vLLM runtime images, and Jetson AI Lab PyPI indexes; maps Orin SM 8.7 vs Thor SM 11.0 and JetPack-specific package choices.

🇺🇸|EnglishTranslated

1 scripts/Checked