J

#4856in AI Skills
0In stores
Description
Stand up vLLM or SGLang serving on Jetson, using upstream vLLM on Thor and Orin JetPack 7.2+, and NVIDIA-AI-IOT vLLM on older Orin.
Information
Ratings & Reviews
No ratings yet
Be the first to rate jetson-llm-serve.
People also visit
jetson-llm-serve FAQ
What is jetson-llm-serve?
Stand up vLLM or SGLang serving on Jetson, using upstream vLLM on Thor and Orin JetPack 7.2+, and NVIDIA-AI-IOT vLLM on older Orin.
Is jetson-llm-serve free?
Yes. jetson-llm-serve is free to use.
Do I need to download jetson-llm-serve?
No. jetson-llm-serve runs in your browser at skills.sh, so there's nothing to install.
Who makes jetson-llm-serve?
jetson-llm-serve is made by nvidia.
What are the best jetson-llm-serve alternatives?
Popular alternatives to jetson-llm-serve include frontend-design, artifacts-builder and canvas-design. See all jetson-llm-serve alternatives




