Open source alternatives to jetson-llm-serve
No open source apps like jetson-llm-serve yet.
About jetson-llm-serve
J
jetson-llm-serve
Stand up vLLM or SGLang serving on Jetson
Stand up vLLM or SGLang serving on Jetson, using upstream vLLM on Thor and Orin JetPack 7.2+, and NVIDIA-AI-IOT vLLM on older Orin.
- Price
- Free
- Made by
- nvidia
- Category
- AI Skills
- Website
- github.com/nvidia/skills/jetson-llm-serve