Skip to content
J

jetson-llm-serve

Stand up vLLM or SGLang serving on Jetson

by nvidiaFree

Launch
#4856in AI Skills
0In stores

Description

Stand up vLLM or SGLang serving on Jetson, using upstream vLLM on Thor and Orin JetPack 7.2+, and NVIDIA-AI-IOT vLLM on older Orin.

Information

Ratings & Reviews

No ratings yet

Be the first to rate jetson-llm-serve.

People also visit

F

frontend-design

Instructs Claude to avoid "AI slop" or generic aesthetics

AI Skills
Launch
A

artifacts-builder

Suite of tools for creating elaborate

AI Skills
Launch
C

canvas-design

Design beautiful visual art in .png and .pdf formats using design philosophies

AI Skills
Launch
M

mcp-builder

Guide for creating high-quality MCP servers to integrate external APIs

AI Skills
Launch
P

pdf

Extract text, tables, metadata, merge & annotate PDFs

AI Skills
Launch
W

webapp-testing

Test local web applications using Playwright for UI verification and debugging

AI Skills
Launch

jetson-llm-serve FAQ

What is jetson-llm-serve?

Stand up vLLM or SGLang serving on Jetson, using upstream vLLM on Thor and Orin JetPack 7.2+, and NVIDIA-AI-IOT vLLM on older Orin.

Is jetson-llm-serve free?

Yes. jetson-llm-serve is free to use.

Do I need to download jetson-llm-serve?

No. jetson-llm-serve runs in your browser at skills.sh, so there's nothing to install.

Who makes jetson-llm-serve?

jetson-llm-serve is made by nvidia.

What are the best jetson-llm-serve alternatives?

Popular alternatives to jetson-llm-serve include frontend-design, artifacts-builder and canvas-design. See all jetson-llm-serve alternatives

Developer Stuff

Badges