Self-hosted alternatives to jetson-llm-benchmark
No self-hosted apps like jetson-llm-benchmark yet.
About jetson-llm-benchmark
J
jetson-llm-benchmark
Benchmark Jetson LLM/VLM serving performance across vLLM, llama.cpp
Benchmark Jetson LLM/VLM serving performance across vLLM, llama.cpp, and Ollama with structured JSON output.
- Price
- Free
- Made by
- nvidia
- Category
- AI Skills
- Website
- github.com/nvidia/skills/jetson-llm-benchmark