Self-hosted alternatives to quantized-export

Q

quantized-export

Export a promoted fine-tuned model in the right deployment format

quantized-export is an agent skill from the wshobson/agents collection for exporting a promoted fine-tuned model in the format its deployment target needs. It is the last step after the checkpoint-promotion gate: a checkpoint that cleared the four-stage gate is not deployed until it has been exported in the right format for its runtime and shown to still work after export. The skill covers the common export formats: merged safetensors, which folds the adapter weights into the base model; LoRA-only output, which keeps the adapter separate; GGUF with an importance matrix (imatrix), a quantized format used by many local inference tools; and FP8, a lower-precision format for accelerated hardware. It explains which format fits which target runtime, and it requires a verification pass after export, because quantization and conversion can change behavior even when the original checkpoint was sound. A REJECT verdict from the gate never reaches this skill, so export only starts from a promoted checkpoint. The skill is for teams that have trained and promoted a model and need it running in production or on a device. Export and quantization details depend on the exact tools and versions, so the agent's commands should be checked against them. The skill is installed with the skills CLI from the wshobson/agents repository. Its skills.sh page showed about 2.4K installs and passing results from three security audits at the time of the scan.