Description
lora-qlora-recipes is an agent skill from the wshobson/agents collection for configuring LoRA and QLoRA supervised fine-tuning with current best-practice settings. LoRA trains a small set of adapter weights instead of the whole model, and QLoRA does the same on a quantized base model to save memory. The skill covers the decisions that shape a LoRA run: which modules of the model to target, how to size the rank and alpha of the adapter, what learning rate to use, and when QLoRA gives real headroom on limited hardware compared with when it only adds risk. It is used when writing or reviewing a LoRA or QLoRA training configuration. The skill assumes the routing step has already picked supervised fine-tuning, because the data is demonstrations rather than preference pairs or a verifiable reward signal. Preparing the dataset and checking its quality are a separate concern, covered by the dataset-curation skill. The guidance helps an agent produce a configuration a team can review and then run with its own training tools. As with any fine-tuning, results should be measured against an evaluation baseline before the adapter is used. The skill is installed with the skills CLI from the wshobson/agents repository. Its skills.sh page showed about 2.4K installs and passing results from three security audits at the time of the scan.…
Highlights
- LoRA and QLoRA supervised fine-tuning configs
- Target module selection
- Rank and alpha sizing
- Learning rate guidance
- When QLoRA helps and when it adds risk
- Installs with the skills CLI
Ratings & Reviews
No ratings yet
Be the first to rate lora-qlora-recipes.
People also visit
preference-optimization
Align a fine-tuned model with preference data using DPO, ORPO, KTO, or SimPO
lora-qlora-recipes FAQ
What is LoRA?
A way to fine-tune a model by training a small set of adapter weights instead of the whole model.
What does QLoRA add?
The same adapter training on a quantized base model, which saves memory. The skill covers when that trade-off is worth it.
What data does it expect?
Demonstrations for supervised fine-tuning. Preference pairs and reward-based training are covered by other skills.
Who prepares the dataset?
The dataset-curation skill covers dataset preparation and quality checks.
How do I install it?
Run npx skills add https://github.com/wshobson/agents --skill lora-qlora-recipes.
What security audits does it have?
skills.sh lists three audits: Gen Agent Trust Hub Pass, Socket Pass and Snyk Pass.
What are the best lora-qlora-recipes alternatives?
Popular alternatives to lora-qlora-recipes include grpo-rlvr-training, preference-optimization and vision-sft. See all lora-qlora-recipes alternatives