Skip to content
SkillModel-led1,399 tokens in use

Fine-Tuning Expert

Fine-tunes LLMs with LoRA and QLoRA on Hugging Face PEFT: dataset validation, hyperparameters, evaluation against the base model, adapter merging and quantization.

12,471 stars on the repository MIT LicenseJeffallan/claude-skills · skills/fine-tuning-expert
/plugin marketplace add jeffallan/claude-skills /plugin install fullstack-dev-skills@fullstack-dev-skills
View source

Install command as written in the repository's README

Skill label

measured from its files

What installing Fine-Tuning Expert costs

129tokens idle
1,399tokens in use
20,606tokens, up to

Idle is what sits in context while the skill is installed. In use is its instructions, loaded when it runs. Up to adds the files its instructions link. Counts are approximate, made offline with cl100k_base.

Model dependence Model-led

Script-ledMixedModel-led

Mostly instructions, so how well it works depends on the model that follows them.

This describes the skill's structure, how much of it is scripts. It does not say how well it works.

Touches

shelldetected

Declared tags come from the skill's frontmatter; detected ones from its scripts, its code blocks and the commands it names in inline code. This is detected, not audited.

How it scores

Quality

How well the skill is written, counted from its own files: its frontmatter, its steps, examples, stated output and constraints, its size and whether every file it ships is one it names.How we score it →
Excellent
  • Frontmatter15/15
  • Structure22/25
  • Examples12/15
  • Output15/15
  • Size15/15
  • Resources15/15

Security

Starts at 100 and loses points for each thing in the skill's files that a reader should look at first.How we score it →
Excellent

No findings.

Repository health

Pre-computed score based on development activity, maintenance, community, maturity, and trend momentum.How we score it →
Excellent
  • Development activity100
  • Maintenance100
  • Community60
  • Maturity36
  • Momentum40

Fine-Tuning Expert gives Claude a five-step routine for adapting language models: prepare and validate the dataset, choose a parameter-efficient method, train while watching validation loss, evaluate against the base model and deploy a merged, quantized model.

Five reference files cover LoRA and PEFT, dataset preparation, hyperparameter tuning, evaluation metrics and deployment optimization. The SKILL.md carries a complete LoRA training example with a QLoRA variant and an adapter merge.

What You Get

  • A dataset preparation script with schema checks, token-length statistics and deduplication
  • A training configuration with TrainingArguments and LoraConfig, commented
  • An evaluation script reporting perplexity, task metrics and latency
  • A design rationale for the method, rank and learning rate
  • Steps to merge adapters, quantize and serve the model

Common Use Cases

  • Adapting an open model to an instruction-following dataset
  • Training on a single GPU with QLoRA four-bit quantization
  • Comparing a tuned model with the base model on held-out data
  • Exporting a merged model to GGUF or a serving container

What Makes It Unique

Each step has a checkpoint: dataset errors are fixed before training starts, validation loss must fall during training, and a model is not deployed before a held-out evaluation and a latency benchmark. The rules also forbid merging adapters with mismatched rank, base model or target modules and require learning rate warmup.

Under The Hood

The skill is a SKILL.md with five reference files and no scripts, and the references load by topic. The examples download base models and datasets from Hugging Face, train on local GPUs, write checkpoints and adapter folders to disk and can push merged models to a hub repository. The deployment reference runs llama.cpp conversion and quantization programs through subprocess calls and includes a container setup for a text generation server. Training runs can report to Weights and Biases. The workflow also expects a validate_dataset.py script that the agent writes.

Join founders building with open source

Opinionated takes, migration guides, cost-saving tips, and insights from the open source ecosystem.

Subscribe on SubstackJoin 750+ subscribers