Skip to content
SkillModel-led1,345 tokens in use

ML Pipeline Expert

Builds production ML pipelines: MLflow or W&B tracking, Kubeflow, Airflow or Prefect orchestration, Feast feature stores, DVC versioning and model validation gates.

12,471 stars on the repository MIT LicenseJeffallan/claude-skills · skills/ml-pipeline
/plugin marketplace add jeffallan/claude-skills /plugin install fullstack-dev-skills@fullstack-dev-skills
View source

Install command as written in the repository's README

Skill label

measured from its files

What installing ML Pipeline Expert costs

124tokens idle
1,345tokens in use
26,954tokens, up to

Idle is what sits in context while the skill is installed. In use is its instructions, loaded when it runs. Up to adds the files its instructions link. Counts are approximate, made offline with cl100k_base.

Model dependence Model-led

Script-ledMixedModel-led

Mostly instructions, so how well it works depends on the model that follows them.

This describes the skill's structure, how much of it is scripts. It does not say how well it works.

Touches

writes filesdetected

Declared tags come from the skill's frontmatter; detected ones from its scripts, its code blocks and the commands it names in inline code. This is detected, not audited.

How it scores

Quality

How well the skill is written, counted from its own files: its frontmatter, its steps, examples, stated output and constraints, its size and whether every file it ships is one it names.How we score it →
Excellent
  • Frontmatter15/15
  • Structure22/25
  • Examples12/15
  • Output15/15
  • Size15/15
  • Resources15/15

Security

Starts at 100 and loses points for each thing in the skill's files that a reader should look at first.How we score it →
Excellent
  • Writes files−8

    does this on the machine, and the frontmatter does not say so

    SKILL.md, line 103

Repository health

Pre-computed score based on development activity, maintenance, community, maturity, and trend momentum.How we score it →
Excellent
  • Development activity100
  • Maintenance100
  • Community60
  • Maturity36
  • Momentum40

ML Pipeline Expert guides Claude through ML infrastructure in six steps: design the pipeline architecture, validate the data schema, build feature engineering, orchestrate training, track experiments and validate and deploy. Training stops and reports when data validation fails, and a model needs recorded validation metrics before deployment.

Five reference files cover feature engineering, training pipelines, experiment tracking, pipeline orchestration and model validation.

What You Get

  • Pipeline definitions as Kubeflow, Airflow or Prefect DAGs
  • Feature engineering code with Feast feature views and Great Expectations checks
  • Training scripts with MLflow or Weights and Biases logging, plus distributed training and hyperparameter search with Optuna or Ray Tune
  • Model evaluation code with explicit pass and fail thresholds and segment-level checks
  • Deployment configuration with A/B or shadow rollout and a rollback strategy

Common Use Cases

  • Setting up experiment tracking and a model registry for a team
  • Turning a notebook into an orchestrated training DAG
  • Defining a Feast feature store for training and online serving
  • Adding data validation and drift checks before each training run
  • Gating model promotion on evaluation metrics and a shadow deployment

What Makes It Unique

It covers the whole model lifecycle in one skill, from feature store schema to shadow deployment. The workflow halts on a failed data check and refuses to deploy without recorded validation metrics, and the orchestration reference shows the same evaluation gate in all three of Kubeflow, Airflow and Prefect.

Under The Hood

The skill is a SKILL.md with five reference files and no scripts, and the references load by topic. It writes pipeline, training and configuration code and the agent may run it, which can start training jobs, install Python packages and use local compute. The examples connect to an MLflow tracking server and a Kubeflow host over HTTP, log to Weights and Biases, read training data from files and object storage, include a launch script for distributed training, and pull credentials from environment variables. The skill does not tell the agent to fetch web pages.

Join founders building with open source

Opinionated takes, migration guides, cost-saving tips, and insights from the open source ecosystem.

Subscribe on SubstackJoin 750+ subscribers