Skip to content
SkillModel-led402 tokens in use

reproduce-regression

Builds and runs the before and after systems for a regression candidate, then proves or disproves it with one portable PoC on both live deployments.

8,320 stars on the repository CC-BY-SA-4.0trailofbits/skills · plugins/regression-hunt/skills/reproduce-regression
/plugin marketplace add trailofbits/skills
View source

Install command as written in the repository's README

Skill label

measured from its files

What installing reproduce-regression costs

24tokens idle
402tokens in use

Idle is what sits in context while the skill is installed. In use is its instructions, loaded when it runs. Counts are approximate, made offline with cl100k_base.

Model dependence Model-led

Script-ledMixedModel-led

Mostly instructions, so how well it works depends on the model that follows them.

This describes the skill's structure, how much of it is scripts. It does not say how well it works.

Touches

Nothing detected: no shell, network, file writes, git or credentials in its files.

Declared tags come from the skill's frontmatter; detected ones from its scripts, its code blocks and the commands it names in inline code. This is detected, not audited.

How it scores

Quality

How well the skill is written, counted from its own files: its frontmatter, its steps, examples, stated output and constraints, its size and whether every file it ships is one it names.How we score it →
Good
  • Frontmatter12/15
  • Structure17/25
  • Examples3/15
  • Output15/15
  • Size11/15
  • Resources10/15

Security

Starts at 100 and loses points for each thing in the skill's files that a reader should look at first.How we score it →
Excellent

No findings.

Repository health

Pre-computed score based on development activity, maintenance, community, maturity, and trend momentum.How we score it →
Good
  • Development activity100
  • Maintenance52
  • Community64
  • Maturity32
  • Momentum40

reproduce-regression is the reproduction stage of the regression-hunt plugin from Trail of Bits. Given sealed preparation and discovery packages plus one candidate, it builds the real before (S0) and after (S1) systems with their services and traces the candidate to a real user or attacker entry point.

It then writes one portable proof of concept, runs it against both live deployments with identical input, and records whether S0 behaves correctly and S1 shows the claimed failure. Mocks, extracted functions and simulated systems are not accepted.

What You Get

  • A sealed reproduce.json with observations and false-positive checks
  • A portable PoC and the exact input used against both deployments
  • Saved setup, tool and dependency versions, sanitized configuration and separate logs for each system
  • A status of complete or blocked, with the missing prerequisites listed when blocked

Common Use Cases

  • Proving that a suspected regression in a pull request changes behavior in the running product
  • Checking that a build or install finding shows up in the supported build workflow
  • Recording a blocked attempt with its exact prerequisites so a person can finish it

What Makes It Unique

The skill demands a live-system experiment. It says that a unit test, mock or extracted function cannot establish a regression, and it ties each finding to a real entry point. It also separates finishing the experiment from confirming the regression: completion only means the run ended. Independent verification of an existing PoC belongs to the replay skill.

Under The Hood

The skill is a short instruction file with no scripts of its own. It tells the agent to read the plugin’s standard and file contract, then build, install and run the actual before and after systems with their services, which means running shell commands, building software and starting deployments on the machine. The agent writes the PoC, logs, configuration copies and the reproduce.json record to files inside its own attempt directory, lists every build directory, and releases temporary resources at the end while keeping the evidence. It does not fetch web pages or call APIs by its own instruction, though a build may download dependencies.

Join founders building with open source

Opinionated takes, migration guides, cost-saving tips, and insights from the open source ecosystem.

Subscribe on SubstackJoin 750+ subscribers