Skip to content
SkillModel-led1,365 tokens in use

mutation-testing

Configures mewt and muton mutation testing campaigns, analyzes surviving mutants and uses them to find bugs in weakly tested code.

8,319 stars on the repository CC-BY-SA-4.0trailofbits/skills · plugins/mutation-testing/skills/mutation-testing
/plugin marketplace add trailofbits/skills
View source

Install command as written in the repository's README

Skill label

measured from its files

What installing mutation-testing costs

47tokens idle
1,365tokens in use
14,982tokens, up to

Idle is what sits in context while the skill is installed. In use is its instructions, loaded when it runs. Up to adds the files its instructions link. Counts are approximate, made offline with cl100k_base.

Model dependence Model-led

Script-ledMixedModel-led

Mostly instructions, so how well it works depends on the model that follows them.

This describes the skill's structure, how much of it is scripts. It does not say how well it works.

Touches

shelldeclared and detectedwrites filesdeclared

Declared tags come from the skill's frontmatter; detected ones from its scripts, its code blocks and the commands it names in inline code. This is detected, not audited.

How it scores

Quality

How well the skill is written, counted from its own files: its frontmatter, its steps, examples, stated output and constraints, its size and whether every file it ships is one it names.How we score it →
Good
  • Frontmatter12/15
  • Structure9/25
  • Examples12/15
  • Output10/15
  • Size15/15
  • Resources13/15

Security

Starts at 100 and loses points for each thing in the skill's files that a reader should look at first.How we score it →
Excellent
  • Runs shell commands−2

    does this on the machine, as the frontmatter declares

    SKILL.md, line 57

Repository health

Pre-computed score based on development activity, maintenance, community, maturity, and trend momentum.How we score it →
Good
  • Development activity100
  • Maintenance52
  • Community64
  • Maturity32
  • Momentum40

Mutation Testing routes the agent to the right workflow for mewt or muton, two mutation testing tools with the same interface. It covers setting up and speeding up a campaign, hunting bugs in code that survivors show to be untested, and turning results into a formal analysis report.

The skill lists the essential commands, explains what caught, uncaught, timeout and skipped outcomes mean, and ranks mutation types by severity while reminding the reader that severity ranks the mutation, not the risk.

What You Get

  • A command cheat sheet for mewt init, mutate, run, status, results, print and test
  • Guidance for reading outcomes such as uncaught, timeout and skipped
  • A severity table for mutation types such as error replacement and condition changes
  • An equivalent mutant catalog with a verification procedure
  • A report template and notes on parsing output from slither-mutate, mull and dextool-mutate

Common Use Cases

  • Setting up and trimming a mutation campaign that runs too long
  • Reviewing which surviving mutants point to real test gaps
  • Telling equivalent mutants apart from missing tests
  • Using survivors in a smart contract codebase to look for bugs

What Makes It Unique

It treats surviving mutants as leads for finding bugs, not only as a coverage number, and it keeps the loading rules in one place so workflows do not load each other. It points to the tool’s own —help as the source of truth for flags, includes blockchain-specific patterns for Solidity, Move, FunC, Cairo and Solana, and can read results from other mutation tools.

Under The Hood

The skill is prose with workflow and reference files and no scripts. The agent runs mewt or muton commands in the shell, which create a config file and a SQLite database in your project, generate mutated copies of source files, and run your test suite against them. It reads and searches your code and tests and can write reports and ID lists to files. It does not call web services itself.

Join founders building with open source

Opinionated takes, migration guides, cost-saving tips, and insights from the open source ecosystem.

Subscribe on SubstackJoin 750+ subscribers