Autoresearch applies a Karpathy-style experiment loop to conversion copy that has no traffic yet. For each element of your content (a hero headline, a subject line, an ad description) it generates ten variants, has a panel of five simulated judges score them in one batched call, keeps the top three, and writes ten new variants that push the winning patterns further.
It stops when a variant reaches the score threshold (80 by default) or after three rounds, then cross-breeds the element winners into complete versions and scores those as whole units. Every run leaves three files: the optimized content, a full experiment log as JSON and a readable report that explains the winner.
What You Get
- An optimized content file named after your input
- An experiments JSON with every variant, every judge score and the top picks per round
- A Markdown optimization report with the winner and its rationale
- Two runner-up alternatives in case the winner does not feel right
- Quality gates that say whether the result is marginal, shippable or strong
Common Use Cases
- Tighten a hero headline, subheadline and CTA before a landing page goes live
- Rework an email subject line, opening line and PS before a send
- Test many ad headline and description options without spending on impressions
- Improve the headline, bullets and button text of a lead form page
What Makes It Unique
It separates simulated pre-launch scoring from real traffic tests and says to run it first, then deploy, then validate. It batches every round into one API call, scores per content type with tailored dimensions such as would_open for email or trust for forms, and refuses to cross-breed until each element has its own winner. The fifth judge is meant to be replaced with your own founder voice.
Under The Hood
The skill ships a Python script that uses the Anthropic SDK and needs an ANTHROPIC_API_KEY in the environment. It reads your input file, calls the Claude API to generate variants, scores them in single batched calls, and writes the result files into a data folder (and the optimized file next to your output path). It also pauses a second between rounds to respect rate limits. Nothing is published or sent anywhere else, and the source file is overwritten only if you turn on auto_apply.