Skip to content
SkillModel-led1,665 tokens in use

rag-architect

Designs RAG systems end to end: chunking, embeddings, vector stores, hybrid search, reranking and retrieval evaluation with set thresholds.

12,471 stars on the repository MIT LicenseJeffallan/claude-skills · skills/rag-architect
/plugin marketplace add jeffallan/claude-skills /plugin install fullstack-dev-skills@fullstack-dev-skills
View source

Install command as written in the repository's README

Skill label

measured from its files

What installing rag-architect costs

74tokens idle
1,665tokens in use
25,189tokens, up to

Idle is what sits in context while the skill is installed. In use is its instructions, loaded when it runs. Up to adds the files its instructions link. Counts are approximate, made offline with cl100k_base.

Model dependence Model-led

Script-ledMixedModel-led

Mostly instructions, so how well it works depends on the model that follows them.

This describes the skill's structure, how much of it is scripts. It does not say how well it works.

Touches

credentialsdetected

Declared tags come from the skill's frontmatter; detected ones from its scripts, its code blocks and the commands it names in inline code. This is detected, not audited.

How it scores

Quality

How well the skill is written, counted from its own files: its frontmatter, its steps, examples, stated output and constraints, its size and whether every file it ships is one it names.How we score it →
Excellent
  • Frontmatter15/15
  • Structure22/25
  • Examples15/15
  • Output15/15
  • Size15/15
  • Resources15/15

Security

Starts at 100 and loses points for each thing in the skill's files that a reader should look at first.How we score it →
Excellent
  • Reads credentials−15

    does this on the machine, and the frontmatter does not say so

    SKILL.md, line 139

Repository health

Pre-computed score based on development activity, maintenance, community, maturity, and trend momentum.How we score it →
Excellent
  • Development activity100
  • Maintenance100
  • Community60
  • Maturity36
  • Momentum40

RAG Architect guides Claude through building retrieval-augmented generation in five steps: requirements, vector store design, chunking, the retrieval pipeline and evaluation. Each step has a checkpoint to pass before the next.

The skill includes Python examples for chunking with metadata, idempotent indexing into Qdrant with OpenAI embeddings, hybrid vector and BM25 search with tenant filters, Cohere reranking and RAGAS evaluation.

What You Get

  • A five-step workflow with a validation checkpoint for each step
  • Five implementation examples: chunking, embedding and indexing, hybrid search, reranking and retrieval evaluation
  • Reference files for vector databases, embedding models, chunking strategies, retrieval optimization and RAG evaluation
  • Rules for hybrid search, metadata filters, reranking, deterministic IDs, embedding versioning and measured retrieval metrics
  • An output template with an architecture diagram, database trade-offs, chunking rationale, pipeline design and an evaluation plan

Common Use Cases

  • Choosing between Pinecone, Weaviate, Chroma, pgvector and Qdrant
  • Setting chunk size and overlap by testing on domain data
  • Adding BM25 and reranking on top of vector search
  • Building a multi-tenant retrieval index with metadata filters
  • Measuring retrieval quality with precision, recall and MRR

What Makes It Unique

The skill treats retrieval quality as something to measure apart from answer quality. Checkpoints assert metadata and deduplication, evaluation targets are numeric, and it warns against defaults such as an unevaluated chunk size of 512. Embedding choices are versioned so a model migration can be planned.

Under The Hood

The skill is instructions and reference markdown that Claude loads by topic; it ships no scripts. Its examples call the OpenAI embeddings API, the Cohere rerank API with a key read from an environment variable, and a Qdrant server on localhost, and the indexing example recreates a collection, which deletes the existing one. Claude writes Python files in your project and may run an evaluation script if you have one.

Join founders building with open source

Opinionated takes, migration guides, cost-saving tips, and insights from the open source ecosystem.

Subscribe on SubstackJoin 750+ subscribers