Skip to main content

Skill Optimization

fastskill optimize is an automated loop that improves a skill document by running evals, scoring results, and applying gradient-style patches until the skill reliably triggers on the cases you care about. You provide a skill, a set of eval cases, and a grading config. FastSkill handles the rest: proposing edits, scoring outcomes, accepting or rejecting each step, and writing the best version to disk.

When to use it

  • Your skill has good eval coverage but still misses cases it should trigger on.
  • You’ve written a skill manually and want a data-driven refinement pass.
  • You want to tune trigger precision without hand-editing text.

How it works

Each training step:
  1. The optimizer agent reads the current skill and a summary of failing cases, then proposes a text patch.
  2. The target agent runs the patched skill against a batch of eval cases.
  3. The gate compares the new score to the current best. If the improvement clears gate_epsilon, the patch is accepted.
  4. The run directory records every step’s artifacts for inspection.

Key concepts

Quick summary of commands

See also