Skill Optimization
fastskill optimize is an automated loop that improves a skill document by running evals, scoring results, and applying gradient-style patches until the skill reliably triggers on the cases you care about.
You provide a skill, a set of eval cases, and a grading config. FastSkill handles the rest: proposing edits, scoring outcomes, accepting or rejecting each step, and writing the best version to disk.
When to use it
- Your skill has good eval coverage but still misses cases it should trigger on.
- You’ve written a skill manually and want a data-driven refinement pass.
- You want to tune trigger precision without hand-editing text.
How it works
- The optimizer agent reads the current skill and a summary of failing cases, then proposes a text patch.
- The target agent runs the patched skill against a batch of eval cases.
- The gate compares the new score to the current best. If the improvement clears
gate_epsilon, the patch is accepted. - The run directory records every step’s artifacts for inspection.