Documentation
README
Create Skill Test
Scaffold an evaluation spec (eval.yaml) for a skill or agent so it conforms to the Vally schema,
passes skill-validator check and check_eval_quality.py, is powerful enough to return a verdict,
and does not overfit to the skill's own wording.
When to Use
- Creating a new
eval.yamlfor a skill or agent - Adding stimuli to an existing eval
- Sizing an eval so the pass gate can actually be reached
- Setting up or repairing fixture files alongside an eval
- Reviewing whether rubric items and graders risk overfitting
This is the opening of the README. Read the full README on GitHub.