Loading...
Loading...
Entry point for evals. Use when the user asks for help with evals, does not know where to begin, or asks for something no other skill in this plugin matches. Do NOT use when a more specific skill in this plugin already matches; load that skill directly.
npx skill4agent add ai-evals-course/evals-skills start| Situation | Skill to load |
|---|---|
| Has traces, wants to find failure modes, no established taxonomy yet | |
| Has an existing eval pipeline and wants to know if it can be trusted | |
| Has a known failure mode and wants an LLM judge for it | |
| Has an LLM judge or evaluator and wants to check its quality | |
| Has no traces to review yet | |
| Wants a custom annotation interface for some other labeling task | |
| Wants to evaluate a RAG pipeline | |
error-discoveryeval-audit