Loading...

agent-evals

Original：🇺🇸 English

Translated

Build automated evaluation suites for AI agents using golden datasets, rubrics, and regression gates.

1installs

Sourcebagelhole/devops-security-agent-skills

Added on2026-02-22

NPX Install

npx skill4agent add bagelhole/devops-security-agent-skills agent-evals

Tags

Translated version includes tags in frontmatter

ai-agent-evaluation automated-testing ci-cd-integration safety-evaluation golden-dataset

SKILL.md Content

View Translation Comparison →

Agent Evals

Create repeatable checks so agent behavior improves safely over time.

Evaluation Layers

Unit evals: prompt-level correctness
Tool evals: API/tool call decision quality
End-to-end evals: realistic multi-step tasks
Safety evals: prompt injection and data leak resistance

CI/CD Integration

bash

# Example eval pipeline steps
make evals-smoke
make evals-regression
make evals-safety

Best Practices

Version datasets with expected outputs.
Track pass rates and score drift over time.
Block deploys on critical safety regressions.

Related Skills

github-actions - Eval automation in CI
ai-agent-security - Security-focused eval cases