layue13
05f8fad38a
Gatekeep evals / eval-floor (push) Successful in 8s
Add .github/workflows/gatekeep-pr.yml with uses: ./ and OPENROUTER_API_KEY from secrets. Forge-agnostic API helper for Gitea.
8 lines
465 B
Markdown
8 lines
465 B
Markdown
# Incidents → evals
|
|
|
|
1. Restore service (revert / slot swap). Flip `GATEKEEP_MERGE_ENABLED=false` if needed.
|
|
2. File **gatekeep-incident** issue (template in `templates/gatekeep-incident.yml`).
|
|
3. Add `incidents/seed/<id>.json` + `evals/cases/<id>.json` with `expect_min_tier`.
|
|
4. Tighten `defaults/policy.json` (or consumer override) / security checklist; never delete a failing case to go green.
|
|
5. `bash scripts/eval-floor.sh evals/cases defaults/policy.json`
|