Gatekeep evals / eval-floor (push) Successful in 8s
Add .github/workflows/gatekeep-pr.yml with uses: ./ and OPENROUTER_API_KEY from secrets. Forge-agnostic API helper for Gitea.
726 B
726 B
Incident record schema
{
"id": "INC-2026-001",
"date": "2026-10-26",
"severity": "low|medium|high|critical",
"summary": "One-line what went wrong",
"pr_url": "https://github.com/org/repo/pull/123",
"merge_sha": "abc123",
"ai_tier_at_merge": "low|medium|high|null",
"should_have_been_tier": "low|medium|high",
"root_cause": "classifier_under_tier|missed_agreed_finding|agreement_split|missing_oracle|human_skip|prompt_miss|other",
"models_at_review": ["model-a", "model-b"],
"revert_pr_url": "https://github.com/org/repo/pull/124",
"revert_minutes": 15,
"eval_case_id": "must-stay-high-from-inc-2026-001",
"policy_change": "What glob/label/checklist changed",
"notes": "Freeform"
}