# fierros-evals

Evaluation datasets, metrics, and reporting primitives.

## Public API

- Dataset loading: `load_jsonl`, `parse_jsonl`, `EvalCase`
- Metrics:
  - `retrieval_recall`
  - `source_precision`
  - `refusal_accuracy`
  - `schema_validity_score`
  - `average`
- Reporting: `EvalCaseReport`, `EvalReport`
- Production gates:
  - `assess_eval_thresholds`
  - `evaluate_load_test`
  - `build_slo_dashboard`
  - `evaluate_reliability`

## Example command

```bash
fierros eval ./examples/evals/rag_questions.jsonl
```

See the root README and `docs/` for architecture, specs, RFCs, ADRs, and policy.
