justin c33682c968 eval: new baseline on the 4-endpoint embed pool index ...

22 queries against the prod image index rebuilt today on the expanded
GPU pool with the resilient embedder (PR #8): dense MRR 0.539→0.557,
bm25+rerank 0.920→0.959, hybrid_rrf+rerank 0.875→0.960 vs the
2026-05-22 baseline. No regression from mixed-provenance embeddings.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

2026-06-10 20:37:41 -04:00

..

results

eval: new baseline on the 4-endpoint embed pool index

2026-06-10 20:37:41 -04:00

__init__.py

initial: docs-mcp-template — build guide + scaffolded server

2026-05-22 09:18:17 -04:00

queries.jsonl

search: BM25-default + cross-encoder rerank, hybrid behind env gate

2026-05-22 13:06:51 -04:00

queries.jsonl.example

initial: docs-mcp-template — build guide + scaffolded server

2026-05-22 09:18:17 -04:00

retrievers.py

search: BM25-default + cross-encoder rerank, hybrid behind env gate

2026-05-22 13:06:51 -04:00

run_eval.py

search: BM25-default + cross-encoder rerank, hybrid behind env gate

2026-05-22 13:06:51 -04:00