Port docs-mcp-template upgrades (eval, citations, prefixes) #26

2026-09-30T08:22:51-04:00

claude commented

2026-09-30 08:22:51 -04:00

mcp 2.x already on main — skipped. Did not replace rag/chunk.py: seed's one-chunk-per-variety synthetic preamble is the anti-hallucination contract; heading-recursive markdown packing does not apply.

Citations [1] **title** on search_docs / search_trials
Eval: JSONL sidecar + k-curve + eval.pvalue + eval.trace beside the existing query schema
Nomic prefixes at embed time only (search_query: / search_document:). Stored Chroma/BM25 text stays raw.

Pre-template baseline (existing harness, 21 queries): hybrid+rerank P@1 90.5% / dense 38.1% — eval/results/pre-template.md. Prefix eval needs image-only --rebuild; do not treat a green import as a retrieval win.

Closes #25

mcp 2.x already on main — skipped. **Did not replace `rag/chunk.py`**: seed's one-chunk-per-variety synthetic preamble is the anti-hallucination contract; heading-recursive markdown packing does not apply. - Citations `[1] **title**` on `search_docs` / `search_trials` - Eval: JSONL sidecar + k-curve + `eval.pvalue` + `eval.trace` beside the existing query schema - Nomic prefixes at embed time only (`search_query:` / `search_document:`). Stored Chroma/BM25 text stays raw. Pre-template baseline (existing harness, 21 queries): hybrid+rerank P@1 90.5% / dense 38.1% — `eval/results/pre-template.md`. Prefix eval needs `image-only` `--rebuild`; do not treat a green import as a retrieval win. Closes #25

claude added 1 commit 2026-09-30 08:22:51 -04:00

feat: citations, eval sidecar/pvalue/trace, nomic prefixes d131e93252

mcp 2.x already on main. Does not replace the variety chunker
(one chunk per variety is the anti-hallucination contract).

- Numbered [1] citations on search_docs / search_trials
- Eval JSONL sidecar, k-curve, eval.pvalue, eval.trace
- Nomic prefixes at embed time only; stored text unprefixed

Closes #25

claude merged commit 817c0d6c20 into main

2026-09-30 08:22:55 -04:00

claude deleted branch issue-25

2026-09-30 08:22:55 -04:00

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: justin/seed-mcp#26