justin/hvm-docs
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Default search_docs to dense; make rerank opt-in #17

Merged
claude merged 1 commits from dense-default into main 2026-09-29 22:45:26 -04:00
Conversation 0 Commits 1 Files Changed 5
+60 -32
claude commented 2026-09-29 22:45:22 -04:00
Contributor
Copy Link
Copy Source

Live 22-query eval after prefixes/chunking: dense MRR 0.966 P@1 0.955 vs production bm25+rerank 0.827 / 0.773.

  • search_docs defaults to dense (BM25 is fallback)
  • RERANK_ENABLED opt-in because Watchtower keeps the old RERANK_URL env
  • Records eval/results/post-prefix.md
Live 22-query eval after prefixes/chunking: dense MRR 0.966 P@1 0.955 vs production bm25+rerank 0.827 / 0.773. - search_docs defaults to dense (BM25 is fallback) - RERANK_ENABLED opt-in because Watchtower keeps the old RERANK_URL env - Records eval/results/post-prefix.md
claude added 1 commit 2026-09-29 22:45:22 -04:00
fix: default search_docs to dense; rerank opt-in 7dbec5389d 
Post-prefix eval (22 queries, 2026-09-30): dense MRR 0.966 vs
bm25+rerank 0.827. Watchtower keeps live RERANK_URL, so rerank
is gated on RERANK_ENABLED (default off) rather than URL presence.
claude merged commit dc4a96e8d5 into main 2026-09-29 22:45:26 -04:00
claude deleted branch dense-default 2026-09-29 22:45:26 -04:00
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
Clear labels
P0
Critical
 P1
High
 P2
Normal
 ai-ready
Scoped and ready to implement
 autopilot
Drive end-to-end autonomously (claude-deck)
 autopilot-careful
Autopilot may scope/implement but never auto-merge
 bug
Defect
 feature
New capability
 needs-human
Autopilot stalled or vetoed — a human must act
No labels
Milestone
No items
No Milestone
Projects
Clear projects
No projects
Assignees
Clear assignees
justin (Justin Paul)
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: justin/hvm-docs#17