The chunker emits any single paragraph as a stand-alone chunk regardless
of size. One HVM page had a 14,858-char paragraph (a big config table) —
nomic-embed-text 400'd the entire embed batch because the model's context
is 2048 tokens. Added a hard-split fallback that splits any oversized
chunk on line boundaries to MAX_CHARS=6000 (~1500 tokens, headroom).
Also defaulted PRODUCT_NAME to "hvm" in rag/index.py to match server.py.
Co-Authored-By: Claude Opus 4.7 (1M context) <[email protected]>
justinandClaude Opus 4.7
dd691b0111