feat(scrape): auto-discover HVM versions + add 9.0 to corpus
HVM (HPE Morpheus VM Essentials) 9.0.0 shipped June 2026; the MCP had
nothing about it. Add it and stop hand-adding a docId per release.
scrape/bundles.py now AUTO-DISCOVERS new versions (discover_specs, on by
default): it scans the DocPortal docId range above the highest known
bundle and classifies each abstract. On-by-default in CI's refresh.yml,
so future releases flow into the corpus with no code change. Gotchas
encoded:
- classify on the abstract BODY, not the <h1> (a Release Notes h1 is
just "v9.0.0 Release Notes" with no product name)
- EXCLUDE the interleaved siblings that share the same version string:
Morpheus Enterprise, Morpheus Central, Storage Integration Pack
- failsoft: a scan error logs a warning and falls back to known bundles
- self-healing + idempotent: prior bundles.json persists discoveries;
the scan anchor rolls forward; re-runs add no duplicates
Discovered + scraped for 9.0.0:
- User Manual sd00008058en_us (414 pages; Deployment Guide now folded in)
- Release Notes sd00008079en_us
corpus: +412 pages (9.0), sidecar topic_cluster peers re-linked to 9.0
across the 8.1.x bundles (shared GUIDs). Local reindex: 3645 chunks
(956 are 9.0.0); 9.0 content verified retrievable end-to-end.
Co-Authored-By: Claude Opus 4.8 <[email protected]>
Claude-Session: https://claude.ai/code/session_01MNQRS6F7N9Uwh1SMn3xz2g
This commit is contained in:
+35
-1
@@ -113,7 +113,7 @@
|
||||
"mode": "toc",
|
||||
"abstract": "HPE Morpheus VM Essentials Deployment Guide",
|
||||
"dates": {
|
||||
"Published": "January 2026"
|
||||
"Published": "July 2026"
|
||||
},
|
||||
"landing_page": "GUID-BF94B8DA-C4F6-4CDF-99E6-0AAA03177099",
|
||||
"source_url": "https://support.hpe.com/hpesc/public/docDisplay?docId=sd00007332en_us"
|
||||
@@ -149,5 +149,39 @@
|
||||
"dates": {},
|
||||
"landing_page": "a50004260enw",
|
||||
"source_url": "https://www.hpe.com/psnow/doc/a50004260enw"
|
||||
},
|
||||
{
|
||||
"slug": "hvm_user_manual_9_0_0",
|
||||
"doc_id": "sd00008058en_us",
|
||||
"title": "HPE Morpheus VM Essentials Software Documentation v9.0.0",
|
||||
"version": "9.0.0",
|
||||
"platform": null,
|
||||
"product": "User Manual",
|
||||
"language": "en-US",
|
||||
"page_count": 414,
|
||||
"mode": "toc",
|
||||
"abstract": "User Manual for HPE Morpheus VM Essentials Software version v9.0.0",
|
||||
"dates": {
|
||||
"Published": "July 2026"
|
||||
},
|
||||
"landing_page": "GUID-498C49E5-5D26-44E1-A2CC-9AAC0813BA93",
|
||||
"source_url": "https://support.hpe.com/hpesc/public/docDisplay?docId=sd00008058en_us"
|
||||
},
|
||||
{
|
||||
"slug": "hvm_release_notes_9_0_0",
|
||||
"doc_id": "sd00008079en_us",
|
||||
"title": "v9.0.0 Release Notes",
|
||||
"version": "9.0.0",
|
||||
"platform": null,
|
||||
"product": "Release Notes",
|
||||
"language": "en-US",
|
||||
"page_count": 1,
|
||||
"mode": "single",
|
||||
"abstract": "Release notes for HPE Morpheus VM Essentials version v9.0.0",
|
||||
"dates": {
|
||||
"Published": "June 2026"
|
||||
},
|
||||
"landing_page": "sd00008079en_us",
|
||||
"source_url": "https://support.hpe.com/hpesc/public/docDisplay?docId=sd00008079en_us"
|
||||
}
|
||||
]
|
||||
|
||||
Reference in New Issue
Block a user