Commit Graph
9 Commits
Author SHA1 Message Date
claudeandClaude Opus 4.8 b31121d90c fix(scrape): make vision OCR a per-bundle allowlist, not a corpus sweep
The first vision pass OCR'd every large image and, because the "transcribe
the table" prompt makes qwen render ANY image as a markdown table, it turned
60 product UI screenshots into junk "tables" in the corpus. In practice the
only image-only DATA in this corpus is the release-schedule matrix — the
upgrade-compatibility matrices etc. are already native HTML tables, no OCR
needed.

- Add BundleSpec.ocr (default False); the runner passes the OCR-enabling
  session only for bundles that opt in. Set ocr=True only on
  morpheus_release_schedule.
- Purge the 60 screenshot cache entries (keep the release-schedule one). The
  next --force refresh regenerates every other page's .md WITHOUT the bogus
  "## Image transcriptions" section, cleaning the deployed corpus + index.
- Update vision.py / refresh.yml docs to the allowlist model.

Also add scripts/vision_report.py — a self-contained HTML report pairing each
OCR'd source image with its transcription (uncertain-first) for accuracy
inspection. Regenerate anytime from corpus/.vision-cache/.

Verified: release schedule still transcribes (cache hit); cache is back to 1
entry; other bundles now pass no session so their images are left alone.

Co-Authored-By: Claude Opus 4.8 <[email protected]>
Claude-Session: https://claude.ai/code/session_01LFowQzJu7k97QLCRDSAeh1
2026-07-23 13:31:09 -04:00
hvm-docs-refresh 6686b033e6 weekly refresh: 2026-07-23T14:45Z — 156 content change(s) across 4 bundle(s)
156 content change(s) across 4 bundle(s)
60 sidecar metadata update(s)

Bundles with content changes:
  morpheus_user_manual_8_1_0: 39 page(s)
    - GUID-06F0DB01-64F2-4D07-93F8-38AC80DBB09B
    - GUID-0A5AD977-07F5-4278-9CB3-F7D8AB8427A3
    - GUID-173469C2-D5C6-47F6-8A01-41C3D73B679B
    - GUID-180B8370-AEF2-45C1-9E72-99FF796CB222
    - GUID-2277183A-E315-4439-A885-C111A77C7154
    ... and 34 more
  morpheus_user_manual_8_1_1: 39 page(s)
    - GUID-06F0DB01-64F2-4D07-93F8-38AC80DBB09B
    - GUID-0A5AD977-07F5-4278-9CB3-F7D8AB8427A3
    - GUID-173469C2-D5C6-47F6-8A01-41C3D73B679B
    - GUID-180B8370-AEF2-45C1-9E72-99FF796CB222
    - GUID-2277183A-E315-4439-A885-C111A77C7154
    ... and 34 more
  morpheus_user_manual_8_1_2: 39 page(s)
    - GUID-06F0DB01-64F2-4D07-93F8-38AC80DBB09B
    - GUID-0A5AD977-07F5-4278-9CB3-F7D8AB8427A3
    - GUID-173469C2-D5C6-47F6-8A01-41C3D73B679B
    - GUID-180B8370-AEF2-45C1-9E72-99FF796CB222
    - GUID-2277183A-E315-4439-A885-C111A77C7154
    ... and 34 more
  morpheus_user_manual_9_0_0: 39 page(s)
    - GUID-06F0DB01-64F2-4D07-93F8-38AC80DBB09B
    - GUID-0A5AD977-07F5-4278-9CB3-F7D8AB8427A3
    - GUID-173469C2-D5C6-47F6-8A01-41C3D73B679B
    - GUID-180B8370-AEF2-45C1-9E72-99FF796CB222
    - GUID-2277183A-E315-4439-A885-C111A77C7154
    ... and 34 more

Bundles with sidecar-only drift (1): .vision-cache
2026-07-23 14:45:49 +00:00
claude 698196bd63 feat(scrape): vision OCR of image-only doc pages (support matrices) (#5)
Co-authored-by: claude <[email protected]>
2026-07-23 09:48:38 -04:00
hvm-docs-refresh caf562b7c3 weekly refresh: 2026-07-20T06:05Z — 0 content change(s) across 0 bundle(s)
0 content change(s) across 0 bundle(s)
0 sidecar metadata update(s)
2026-07-20 06:05:29 +00:00
hvm-docs-refresh 450380bbe8 weekly refresh: 2026-07-15T15:20Z — 587 content change(s) across 2 bundle(s)
587 content change(s) across 2 bundle(s)
2167 sidecar metadata update(s)
2 new bundle(s) added
1 other file change(s)

Bundles with content changes:
  morpheus_release_notes_9_0_0 (NEW): 1 page(s)
    - sd00008017en_us
  morpheus_user_manual_9_0_0 (NEW): 586 page(s)
    - GUID-008B6CB0-CC99-4E40-89CE-2EA5D3389D8F
    - GUID-00CE7A1B-7CBC-4227-B285-2E8E4FFC73B1
    - GUID-00E2C383-D602-4EAD-BE7F-64E69F5DD5C1
    - GUID-014CB518-CCE4-449A-9BCC-241FF8FEA3C5
    - GUID-016909A4-5AF9-4DE7-8088-DB62BBC6B00C
    ... and 581 more

Bundles with sidecar-only drift (6): morpheus_release_notes_8_1_0, morpheus_release_notes_8_1_1, morpheus_release_notes_8_1_2, morpheus_user_manual_8_1_0, morpheus_user_manual_8_1_1, morpheus_user_manual_8_1_2
2026-07-15 15:20:40 +00:00
hvm-docs-refresh 7b2c39bb0a weekly refresh: 2026-06-29T06:04Z — 0 content change(s) across 0 bundle(s)
0 content change(s) across 0 bundle(s)
0 sidecar metadata update(s)
2026-06-29 06:04:21 +00:00
hvm-docs-refresh 12298d1c7d weekly refresh: 2026-06-22T06:18Z — 1 content change(s) across 1 bundle(s)
1 content change(s) across 1 bundle(s)
0 sidecar metadata update(s)

Bundles with content changes:
  morpheus_quickspecs: 1 page(s)
    - a50009231enw
2026-06-22 06:18:14 +00:00
hvm-docs-refresh 5b929e40c2 weekly refresh: 2026-05-25T06:09Z — 0 content change(s) across 0 bundle(s)
0 content change(s) across 0 bundle(s)
0 sidecar metadata update(s)
2026-05-25 06:09:23 +00:00
hvm-docs-refresh 797750a4dc weekly refresh: 2026-05-22T19:31Z — 1599 content change(s) across 7 bundle(s)
1599 content change(s) across 7 bundle(s)
1599 sidecar metadata update(s)
7 new bundle(s) added

Bundles with content changes:
  morpheus_quickspecs (NEW): 1 page(s)
    - a50009231enw
  morpheus_release_notes_8_1_0 (NEW): 1 page(s)
    - sd00007496en_us
  morpheus_release_notes_8_1_1 (NEW): 1 page(s)
    - sd00007610en_us
  morpheus_release_notes_8_1_2 (NEW): 1 page(s)
    - sd00007733en_us
  morpheus_user_manual_8_1_0 (NEW): 531 page(s)
    - GUID-008B6CB0-CC99-4E40-89CE-2EA5D3389D8F
    - GUID-00CE7A1B-7CBC-4227-B285-2E8E4FFC73B1
    - GUID-00E2C383-D602-4EAD-BE7F-64E69F5DD5C1
    - GUID-014CB518-CCE4-449A-9BCC-241FF8FEA3C5
    - GUID-016909A4-5AF9-4DE7-8088-DB62BBC6B00C
    ... and 526 more
  morpheus_user_manual_8_1_1 (NEW): 532 page(s)
    - GUID-008B6CB0-CC99-4E40-89CE-2EA5D3389D8F
    - GUID-00CE7A1B-7CBC-4227-B285-2E8E4FFC73B1
    - GUID-00E2C383-D602-4EAD-BE7F-64E69F5DD5C1
    - GUID-014CB518-CCE4-449A-9BCC-241FF8FEA3C5
    - GUID-016909A4-5AF9-4DE7-8088-DB62BBC6B00C
    ... and 527 more
  morpheus_user_manual_8_1_2 (NEW): 532 page(s)
    - GUID-008B6CB0-CC99-4E40-89CE-2EA5D3389D8F
    - GUID-00CE7A1B-7CBC-4227-B285-2E8E4FFC73B1
    - GUID-00E2C383-D602-4EAD-BE7F-64E69F5DD5C1
    - GUID-014CB518-CCE4-449A-9BCC-241FF8FEA3C5
    - GUID-016909A4-5AF9-4DE7-8088-DB62BBC6B00C
    ... and 527 more
2026-05-22 19:31:35 +00:00