scrape: add Qualification Matrix + QuickSpecs bundles (live curl_cffi for HPE www)
Two new bundles:
* hvm_qualification_matrix (sd00006551en_us) — the "Qualification Matrix
for HVM Clusters Managed by HPE Morpheus Software". Single TOC bundle,
2 pages (parent + content). The content page is ~100 KB of HTML
containing five tables: Server Hardware Support, Storage Hardware
Support, Independent Software Vendor (ISV) Support, Hypervisor OS
Compatibility and Interoperability Matrix, and Guest OS. Scraped via
the same /hpesc/public/api/document/{docId}/render endpoint as every
other bundle on support.hpe.com — the API returns server-rendered
DITA HTML, so no JS/SPA shenanigans.
* hvm_quickspecs (a50004260enw) — HPE Morpheus VM Essentials Software
QuickSpecs, Version 4 (02-Feb-2026). SKUs: S5Q81AAE (1-yr per Socket
E-LTU), S5Q82AAE (3-yr), S5Q83AAE (5-yr); each includes Tech Care
Essentials. QuickSpecs lives at www.hpe.com (not support.hpe.com),
which drops connections at the edge for non-browser TLS fingerprints —
verified 2026-05-22 against curl, wget, urllib, and Anthropic's
WebFetch (all = 0 bytes / connection timeout in headers). Bypassed
here via curl_cffi impersonating Chrome 120's JA3/JA4 fingerprint.
HTTP 200, 255 KB on first try, all four sections + all three SKUs
cleanly parseable from the server-rendered HTML.
New module scrape/quickspecs.py drives the live fetch + parse for any
hvm_*_quickspecs bundle. CSS selectors taken from the captured DOM:
.lr-right-rail hpe-highlights-container .collateral-content
— one block per H3 section
h3.txto-title — section title
div.txto-description — section body
uc-table.uc-table-polaris — SKU and version-history tables
On any live failure the parser falls back to a committed HTML fixture
at scrape/quickspecs/<doc_id>.html so the build never breaks on a
transient edge hiccup.
scrape/runner.py learned a new mode "html-file" that dispatches to
scrape.quickspecs; bundles.py extended with an optional source_url on
BundleSpec for cases where the page lives outside support.hpe.com.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,27 @@
|
||||
# scrape/quickspecs/
|
||||
|
||||
Static HTML fixtures for HPE QuickSpecs documents that aren't reachable
|
||||
from the runner (www.hpe.com edge drops connections from datacenter IPs
|
||||
with non-browser User-Agents — verified 2026-05-22 with curl, wget, and
|
||||
Anthropic's WebFetch).
|
||||
|
||||
## Workflow
|
||||
|
||||
1. Operator visits `https://www.hpe.com/psnow/doc/<doc_id>` in a real
|
||||
browser, opens DevTools → Elements → Copy the `<body>` HTML.
|
||||
2. Save it at `scrape/quickspecs/<doc_id>.html`.
|
||||
3. Add a bundle entry in `scrape/bundles.py` with `mode="html-file"`.
|
||||
4. `python -m scrape.runner --bundle hvm_quickspecs --force` reads the
|
||||
committed HTML and writes `corpus/hvm_quickspecs/<doc_id>.{md,json}`.
|
||||
5. Re-index and ship.
|
||||
|
||||
QuickSpecs only update every few months (HPE rebrand, new SKU added,
|
||||
feature change). When a new version drops, refresh the local HTML
|
||||
file and re-run the scrape.
|
||||
|
||||
## Current fixtures
|
||||
|
||||
- `a50004260enw.html` — HPE Morpheus VM Essentials Software QuickSpecs
|
||||
(Version 4, 02-February-2026). SKUs: S5Q81AAE (1-yr), S5Q82AAE
|
||||
(3-yr), S5Q83AAE (5-yr) — all "per Socket E-LTU" with Tech Care
|
||||
Essentials included.
|
||||
@@ -0,0 +1,219 @@
|
||||
<!-- Source: https://www.hpe.com/us/en/collaterals/collateral.a50004260enw.html
|
||||
Captured: 2026-05-22 (Version 4, 02-February-2026)
|
||||
Reason for static fixture: www.hpe.com edge drops connections from
|
||||
datacenter IPs / non-browser User-Agents. Operator captures the
|
||||
.lr-right-rail HTML in a browser and commits it here.
|
||||
Parser: python -m scrape.quickspecs_parse a50004260enw -->
|
||||
<div class="quickspecs-content">
|
||||
<h1>HPE Morpheus VM Essentials Software QuickSpecs</h1>
|
||||
<p><em>Version 4 — 02-February-2026 — a50004260enw</em></p>
|
||||
<p><strong>HPE Morpheus VM Essentials Software is a virtualization
|
||||
software solution that allows customers to provision and manage KVM
|
||||
and VMware-based VMs from a single intuitive interface.</strong></p>
|
||||
|
||||
<h2 id="overview">Overview</h2>
|
||||
<p>The solution comes with the KVM-based HVM hypervisor that is enhanced
|
||||
to include enterprise-grade cluster management with capabilities such
|
||||
as high availability, live compute and storage migration, distributed
|
||||
workload placement, integrated data protection, secure hardening, and
|
||||
external storage support. To enable flexibility for those continuing to
|
||||
host VMware-based applications, VM Essentials can also be used to
|
||||
connect to and manage existing VMware clusters. This means unified
|
||||
management and simple VM provisioning across both the HVM hypervisor
|
||||
and VMware ESXi™ so you can provision workloads on demand to the right
|
||||
environment, on your terms, with zero lock-in. When you're ready, you
|
||||
can use the included toolset to convert existing VMware images to
|
||||
VM Essentials.</p>
|
||||
|
||||
<h3>Validated Hardware and Software</h3>
|
||||
<p>The list of validated compute and storage hardware for VM Essentials
|
||||
can be found in the <a href="https://www.hpe.com/support/VME-Compatibility-Matrix">compatibility matrix</a>,
|
||||
along with validated operating systems and ISV software.</p>
|
||||
|
||||
<h3>Models</h3>
|
||||
<p>Hewlett Packard Enterprise is making the following VM Essentials
|
||||
SKUs available. VM Essentials SKUs are licensed per physical CPU
|
||||
socket. Each SKU includes Tech Care Essentials support.</p>
|
||||
|
||||
<table>
|
||||
<caption>HPE Morpheus VM Essentials Software SKUs</caption>
|
||||
<thead><tr><th>Description</th><th>SKU</th></tr></thead>
|
||||
<tbody>
|
||||
<tr><td>HPE Morpheus VM Essentials Software per Socket 1-year E-LTU</td><td><code>S5Q81AAE</code></td></tr>
|
||||
<tr><td>HPE Morpheus VM Essentials Software per Socket 3-year E-LTU</td><td><code>S5Q82AAE</code></td></tr>
|
||||
<tr><td>HPE Morpheus VM Essentials Software per Socket 5-year E-LTU</td><td><code>S5Q83AAE</code></td></tr>
|
||||
</tbody>
|
||||
</table>
|
||||
|
||||
<h2 id="standard-features">Standard Features</h2>
|
||||
|
||||
<h3>Key Features</h3>
|
||||
|
||||
<h4>Enterprise Virtualization</h4>
|
||||
<ul>
|
||||
<li><strong>VM Live Migration:</strong> Migrate running virtual
|
||||
machines from one physical host to another within an HVM cluster
|
||||
without downtime to improve host utilization or to perform host
|
||||
maintenance.</li>
|
||||
<li><strong>VM High Availability:</strong> Enable workload resiliency
|
||||
with virtual machine high availability to quickly restart virtual
|
||||
machines on another physical host in the event of a host failure.</li>
|
||||
<li><strong>Distributed Workload Placement:</strong> Dynamically
|
||||
schedule the placement of virtual machines within an HVM cluster
|
||||
based on intelligent placement logic that determines the optimal host
|
||||
for the virtual machine.</li>
|
||||
<li><strong>VM Live Storage Migration:</strong> Migrate a running
|
||||
virtual machine's storage disks from one datastore to another without
|
||||
downtime.</li>
|
||||
<li><strong>External Storage Support:</strong> Integrate with existing
|
||||
external storage (NFS, iSCSI, Fibre Channel) to take advantage of
|
||||
existing infrastructure investments.</li>
|
||||
</ul>
|
||||
|
||||
<h4>Solution Integrations</h4>
|
||||
<ul>
|
||||
<li><strong>VMware vSphere Integration:</strong> Integrate VM
|
||||
Essentials with a vSphere deployment to discover existing virtual
|
||||
machines, provision new virtual machines, as well as manage
|
||||
provisioned or discovered machines.</li>
|
||||
<li><strong>Native IP Pools:</strong> Assign virtual machine IP
|
||||
addresses using the VM Essentials native IP pools feature to define
|
||||
and manage pools of IP addresses associated with virtual machine
|
||||
networks.</li>
|
||||
<li><strong>Native Secrets Management:</strong> Securely store and
|
||||
retrieve credentials and other sensitive information used in
|
||||
automation tasks for bootstrapping and managing managed virtual
|
||||
machines.</li>
|
||||
<li><strong>IP Address Management (IPAM) Integration:</strong>
|
||||
Integrate 3rd party IPAM solutions (InfoBlox, BlueCat, SolarWinds,
|
||||
phpIPAM, EfficientIP) to automate the reservation and assignment of
|
||||
IP address.</li>
|
||||
<li><strong>Domain Name System (DNS) Integration:</strong> Integrate
|
||||
3rd party DNS solutions (PowerDNS, Microsoft DNS, BlueCat, InfoBlox,
|
||||
EfficientIP) to automate the creation of DNS A and PTR records.</li>
|
||||
<li><strong>Native Data Protection:</strong> Create and restore
|
||||
snapshot-based backups for VM Essentials and VMware virtual machines
|
||||
using the native data protection functionality.</li>
|
||||
<li><strong>Data Protection Integration:</strong> Integrate 3rd party
|
||||
Data Protection solutions (Commvault, Rubrik, Veeam) to create backup
|
||||
jobs during the creation of a VMware virtual machine and restore
|
||||
backups through the VM Essentials web interface.</li>
|
||||
<li><strong>Provisioning Task Automation:</strong> Execute automation
|
||||
scripts (Bash and PowerShell) during the provisioning of virtual
|
||||
machines to orchestrate bootstrap operations such as software
|
||||
installation and system configuration.</li>
|
||||
<li><strong>HPE Alletra Storage MP Integration:</strong> Integrate
|
||||
with the HPE Alletra Storage MP B10000 storage array to utilize
|
||||
direct virtual machine volume mapping to the storage array to enable
|
||||
granular performance configuration and array-based snapshotting.</li>
|
||||
</ul>
|
||||
|
||||
<h3>Virtual Machine Management</h3>
|
||||
<ul>
|
||||
<li><strong>Power Operations:</strong> Start, stop, and restart
|
||||
VMware and HVM virtual machines.</li>
|
||||
<li><strong>Snapshot Management:</strong> Create, revert, and delete
|
||||
virtual machine snapshots for VMware and HVM virtual machines.</li>
|
||||
<li><strong>Virtual Hardware Management:</strong> Add and remove
|
||||
virtual hardware such as hard disks, network interfaces, CPU and
|
||||
memory from a managed virtual machine (VM Essentials or VMware).</li>
|
||||
<li><strong>Integrated Backup Management:</strong> Create, restore,
|
||||
and delete virtual machine backups for VMware and HVM virtual
|
||||
machines.</li>
|
||||
<li><strong>HTML5 Console:</strong> Access the console of managed
|
||||
virtual machines via the VM Essentials manager web interface with
|
||||
support for Virtual Network Computing (VNC), Secure Shell (SSH), and
|
||||
Remote Desktop Protocol (RDP).</li>
|
||||
<li><strong>Day 2 Task Automation:</strong> Execute automation
|
||||
scripts (Bash and PowerShell) against managed virtual machines to
|
||||
perform day 2 operational tasks such as freeing up disk space or
|
||||
updating system packages.</li>
|
||||
<li><strong>Tag Management:</strong> Create and manage virtual
|
||||
machine tags for VMware and VM Essentials virtual machines.</li>
|
||||
</ul>
|
||||
|
||||
<h2 id="service-and-support">Service and Support</h2>
|
||||
|
||||
<h3>HPE Services</h3>
|
||||
<p>No matter where you are in your digital transformation journey, you
|
||||
can count on HPE Services to deliver the expertise you need when, where
|
||||
and how you need it. From planning to deployment, ongoing operations
|
||||
and beyond, our experts can help you realize your digital ambitions.
|
||||
See <a href="https://www.hpe.com/services">https://www.hpe.com/services</a>.</p>
|
||||
|
||||
<h3>HPE Complete Care Service</h3>
|
||||
<p>A modular, edge-to-cloud IT environment service designed to help
|
||||
optimize your entire IT environment and achieve agreed-upon IT outcomes
|
||||
and business goals through a personalized experience. Includes complete
|
||||
coverage, an assigned HPE team, modular engagement, enhanced incident
|
||||
management with priority access, and AI-driven customer experience.
|
||||
See <a href="https://www.hpe.com/services/completecare">https://www.hpe.com/services/completecare</a>.</p>
|
||||
|
||||
<h3>HPE Tech Care Service</h3>
|
||||
<p>Operational support service experience for HPE products. Goes beyond
|
||||
traditional support by providing access to product-specific experts,
|
||||
an AI-driven digital experience, and general technical guidance.
|
||||
Available in three response levels:</p>
|
||||
<ul>
|
||||
<li><strong>Basic:</strong> 9×5 business hours, 2-hour response.</li>
|
||||
<li><strong>Essential:</strong> 15-minute response 24×7 (most
|
||||
enterprise customers).</li>
|
||||
<li><strong>Critical:</strong> 6-hour repair commitment where
|
||||
available, plus outage management response for severity 1
|
||||
incidents.</li>
|
||||
</ul>
|
||||
<p>See <a href="https://www.hpe.com/services/techcare">https://www.hpe.com/services/techcare</a>.</p>
|
||||
|
||||
<h3>HPE Lifecycle Services</h3>
|
||||
<ul>
|
||||
<li>Lifecycle Install and Startup Services.</li>
|
||||
<li>Firmware Update Analysis Service.</li>
|
||||
<li>Firmware Update Implementation Service.</li>
|
||||
<li>Implementation assistance services.</li>
|
||||
<li>HPE Service Credits.</li>
|
||||
</ul>
|
||||
<p>See <a href="https://www.hpe.com/services/lifecycle">https://www.hpe.com/services/lifecycle</a>.</p>
|
||||
|
||||
<h3>Other Related Services</h3>
|
||||
<ul>
|
||||
<li><strong>HPE Education Services:</strong> Training and
|
||||
certification. See <a href="https://www.hpe.com/services/training">https://www.hpe.com/services/training</a>.</li>
|
||||
<li><strong>Defective Media Retention:</strong> Available with
|
||||
Complete Care and Tech Care for disks/SSDs replaced due to
|
||||
malfunction.</li>
|
||||
<li><strong>Parts and Materials:</strong> HPE provides supported
|
||||
replacement parts including engineering improvements; parts past
|
||||
maximum supported lifetime are not provided.</li>
|
||||
<li><strong>How to Purchase:</strong> Services sold by HPE and HPE
|
||||
Authorized Service Partners. Customers from commercial resellers see
|
||||
<a href="https://ssc.hpe.com/portal/site/ssc/">ssc.hpe.com</a>.</li>
|
||||
</ul>
|
||||
|
||||
<h3>AI Powered and Digitally Enabled Support Experience</h3>
|
||||
<p>Sign into the HPE Support Center for streamlined self-serve case
|
||||
creation, knowledge recommendations, personalized task alerts, and an
|
||||
intelligent virtual agent with seamless transition to a live support
|
||||
agent when needed.
|
||||
See <a href="https://support.hpe.com/hpesc/public/home/signin">support.hpe.com</a>.</p>
|
||||
|
||||
<h3>Consume IT On Your Terms</h3>
|
||||
<p><a href="https://www.hpe.com/GreenLake">HPE GreenLake</a>
|
||||
edge-to-cloud platform brings the cloud experience directly to your
|
||||
apps and data — at the edge, in colocations, or in your data center.
|
||||
Pay-per-use, scalable, self-service experience.</p>
|
||||
|
||||
<h2 id="summary-of-changes">Summary of Changes</h2>
|
||||
<table>
|
||||
<thead><tr><th>Date</th><th>Version</th><th>Action</th><th>Description</th></tr></thead>
|
||||
<tbody>
|
||||
<tr><td>02-Feb-2026</td><td>Version 4</td><td>Changed</td><td>HPE Rebranding applied</td></tr>
|
||||
<tr><td>05-May-2025</td><td>Version 3</td><td>Changed</td><td>Branding updates, Overview and Standard Features sections updated.</td></tr>
|
||||
<tr><td>13-Jan-2025</td><td>Version 2</td><td>Changed</td><td>Overview and Standard Features sections updated.</td></tr>
|
||||
<tr><td>02-Dec-2024</td><td>Version 1</td><td>New</td><td>New QuickSpecs.</td></tr>
|
||||
</tbody>
|
||||
</table>
|
||||
|
||||
<hr />
|
||||
<p><em>© Copyright 2026 Hewlett Packard Enterprise Development LP.
|
||||
a50004260enw, 16864 - Worldwide - V4 - 02-February-2026.</em></p>
|
||||
</div>
|
||||
Reference in New Issue
Block a user