Add 4 independent seed brands: Latham, Stine, 1st Choice, Burrus (+623 varieties)

Four independent regional brands across IA/IN/IL (variety-identity sources,
each parsed into structured characteristics_groups so ratings embed):

- latham (264: 155 corn + 109 soy) — Latham Hi-Tech Seeds, Alexander IA.
  WordPress REST enum (/wp-json/wp/v2/varieties) + /products/<slug>/ detail
  HTML. Scale 1-9 LOWER=better (reversed, like NK/AgriPro).
- stine (217: 58 corn + 159 soy) — Stine Seed, Adel IA (largest US
  independent). sitemap enum + /{crop}/traits/<slug>/<code>/ detail HTML.
  Corn 1-9 (9=best); soy qualitative.
- first_choice (78: 52 corn + 22 soy + 4 wheat) — 1st Choice Seeds,
  Rushville IN (employee-owned). Per-crop sitemap -> detail HTML. Scale
  0-10 higher=better. ~40 older corn pages thin at source; wheat
  identity-only.
- burrus (64: 38 corn + 26 soy) — Burrus Seed, Arenzville IL. Seedware
  JSON API. Scale 1-10 (10=best). Brands Burrus/Power Plus/DONMARIO.
  robots ai-train=no + named-bot blocks; operator opted in, scraper uses a
  non-blacklisted UA + honors Crawl-delay 10.

All 623 validated through rag.chunk.chunks_from_variety (0 errors; 6
identity-only pages from source gaps). No chunk.py change needed (identity
sources auto-route to chunks_from_variety).

Docs:
- sources.json: 4 entries + Hoegemeyer added to _excluded_sources. The
  Corteva ToU (shared across pioneer.com / hoegemeyer.com / therightseed.com
  / corteva.com + the Vylor spinoff) bans scrapers + competitive use, so the
  whole Corteva family is one excluded ToU domain.
- docs_mcp/lessons.md: rating-scales updated with all 4 directions +
  an explicit cross-vendor warning (Latham 1=best vs Stine/Burrus higher=best
  — never compare raw numbers without _scale_direction).
- README + CLAUDE corpus inventory: now 2,268 variety + 6,787 trial records.

CI rebuilds the index from the committed corpus.
This commit is contained in:
2026-06-04 21:57:30 -04:00
parent 22e8092faf
commit 9600235466
1254 changed files with 103589 additions and 4 deletions
+143
View File
@@ -0,0 +1,143 @@
{
"source": "latham",
"source_key": "latham-lh-5159-ss-rib",
"vendor": "Latham Hi-Tech Seeds",
"brand": "Latham Hi-Tech Seeds",
"product_name": "LH 5159 SS RIB",
"product_id": "LH 5159 SS RIB",
"crop": "corn",
"release_year": "2021",
"relative_maturity": 101,
"maturity_group": null,
"wheat_class": null,
"trait_stack": [
"Smart Stax"
],
"trait_descriptions": [],
"positioning_statement": "A medium tall plant with medium ear placement and strong ear flex helps LH 5159 SS RIB the population flexibility to match to grower production style. High marks for early vigor, stress, and corn-on-corn situations on your medium-higher yield environments using medium population levels are key features.",
"strengths": [],
"characteristics_groups": [
{
"label": "AGRONOMIC CHARACTERISTICS",
"items": [
{
"characteristic": "Flowering for Maturity",
"value": "Equal"
},
{
"characteristic": "Early Vigor",
"value": "1.5"
},
{
"characteristic": "Stalk Strength",
"value": "2.0"
},
{
"characteristic": "Root Strength",
"value": "2.0"
},
{
"characteristic": "Stay Green",
"value": "2.0"
},
{
"characteristic": "Drydown",
"value": "2.0"
},
{
"characteristic": "Test Weight",
"value": "2.0"
},
{
"characteristic": "Drought Tolerance",
"value": "1.5"
},
{
"characteristic": "Foliar Fungicide",
"value": "1.5"
},
{
"characteristic": "Herbicide Sensitivity",
"value": "None Known"
},
{
"characteristic": "Suggested Population",
"value": "30,000-34,000"
},
{
"characteristic": "Corn-on-Corn",
"value": "1.0"
},
{
"characteristic": "Ear Height",
"value": "Medium"
},
{
"characteristic": "Ear Type",
"value": "Flex"
},
{
"characteristic": "Number of Kernel Rows",
"value": "16-18"
},
{
"characteristic": "Cob Color",
"value": "Red"
},
{
"characteristic": "Husk Cover",
"value": "Medium"
},
{
"characteristic": "Shank Length",
"value": "Medium Short"
},
{
"characteristic": "Leaf Angle",
"value": "Semi-Upright"
}
]
},
{
"label": "DISEASE RATINGS",
"items": [
{
"characteristic": "Gosss Wilt",
"value": "3.0"
},
{
"characteristic": "Northern Leaf Blight",
"value": "1.5"
},
{
"characteristic": "Anthracnose Stalk Rot",
"value": "ASR"
},
{
"characteristic": "Eye Spot",
"value": "1.0"
},
{
"characteristic": "Gray Leaf Spot",
"value": "2.0"
}
]
}
],
"_scale_direction": "numeric ratings ~1-9 where LOWER = BETTER (1 = best / most tolerant / most resistant); confirmed by cross-referencing Product Overview prose vs values (top-rated stalks/roots cluster 1.0-1.5, weak traits 3.0-3.5, none approach 9). Categorical values pass through verbatim (SCN source 'PI 88788', Phytophthora 'Rps 1k', Anthracnose 'ASR', 'Medium Tall', 'Flex'). NA/blank = not rated.",
"regional_recommendations": [
{
"product_list_name": "Latham dealer network (Upper Midwest — IA/MN/WI/IL/ND/SD/NE)",
"agronomist": null,
"agronomist_email": null,
"variant_id": null
}
],
"image_url": null,
"source_urls": [
"https://www.lathamseeds.com/products/lh-5159-ss-rib/"
],
"sitemap_last_modified": null,
"fetched_at": "2026-06-05T01:47:03.015178+00:00",
"scraper_version": "0.1.0"
}