Add 4 independent seed brands: Latham, Stine, 1st Choice, Burrus (+623 varieties)
Four independent regional brands across IA/IN/IL (variety-identity sources,
each parsed into structured characteristics_groups so ratings embed):
- latham (264: 155 corn + 109 soy) — Latham Hi-Tech Seeds, Alexander IA.
WordPress REST enum (/wp-json/wp/v2/varieties) + /products/<slug>/ detail
HTML. Scale 1-9 LOWER=better (reversed, like NK/AgriPro).
- stine (217: 58 corn + 159 soy) — Stine Seed, Adel IA (largest US
independent). sitemap enum + /{crop}/traits/<slug>/<code>/ detail HTML.
Corn 1-9 (9=best); soy qualitative.
- first_choice (78: 52 corn + 22 soy + 4 wheat) — 1st Choice Seeds,
Rushville IN (employee-owned). Per-crop sitemap -> detail HTML. Scale
0-10 higher=better. ~40 older corn pages thin at source; wheat
identity-only.
- burrus (64: 38 corn + 26 soy) — Burrus Seed, Arenzville IL. Seedware
JSON API. Scale 1-10 (10=best). Brands Burrus/Power Plus/DONMARIO.
robots ai-train=no + named-bot blocks; operator opted in, scraper uses a
non-blacklisted UA + honors Crawl-delay 10.
All 623 validated through rag.chunk.chunks_from_variety (0 errors; 6
identity-only pages from source gaps). No chunk.py change needed (identity
sources auto-route to chunks_from_variety).
Docs:
- sources.json: 4 entries + Hoegemeyer added to _excluded_sources. The
Corteva ToU (shared across pioneer.com / hoegemeyer.com / therightseed.com
/ corteva.com + the Vylor spinoff) bans scrapers + competitive use, so the
whole Corteva family is one excluded ToU domain.
- docs_mcp/lessons.md: rating-scales updated with all 4 directions +
an explicit cross-vendor warning (Latham 1=best vs Stine/Burrus higher=best
— never compare raw numbers without _scale_direction).
- README + CLAUDE corpus inventory: now 2,268 variety + 6,787 trial records.
CI rebuilds the index from the committed corpus.
This commit is contained in:
@@ -10,18 +10,22 @@ vendors — **variety identity** (what each hybrid IS) plus **yield-trial data**
|
||||
|
||||
## What's in the corpus
|
||||
|
||||
**~8,400 indexed records** (one chunk each) across two complementary surfaces:
|
||||
**~9,050 indexed records** (one chunk each) across two complementary surfaces:
|
||||
|
||||
### Variety identity — 1,645 records
|
||||
### Variety identity — 2,268 records
|
||||
|
||||
| Source | Count | Vendor | Brand |
|
||||
|---|---|---|---|
|
||||
| `bayer_seeds` | 931 | Bayer | DEKALB / Channel (corn) / Asgrow (soy) / WestBred (wheat) / Deltapine |
|
||||
| `latham` | 264 | Latham Hi-Tech Seeds | Latham (corn / soy) — **independent family brand, Alexander IA** |
|
||||
| `stine` | 217 | Stine Seed Company | Stine (corn / soy) — **largest US independent, Adel IA** |
|
||||
| `lg_seeds` | 170 | AgReliant | LG Seeds (corn / soy / sorghum) |
|
||||
| `golden_harvest` | 139 | Syngenta | Golden Harvest (corn / soy) |
|
||||
| `nk` | 122 | Syngenta | NK (corn / soy) |
|
||||
| `proharvest` | 119 | ProHarvest Seeds | ProHarvest / Apex (corn / soy / wheat) — **independent Corn Belt brand** |
|
||||
| `agrigold` | 111 | AgReliant | AgriGold (corn / soy) |
|
||||
| `first_choice` | 78 | 1st Choice Seeds | 1st Choice (corn / soy / wheat) — **employee-owned independent, Rushville IN** |
|
||||
| `burrus` | 64 | Burrus Seed | Burrus / Power Plus / DONMARIO (corn / soy) — **independent family, Arenzville IL** |
|
||||
| `ebberts_seeds` | 29 | Ebbert's Seeds | Ebbert's (corn / soy / wheat) — independent E. Corn Belt breeder |
|
||||
| `agripro` | 24 | Syngenta | AgriPro (wheat — HRW / HRS / HWS / SWW) |
|
||||
|
||||
@@ -37,7 +41,7 @@ vendors — **variety identity** (what each hybrid IS) plus **yield-trial data**
|
||||
|
||||
### Not in the corpus (documented in `docs_mcp/lessons.md`)
|
||||
|
||||
- **Pioneer / Corteva** — ToS bans automation. Curated fallback lesson points the farmer at pioneer.com / a local dealer.
|
||||
- **Pioneer / Corteva (all brands)** — ToS bans automation. This now covers the whole Corteva family — Pioneer, Brevant, **Hoegemeyer** (the consolidation brand absorbing Seed Consultants / Dairyland / Nu-Tech / Terral), and the upcoming Vylor spinoff — all share the same corteva.com ToU. Curated fallback lesson points the farmer at a local dealer; legitimate Corteva-data paths are an official license (openinnovation@corteva.com) or university-extension trial data.
|
||||
- **NK yield-results** — fiddly ASMX/SOAP endpoint, needs a dedicated reverse-engineer session.
|
||||
- **Bayer per-variety trial data** — not publicly indexed (DEKALB / Asgrow trial data flows through Channel reps). Partially covered by the GH plot reports' cross-vendor results.
|
||||
|
||||
|
||||
Reference in New Issue
Block a user