justin
eaa7e0789b
User flagged that Channel is expanding into their area — re-walked the cropscience.bayer.us sitemap and found 8 additional brand×crop paths beyond the original DEKALB/Asgrow/WestBred triple. Patches the scraper to walk all of them; total Bayer varieties roughly doubles from 475 to 931 and the corpus picks up first-ever coverage in sorghum (36), cotton (30), canola (6), and silage as a distinct crop (was conflated with corn before). Net new varieties: 456 Channel corn=181 soy=67 silage=54 sorghum=18 (320) DEKALB silage=82 sorghum=18 canola=6 (106) Deltapine cotton=30 (30) scrape/sources/bayer_seeds.py - Replace `BRANDS` (brand → 1 path) and `CROP_SUFFIX` (brand → 1 suffix) with a flatter `BRAND_PATHS` list of (brand, url_path, crop, is_primary_for_brand) entries. Channel and DEKALB are now multi-crop brands; the same scraper walks every brand×crop pair. - source_key derivation: for a brand's PRIMARY crop, strip the trailing `-<crop>` suffix (matches the existing deployed source keys for DEKALB corn / Asgrow soy / WestBred wheat). For SECONDARY crops, KEEP the suffix so DEKALB-the-same-SKU sold as both grain corn and silage gets two distinct source_keys (collision-safe and unambiguous for `lookup_variety`). - New `--crop` CLI filter for incremental backfills. - Log line shows brand + crop alongside source_key for visibility. rag/chunk.py - Channel + Deltapine pages use slightly different characteristics group labels (DISEASE not DISEASE RATINGS, AGRONOMIC CHARACTERISTICS not GROWTH/HARVEST, plus MATURITY / ADAPTATION / HERBICIDES / OTHER). Fold them into the DISEASE / AGRONOMIC / MANAGEMENT label sets so the chunker buckets them correctly into the standard sections. Smoke-tested cross-brand × cross-crop queries against the rebuilt index (5,529 chunks total) — all 6 sample queries surface the right brand+crop at top-3: Channel corn 110 RM → 210-25TRE BRAND Channel soy 2.5 MG IA → 2622RXF BRAND Deltapine cotton XF → DP 1820 B3XF BRAND Sorghum dryland Kansas → 6B95 BRAND (Channel) Silage corn WI dairy → DKC64-44RIB BRAND BLEND (silage variant) Canola Northern Plains → DK401TL BRAND Watchtower will pull the new image on the next push; deploy is unchanged otherwise. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
125 lines
2.9 KiB
JSON
125 lines
2.9 KiB
JSON
{
|
||
"source": "bayer_seeds",
|
||
"source_key": "deltapine-dp-2644nr-xf",
|
||
"vendor": "Bayer",
|
||
"brand": "DELTAPINE",
|
||
"product_name": "DP 2644NR XF BRAND",
|
||
"product_id": "COTTON_DP 2644NR XF BRAND_WEST TEXAS_DELTAPINE_US",
|
||
"hybrid_prefix": "DP 2644NR XF",
|
||
"hybrid_suffix": "BRAND",
|
||
"crop": "cotton",
|
||
"release_year": null,
|
||
"relative_maturity": null,
|
||
"maturity_group": null,
|
||
"wheat_class": null,
|
||
"trait_stack": [
|
||
"XF"
|
||
],
|
||
"trait_descriptions": [
|
||
"XtendFlex®"
|
||
],
|
||
"positioning_statement": "Widely adapted across yield environments in the Texas High Plains",
|
||
"strengths": [
|
||
"Resistant to bacterial blight and moderately tolerant to verticillium wilt",
|
||
"Resistant to Root Knot nematodes",
|
||
"Herbicide only trait platform"
|
||
],
|
||
"characteristics_groups": [
|
||
{
|
||
"label": "GROWTH",
|
||
"type": "growth",
|
||
"items": [
|
||
{
|
||
"characteristic": "RELATIVE MATURITY",
|
||
"value": "Mid-Full"
|
||
},
|
||
{
|
||
"characteristic": "# FRT NODES",
|
||
"value": "7.4"
|
||
},
|
||
{
|
||
"characteristic": "LEAF TYPE",
|
||
"value": "Semi Smooth"
|
||
},
|
||
{
|
||
"characteristic": "NFFB",
|
||
"value": "7.3"
|
||
},
|
||
{
|
||
"characteristic": "PLANT HEIGHT",
|
||
"value": "Med"
|
||
},
|
||
{
|
||
"characteristic": "SEED SIZE",
|
||
"value": "4800-5100"
|
||
},
|
||
{
|
||
"characteristic": "STORM RESISTANCE",
|
||
"value": "5.7"
|
||
}
|
||
]
|
||
},
|
||
{
|
||
"label": "FIBER QUALITY",
|
||
"type": "fiber quality",
|
||
"items": [
|
||
{
|
||
"characteristic": "LINT %",
|
||
"value": "42.1"
|
||
},
|
||
{
|
||
"characteristic": "MICRONAIRE",
|
||
"value": "4.6"
|
||
},
|
||
{
|
||
"characteristic": "STAPLE",
|
||
"value": "37"
|
||
},
|
||
{
|
||
"characteristic": "STRENGTH",
|
||
"value": "33"
|
||
},
|
||
{
|
||
"characteristic": "LENGTH UNIF. %",
|
||
"value": "82"
|
||
}
|
||
]
|
||
},
|
||
{
|
||
"label": "DISEASE",
|
||
"type": "disease",
|
||
"items": [
|
||
{
|
||
"characteristic": "VERTICILLIUM WILT",
|
||
"value": "Mod Tol"
|
||
},
|
||
{
|
||
"characteristic": "BACTERIAL BLIGHT",
|
||
"value": "Res"
|
||
},
|
||
{
|
||
"characteristic": "FUSARIUM",
|
||
"value": "Mod Res"
|
||
},
|
||
{
|
||
"characteristic": "ROOTKNOT NEMATODE",
|
||
"value": "Res"
|
||
},
|
||
{
|
||
"characteristic": "RENIFORM NEMATODE",
|
||
"value": "-"
|
||
}
|
||
]
|
||
}
|
||
],
|
||
"_scale_direction": "1-9 (9 = best)",
|
||
"regional_recommendations": [],
|
||
"image_url": null,
|
||
"source_urls": [
|
||
"https://www.cropscience.bayer.us/cotton/deltapine/deltapine-dp-2644nr-xf-cotton"
|
||
],
|
||
"sitemap_last_modified": "2026-05-12T14:40:56.225Z",
|
||
"fetched_at": "2026-05-26T15:49:05.965472+00:00",
|
||
"scraper_version": "0.1.0"
|
||
}
|