justin
eaa7e0789b
User flagged that Channel is expanding into their area — re-walked the cropscience.bayer.us sitemap and found 8 additional brand×crop paths beyond the original DEKALB/Asgrow/WestBred triple. Patches the scraper to walk all of them; total Bayer varieties roughly doubles from 475 to 931 and the corpus picks up first-ever coverage in sorghum (36), cotton (30), canola (6), and silage as a distinct crop (was conflated with corn before). Net new varieties: 456 Channel corn=181 soy=67 silage=54 sorghum=18 (320) DEKALB silage=82 sorghum=18 canola=6 (106) Deltapine cotton=30 (30) scrape/sources/bayer_seeds.py - Replace `BRANDS` (brand → 1 path) and `CROP_SUFFIX` (brand → 1 suffix) with a flatter `BRAND_PATHS` list of (brand, url_path, crop, is_primary_for_brand) entries. Channel and DEKALB are now multi-crop brands; the same scraper walks every brand×crop pair. - source_key derivation: for a brand's PRIMARY crop, strip the trailing `-<crop>` suffix (matches the existing deployed source keys for DEKALB corn / Asgrow soy / WestBred wheat). For SECONDARY crops, KEEP the suffix so DEKALB-the-same-SKU sold as both grain corn and silage gets two distinct source_keys (collision-safe and unambiguous for `lookup_variety`). - New `--crop` CLI filter for incremental backfills. - Log line shows brand + crop alongside source_key for visibility. rag/chunk.py - Channel + Deltapine pages use slightly different characteristics group labels (DISEASE not DISEASE RATINGS, AGRONOMIC CHARACTERISTICS not GROWTH/HARVEST, plus MATURITY / ADAPTATION / HERBICIDES / OTHER). Fold them into the DISEASE / AGRONOMIC / MANAGEMENT label sets so the chunker buckets them correctly into the standard sections. Smoke-tested cross-brand × cross-crop queries against the rebuilt index (5,529 chunks total) — all 6 sample queries surface the right brand+crop at top-3: Channel corn 110 RM → 210-25TRE BRAND Channel soy 2.5 MG IA → 2622RXF BRAND Deltapine cotton XF → DP 1820 B3XF BRAND Sorghum dryland Kansas → 6B95 BRAND (Channel) Silage corn WI dairy → DKC64-44RIB BRAND BLEND (silage variant) Canola Northern Plains → DK401TL BRAND Watchtower will pull the new image on the next push; deploy is unchanged otherwise. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
86 lines
2.5 KiB
JSON
86 lines
2.5 KiB
JSON
{
|
|
"source": "bayer_seeds",
|
|
"source_key": "dekalb-dk400tl-canola",
|
|
"vendor": "Bayer",
|
|
"brand": "DEKALB",
|
|
"product_name": "DK400TL BRAND",
|
|
"product_id": "CANOLA_DK400TL BRAND_DEKALB_US",
|
|
"hybrid_prefix": "DK400TL",
|
|
"hybrid_suffix": "BRAND",
|
|
"crop": "canola",
|
|
"release_year": 2024,
|
|
"relative_maturity": null,
|
|
"maturity_group": null,
|
|
"wheat_class": null,
|
|
"trait_stack": [
|
|
"TF/LL"
|
|
],
|
|
"trait_descriptions": [
|
|
"TruFlex and Liberty Link"
|
|
],
|
|
"positioning_statement": "DK400TL has excellent pod integrity for straight cutting and strong resistance against blackleg and clubroot diseases. The combination of TruFlex® canola with Roundup Ready® Technology and Liberty Link® Technologies provide additional options for management of resistant weeds.",
|
|
"strengths": [
|
|
"Excellent pod integrity for straight cutting combined with strong resistance to blackleg and clubroot.",
|
|
"The TruFlex® and Liberty Link® traits provide growers the option of sequentially applying Roundup® and Liberty® branded herbicides to optimize weed management"
|
|
],
|
|
"characteristics_groups": [
|
|
{
|
|
"label": "MATURITY",
|
|
"type": "maturity",
|
|
"items": [
|
|
{
|
|
"characteristic": "RELATIVE MATURITY",
|
|
"value": "Mid-Full"
|
|
}
|
|
]
|
|
},
|
|
{
|
|
"label": "OTHER",
|
|
"type": "other",
|
|
"items": [
|
|
{
|
|
"characteristic": "SEED TRAIT",
|
|
"value": "TruFlex®,LibertyLink®"
|
|
},
|
|
{
|
|
"characteristic": "ADAPTABILITY FOR DIRECT HARVEST",
|
|
"value": "Straight Cut Plus"
|
|
},
|
|
{
|
|
"characteristic": "BLACKLEG RATING",
|
|
"value": "Res-E2"
|
|
},
|
|
{
|
|
"characteristic": "NEW",
|
|
"value": "NO"
|
|
},
|
|
{
|
|
"characteristic": "PLANT HEIGHT",
|
|
"value": "S-M"
|
|
},
|
|
{
|
|
"characteristic": "LODGING RATING",
|
|
"value": "2"
|
|
},
|
|
{
|
|
"characteristic": "CLUBROOT RESISTANCE",
|
|
"value": "Res"
|
|
},
|
|
{
|
|
"characteristic": "VARIETY CODE",
|
|
"value": "A1111551"
|
|
}
|
|
]
|
|
}
|
|
],
|
|
"_scale_direction": "1-9 (9 = best)",
|
|
"regional_recommendations": [],
|
|
"image_url": "https://cs-assets.bayer.com/is/image/bayer/CANOLA_TRUFLEX_RR_LL_A",
|
|
"source_urls": [
|
|
"https://www.cropscience.bayer.us/canola/dekalb/dekalb-dk400tl-canola"
|
|
],
|
|
"sitemap_last_modified": "2026-05-12T14:40:59.087Z",
|
|
"fetched_at": "2026-05-26T15:39:28.202136+00:00",
|
|
"scraper_version": "0.1.0"
|
|
}
|