Add university-extension variety trials: Illinois VT + Iowa ICPT + Ohio OCPT (+123 trial docs)

Independent third-party performance data — land-grant programs that test every
entered brand side-by-side with replication + LSD stats. This is the legitimate
way to get Pioneer / DEKALB / Brevant / Channel performance the corpus can't
scrape directly (data_type=trial, results[] shape; falls through the trial
chunker).

- illinois_vt_trials (30 docs, 1,392 rows) — U of Illinois VT. Per-region XLSX
  (openpyxl), corn + soy + WHEAT, 2024+2025. Rich per-site agronomic metadata;
  corn-following-corn vs -soybean kept distinct.
- iowa_icpt_trials (24 docs, 674 rows) — Iowa State ICPT. ASP.NET GridView
  (viewstate postback for year/district), corn + soy by district x season.
- ohio_ocpt_trials (69 docs, 4,647 rows) — OSU/CFAES OCPT. Report PDF
  (pdfplumber; per-site column groups split by header Yield-token count +
  x-coord footnote bucketing), corn + soy per site, 2024+2025.

91 distinct seed brands across the three; majors confirmed present in the
independent rankings: DEKALB 395, Golden Harvest 249, Channel 241, NK 212,
Xitavo 135, LG 103, Pioneer 88, Asgrow 59. (A brand only appears where it
ENTERED a given program — e.g. Brevant not in Iowa, DEKALB/Channel not in
Illinois — true negatives, not parse gaps.)

- rag/chunk.py: gated `include_region` on _render_gh_plot_chunk; the 3 university
  sources route through it so the region/district is in the embedded chunk +
  labeled "variety trial (cross-vendor, independent third-party)". Existing plot
  sources (gh/lg/agrigold/proharvest) unchanged.
- requirements.txt: openpyxl (Illinois XLSX; scrape-time only).
- sources.json + README/CLAUDE/lessons: registered + attributed; lessons
  trial-data + Pioneer entries updated (Pioneer/DEKALB performance now available
  indirectly via these trials).

Validation: all 123 chunk via rag.chunk.chunks_from_trial (0 errors), 0
out-of-range yields, 0 dup keys. Public land-grant data; attribution recorded in
each tos_note. CI rebuilds the index from the committed corpus.
This commit is contained in:
2026-06-10 08:35:50 -04:00
parent 0bac06b7b6
commit 54094a0d43
255 changed files with 105410 additions and 13 deletions
@@ -0,0 +1,559 @@
{
"source": "iowa_icpt_trials",
"source_key": "icpt-soybeans-2025-south-full",
"data_type": "trial",
"vendor": "Iowa State University",
"brand_aggregator": "Iowa Crop Performance Tests publishes",
"brand": "Iowa Crop Performance Tests",
"crop": "soybeans",
"state": "IA",
"state_abbrev": "ia",
"year": 2025,
"region": "District South",
"district": "South",
"season": "Full Season",
"cooperator_sites": [
"Atlantic",
"Corning",
"Chariton",
"Batavia",
"Crawfordsville"
],
"experiment_mean_yield": 66.2,
"results": [
{
"rank": 1,
"brand": "Dyna-Gro",
"product": "S38EN75",
"traits": "E3",
"metrics": {
"MG": 3.8,
"Yield": 70.3,
"WestYield": 70.3,
"EastYield": 67.7,
"Atlantic": 75,
"Corning": 74.2,
"Chariton": 61.7,
"Batavia": 64.1,
"Crawfordsville": 77.4
}
},
{
"rank": 2,
"brand": "Dyna-Gro",
"product": "S35ES56",
"traits": "E3S",
"metrics": {
"MG": 3.5,
"Yield": 69.5,
"WestYield": 71.1,
"EastYield": 64.7,
"Atlantic": 79.7,
"Corning": 73.9,
"Chariton": 59.9,
"Batavia": 64.7,
"Crawfordsville": 69.4
}
},
{
"rank": 3,
"brand": "Xitavo",
"product": "XO 3555E",
"traits": "E3",
"metrics": {
"MG": 3.5,
"Yield": 69.4,
"WestYield": 71.4,
"EastYield": 65.3,
"Atlantic": 77.6,
"Corning": 75.7,
"Chariton": 60.8,
"Batavia": 64.7,
"Crawfordsville": 70.4
}
},
{
"rank": 4,
"brand": "Nutech/G2 Genetics",
"product": "36N06E",
"traits": "E3",
"metrics": {
"MG": 3.6,
"Yield": 68.6,
"WestYield": 70.2,
"EastYield": 64.8,
"Atlantic": 74.3,
"Corning": 74.2,
"Chariton": 62.2,
"Batavia": 63.7,
"Crawfordsville": 68.5
}
},
{
"rank": 5,
"brand": "ISU",
"product": "IAS34C1",
"traits": "Conv",
"metrics": {
"MG": 3.4,
"Yield": 68.4,
"WestYield": 68.7,
"EastYield": 65.1,
"Atlantic": 74.8,
"Corning": 72.6,
"Chariton": 58.8,
"Batavia": 63.7,
"Crawfordsville": 72.8
}
},
{
"rank": 6,
"brand": "Xitavo",
"product": "XO 3456E",
"traits": "E3",
"metrics": {
"MG": 3.4,
"Yield": 68.4,
"WestYield": 69.6,
"EastYield": 65.2,
"Atlantic": 75,
"Corning": 72.3,
"Chariton": 61.6,
"Batavia": 60.1,
"Crawfordsville": 74
}
},
{
"rank": 7,
"brand": "P3 Genetics",
"product": "2434E",
"traits": "E3",
"metrics": {
"MG": 3.4,
"Yield": 68.3,
"WestYield": 69.5,
"EastYield": 64.4,
"Atlantic": 74.2,
"Corning": 73.2,
"Chariton": 61.2,
"Batavia": 63.5,
"Crawfordsville": 68.6
}
},
{
"rank": 8,
"brand": "Asgrow",
"product": "AG36XF4",
"traits": "RR2XF",
"metrics": {
"MG": 3.6,
"Yield": 67.8,
"WestYield": 68.2,
"EastYield": 63.6,
"Atlantic": 73.4,
"Corning": 75.3,
"Chariton": 55.9,
"Batavia": 61.3,
"Crawfordsville": 73.6
}
},
{
"rank": 9,
"brand": "Renk",
"product": "RS353NXF",
"traits": "RR2XF",
"metrics": {
"MG": 3.5,
"Yield": 67.7,
"WestYield": 66.5,
"EastYield": 66.9,
"Atlantic": 71.7,
"Corning": 68.8,
"Chariton": 58.9,
"Batavia": 72.2,
"Crawfordsville": 69.6
}
},
{
"rank": 10,
"brand": "Renk",
"product": "G3890E",
"traits": "E3",
"metrics": {
"MG": 3.8,
"Yield": 67.6,
"WestYield": 68.6,
"EastYield": 64.6,
"Atlantic": 75.6,
"Corning": 69.4,
"Chariton": 60.9,
"Batavia": 61.8,
"Crawfordsville": 71
}
},
{
"rank": 11,
"brand": "P3 Genetics",
"product": "2438E",
"traits": "E3",
"metrics": {
"MG": 3.8,
"Yield": 67.6,
"WestYield": 68.4,
"EastYield": 63.6,
"Atlantic": 74.7,
"Corning": 73.9,
"Chariton": 56.6,
"Batavia": 60.1,
"Crawfordsville": 74
}
},
{
"rank": 12,
"brand": "Dyna-Gro",
"product": "S33ES76",
"traits": "E3S",
"metrics": {
"MG": 3.3,
"Yield": 67.6,
"WestYield": 68.8,
"EastYield": 63.1,
"Atlantic": 76.9,
"Corning": 71.6,
"Chariton": 58,
"Batavia": 59.4,
"Crawfordsville": 71.7
}
},
{
"rank": 13,
"brand": "Renk",
"product": "G3380E",
"traits": "E3",
"metrics": {
"MG": 3.3,
"Yield": 67.5,
"WestYield": 68,
"EastYield": 65.4,
"Atlantic": 75.2,
"Corning": 66.2,
"Chariton": 62.6,
"Batavia": 62.1,
"Crawfordsville": 71.6
}
},
{
"rank": 14,
"brand": "Cornelius",
"product": "CB33XF26",
"traits": "RR2XF",
"metrics": {
"MG": 3.3,
"Yield": 67,
"WestYield": 67.3,
"EastYield": 64.9,
"Atlantic": 71.6,
"Corning": 69,
"Chariton": 61.3,
"Batavia": 64.4,
"Crawfordsville": 69
}
},
{
"rank": 15,
"brand": "Xitavo",
"product": "XO 3855E",
"traits": "E3",
"metrics": {
"MG": 3.8,
"Yield": 66.9,
"WestYield": 67.4,
"EastYield": 63.4,
"Atlantic": 74.1,
"Corning": 71.1,
"Chariton": 57.1,
"Batavia": 64,
"Crawfordsville": 69
}
},
{
"rank": 16,
"brand": "P3 Genetics",
"product": "2337E",
"traits": "E3",
"metrics": {
"MG": 3.7,
"Yield": 66.8,
"WestYield": 66.6,
"EastYield": 64.1,
"Atlantic": 71.4,
"Corning": 69.3,
"Chariton": 59.2,
"Batavia": 61.7,
"Crawfordsville": 71.5
}
},
{
"rank": 17,
"brand": "Golden Harvest",
"product": "GH3836E3S",
"traits": "E3S",
"metrics": {
"MG": 3.8,
"Yield": 66.4,
"WestYield": 68.1,
"EastYield": 62.8,
"Atlantic": 71,
"Corning": 72.5,
"Chariton": 60.7,
"Batavia": 59.4,
"Crawfordsville": 68.3
}
},
{
"rank": 18,
"brand": "Cornelius",
"product": "CB36XF60",
"traits": "RR2XF",
"metrics": {
"MG": 3.6,
"Yield": 65.9,
"WestYield": 66.1,
"EastYield": 62.2,
"Atlantic": 69.5,
"Corning": 73.3,
"Chariton": 55.4,
"Batavia": 61.9,
"Crawfordsville": 69.3
}
},
{
"rank": 19,
"brand": "Viking/Blue River",
"product": "3418N",
"traits": "Conv",
"metrics": {
"MG": 3.4,
"Yield": 65.8,
"WestYield": 67.7,
"EastYield": 62.7,
"Atlantic": 69.2,
"Corning": 71.4,
"Chariton": 62.5,
"Batavia": 53.1,
"Crawfordsville": 72.5
}
},
{
"rank": 20,
"brand": "Xitavo",
"product": "XO 3375E",
"traits": "E3",
"metrics": {
"MG": 3.3,
"Yield": 65.7,
"WestYield": 65.7,
"EastYield": 62,
"Atlantic": 72.1,
"Corning": 69.4,
"Chariton": 55.8,
"Batavia": 59.5,
"Crawfordsville": 70.8
}
},
{
"rank": 21,
"brand": "NK Seeds",
"product": "NK33-Y7E3S",
"traits": "E3S",
"metrics": {
"MG": 3.3,
"Yield": 65.1,
"WestYield": 67.2,
"EastYield": 60.3,
"Atlantic": 75.5,
"Corning": 69.9,
"Chariton": 56.4,
"Batavia": 58.7,
"Crawfordsville": 65.9
}
},
{
"rank": 22,
"brand": "Renk",
"product": "RS395NXF",
"traits": "RR2XF",
"metrics": {
"MG": 3.9,
"Yield": 64.6,
"WestYield": 64.6,
"EastYield": 62.9,
"Atlantic": 70,
"Corning": 65,
"Chariton": 58.9,
"Batavia": 63.6,
"Crawfordsville": 66.4
}
},
{
"rank": 23,
"brand": "Nutech/G2 Genetics",
"product": "35N05E",
"traits": "E3",
"metrics": {
"MG": 3.5,
"Yield": 64.5,
"WestYield": 66.3,
"EastYield": 58.9,
"Atlantic": 75.4,
"Corning": 69.7,
"Chariton": 54,
"Batavia": 54.1,
"Crawfordsville": 68.6
}
},
{
"rank": 24,
"brand": "Golden Harvest",
"product": "GH3774E3",
"traits": "E3",
"metrics": {
"MG": 3.7,
"Yield": 64.4,
"WestYield": 65.2,
"EastYield": 61,
"Atlantic": 68.9,
"Corning": 70.5,
"Chariton": 56.2,
"Batavia": 64.9,
"Crawfordsville": 61.9
}
},
{
"rank": 25,
"brand": "Asgrow",
"product": "AG35XF5",
"traits": "RR2XF",
"metrics": {
"MG": 3.5,
"Yield": 64.4,
"WestYield": 62.4,
"EastYield": 61.8,
"Atlantic": 68.2,
"Corning": 68,
"Chariton": 51.1,
"Batavia": 63.4,
"Crawfordsville": 70.8
}
},
{
"rank": 26,
"brand": "Confluence Genetics",
"product": "BH35A233",
"traits": "Conv",
"metrics": {
"MG": 3.5,
"Yield": 64.3,
"WestYield": 64.2,
"EastYield": 60.6,
"Atlantic": 68.7,
"Corning": 70.4,
"Chariton": 53.4,
"Batavia": 59.7,
"Crawfordsville": 68.8
}
},
{
"rank": 27,
"brand": "Pioneer",
"product": "P35T15E",
"traits": "E3",
"metrics": {
"MG": 3.5,
"Yield": 64.1,
"WestYield": 64.4,
"EastYield": 60.2,
"Atlantic": 71.2,
"Corning": 69.3,
"Chariton": 52.6,
"Batavia": 60.2,
"Crawfordsville": 67.9
}
},
{
"rank": 28,
"brand": "Renk",
"product": "G3580ES",
"traits": "E3S",
"metrics": {
"MG": 3.5,
"Yield": 64,
"WestYield": 65.9,
"EastYield": 59.7,
"Atlantic": 73.1,
"Corning": 68.1,
"Chariton": 56.4,
"Batavia": 56.4,
"Crawfordsville": 66.4
}
},
{
"rank": 29,
"brand": "Golden Harvest",
"product": "GH3416E3S",
"traits": "E3S",
"metrics": {
"MG": 3.4,
"Yield": 61.5,
"WestYield": 65.6,
"EastYield": 54.3,
"Atlantic": 74.9,
"Corning": 70.6,
"Chariton": 51.4,
"Batavia": 47.7,
"Crawfordsville": 63.8
}
},
{
"rank": 30,
"brand": "Confluence Genetics",
"product": "N35D950S",
"traits": "Conv",
"metrics": {
"MG": 3.5,
"Yield": 61.2,
"WestYield": 61.5,
"EastYield": 58.6,
"Atlantic": 65.3,
"Corning": 64.1,
"Chariton": 55.2,
"Batavia": 59.7,
"Crawfordsville": 60.9
}
},
{
"rank": 31,
"brand": "Pioneer",
"product": "P37A18E",
"traits": "E3",
"metrics": {
"MG": 3.7,
"Yield": 60.6,
"WestYield": 63.5,
"EastYield": 54.2,
"Atlantic": 71.6,
"Corning": 68.6,
"Chariton": 50.3,
"Batavia": 51.8,
"Crawfordsville": 60.4
}
}
],
"n_results": 31,
"source_urls": [
"https://www.croptesting.iastate.edu/Soybean/SoybeanDistrict2.aspx"
],
"tos_note": "Footer 'Copyright (c) ...ISU...All rights reserved' (no automation clause, no robots.txt); public ICPT data; low request rate; attribute Iowa Crop Performance Tests / ISU.",
"fetched_at": "2026-06-10T12:13:29.017868+00:00",
"scraper_version": "0.1.0"
}