justin
b98965a68a
Adds the **first non-Syngenta trial coverage** to the corpus:
| Source | Docs | Publisher | URL pattern |
|---|---|---|---|
| lg_plot_reports | 1,304 | LG Seeds (AgReliant) | lgseeds.com/performance/{crop} JSON XHR |
| agrigold_plot_reports | 1,003 | AgriGold (AgReliant) | agrigold.com/{crop}/performance/{crop}-yield-results |
Total trial coverage now: gh_plot_reports (4,299) + agripro_trials (14) +
lg_plot_reports (1,304) + agrigold_plot_reports (1,003) = 6,620 trial docs.
**Both scrapers follow the gh_plot_reports template** — same RateLimitedSession
primitive, same TrialResult/PlotReport dataclass shape, same data_type="trial"
sidecar convention. The trial chunker (`rag/chunk.py:_render_trial_chunk`) is
extended to recognize both new sources; they share `_render_gh_plot_chunk`
since their sidecars are structurally identical (just different brand label).
**LG specifics:**
- POST `/performance/{crop}/GetPlots/` returns sparse listing (id, year, lat/lng)
- GET `/performance/{crop}/GetPlotData/?PlotId=X&IsSilage=Y` returns full detail
with state, cooperator, planting/harvest dates, and **top-5 hybrids** (LG +
competitors). Top-5 is what LG publishes publicly; not the full ranking.
- 4 crops: corn (963), soybeans (287), sorghum (10), silage (50) — first
alfalfa absent because LG doesn't run alfalfa plots; that's variety-only data.
- 301 gotcha: www.lgseeds.com redirects to lgseeds.com which drops POST body,
so the scraper hits the apex host directly.
**AgriGold specifics:**
- Listing: GET `/{crop}/performance/{crop}-yield-results?harvestYear={year}`
(server-rendered HTML, ~1MB; 408 corn plots in 2025 alone)
- Detail: GET `/{crop_url}/performance/{slug}/{plot_id}` returns the **full
ranking** (not just top-5) plus rich plot management metadata: tillage,
previous crop, fungicide, herbicide, insecticide, irrigation, soil type,
row width, population. Most metadata-rich of the three trial sources.
- Soybean URL slug is singular: `/soybeans/performance/soybean-yield-results/`
- Columns: Rank | Brand | Product | Trait | Ck | H20 (moisture) | Test Wt. |
Yield | Adj Yield (check-adjusted)
- 2 crops: corn (849) + soybeans (157)
**Indexer needs no changes** — `rag/index.py` auto-discovers any directory
under corpus/ and routes by data_type. Both new sources flow into the
existing trial collection and surface via `search_trials`.
Years scraped: 2024+2025 (matching gh_plot_reports baseline). 2023 is
available via `--include-2023` on either scraper for future backfill.
1.4 KiB
1.4 KiB
Soybean yield trial — Boyle, MS, 2024
- Source: AgriGold plot report (cross-vendor head-to-head)
- Vendor: AgReliant Genetics / AgriGold
- Crop: Soybean
- State: MS
- County: Bolivar
- City: Boyle
- Year: 2024
- Plot ID: 142745
- Cooperator: Bern Prewitt
- Plot average: 85.18 BU/Ac
- Planted: 2024-05-01
- Harvested: 2024-09-20
- Population: 110,000 seeds/acre
- Row width: 30.0"
- # Rows: 16
- Soil type: Silty Clay Loam
- Tillage: Conventional
- Previous crop: Corn
- Irrigation: Yes
- URL: https://www.agrigold.com/soybeans/performance/soybean-yield-results/142745
Results (by rank)
| Rank | Brand | Product | Trait | Ck | H20 | Test Wt. | Yield | Adj Yield |
|---|---|---|---|---|---|---|---|---|
| 6 | AgriGold | G4094XF | XTENDFlex | - | 9.2 | - | 83.5 | 83.5 |
| 3 | AgriGold | G4184XF | XTENDFlex | - | 9.2 | - | 86.6 | 86.6 |
| 2 | AgriGold | G4430XF | XTENDFlex | - | 8.7 | - | 87.7 | 87.7 |
| 8 | AgriGold | G4615XF | XTENDFlex | - | 9.2 | - | 80.1 | 80.1 |
| 5 | AgriGold | G4650XF | XTENDFlex | - | 9.6 | - | 84.2 | 84.2 |
| 7 | AgriGold | G4850XF | XTENDFlex | - | 10.5 | - | 82.3 | 82.3 |
| 1 | AgriGold | G4910XF | XTENDFlex | - | 9.4 | - | 92.6 | 92.6 |
| 4 | AgriGold | G5104XF | XTENDFlex | - | 12.0 | - | 84.4 | 84.4 |
Top 5 by Yield: G4910XF (AgriGold) 92.6, G4430XF (AgriGold) 87.7, G4184XF (AgriGold) 86.6, G5104XF (AgriGold) 84.4, G4650XF (AgriGold) 84.2.