prompt-pool-llm-time-series-forecasting-where-top-k-semantic-anchors CLM-0471In prompt-pool LLM time series forecasting where top-K semantic anchors are retrieved by cosine similarity, the harmful redundancy is concentration of anchor usage accumulated across training batches, not redundancy among the anchors picked for a single forecast: diversifying within a retrieval (MMR) never beat relevance-only selection on four dataset-horizon cells, while an EMA usage-tracking coverage penalty in the training loss lowered MSE on most of six long-term benchmarks.
Capability: Predicting future events
Observed on
GPT-2 backbone with a learned semantic anchor pool derived from pretrained word embeddings, decomposed (trend/seasonal/residual) patch inputs; gains absent on Electricity, M4-Month.
Sources
- Validated by: MSE/MAE on six multivariate long-term benchmarks at four horizons plus M4, against similarity-based LLM forecasters and a paired lambda_cov=0 ablation with identical code, data and seeds; best or second-best MSE in 18 of 24 cells, and an eight-seed paired test significant on ETTh1-96 (7/8 seeds improved, p=0.039).. Measured on six long-term benchmarks plus M4, three seeds for main table and eight seeds for the primary paired cell; [truncated]
Disagreeing is the most useful thing you can do here. Nothing on this page waits for a reviewer: the counts above move when evidence lands, and every source stays attached with who brought it.
Related claims
- Across LLM-based forecasting systems, reported accuracy gains frequently cannot be attributed to the language model's temporal reasoning, because evaluation windows predate training cutoffs, component ablations show the LLM sometimes adds nothing over the statistical or retrieval parts, and results shift under small input perturbations.Predicting future events · reviewed by AI
- When a frozen pretrained time-series forecaster leaves structured residual error, having an LLM propose named semantic features of that residual (e.g. renewable generation over total load) and admitting them through a validation gate into a small post-hoc corrector reduces test error more than statistical feature banks or compositional search over the raw channels, but the gain scales with how much raw error the backbone leaves and vanishes once the backbone already fits the series.Predicting future events · reviewed by AI
- When a small (1.7B) LLM is fine-tuned to act as an ensemble router that assigns per-sample weights across candidate time-series forecasters, chain-of-thought supervision built by rule-templating known oracle weights against extracted temporal features matches or beats CoT generated by a frontier API model, and removing the CoT step costs far more on unseen candidate model pools than on in-distribution ones.Predicting future events · reviewed by AI
- For LLM-based forecasting systems, reported benchmark gains often cannot be attributed to temporal reasoning, because test periods predate the training cutoff, ablations show the LLM component sometimes adds nothing over the statistical or retrieval parts, and accuracy shifts under small input perturbations.Predicting future events · reviewed by AI
- When a search agent is asked to forecast a future distribution rather than report the current state over the same cumulative literature archive, the forward-looking target changes what it retrieves — it allocates a smaller share of retrieved documents to the most recent window, which is the more predictive evidence — so carrying the agent's own state estimate forward beats its explicit forecast.Predicting future events · reviewed by AI
Notes
Drafted from the paper by a model and filed unreviewed. Visible here so it can be read, not because anyone has vouched for it: it does not move any technique's standing and does not count toward the internal scorecard. Drafted confidence: low. Falsifier as drafted: An MMR or DPP-style within-retrieval diversification that matches or exceeds the cross-batch coverage penalty on the same benchmarks and seeds, or a paired test showing the coverage term gives no reliable MSE gain across datasets.