Announcement_5

Our paper “Understanding Data Temporality Impact on Large Language Models Pre-training” has been accepted at ICML 2026! We introduce KairosQA, a dataset for evaluating temporal knowledge in LLMs, along with Sequential Helium, a 6B model trained to better capture temporal dynamics. The project page, code, and resources are available here.