Temporal Reasoning
Date-aware questions on Canadian statutes and SCC decisions across 11 question types (assent/in-force/amendment years, decision dates, before/after ordering). The 23 legacy administrative-law standard-of-review era items were retired on 2026-09-11 after the 2026-09-08 audit.
218 records|5 models evaluated|Best: 91.7%|Worst: 71.1%
Model Performance (avg 85.9%)
1
Claude Fable 5
218 records · 200 correct
91.7%
2
GPT-5.6 Sol
218 records · 198 correct
90.8%
3
Gemini 3.1 Pro
218 records · 193 correct
88.5%
4
Grok 4.5
218 records · 190 correct
87.2%
5
Cohere Command A+
218 records · 155 correct
71.1%†
† the model's shared thinking and answer token budget ran out before it wrote any answer.These answers stay in the denominator and are scored 0; the count is disclosed per cell. Empty-output policy: an answer that came back empty is never removed from its cell; it counts as not correct against the frozen record count, and the number of such answers and their cause are published with the cell.
- Cohere Command A+: † 1 answer hit the token budget before any answer token; scored 0