RULER - 1M
General QA · 2024-04-09
RULER average accuracy over its 13 synthetic long-context tasks generated at a 1M-token context length. The number of samples per task (RULER's default or a smaller count such as 100) is a run setting recorded in notes. Higher is better.