RULER - 64K
General QA · 2024-04-09
RULER average accuracy over its 13 synthetic retrieval, multi-hop tracing, aggregation and question-answering tasks generated at a 64K-token input length. The number of samples per task (RULER's default or a smaller count such as 100) is a run setting recorded in notes; it is a component of the RULER family, whose primary is the 128K length. Higher is better.