Tokenizing the haystack

PROTRAILBLAZER

Lost in the Middle · Context Recall Lab
CTX_TOKENS32,768
DEPTH50%
TRIALSN = 000000
RECALL
DISTRACT17
PENALTY0 pts
Context length32,768 tok
Needle position2%
17
Query specificity
Strategy
No mitigation applied. Recall follows the position curve.
Positional bias
U-shaped teaching curve active. Toggle off for an idealized position-blind control.
Needle Distractor Recall low→high
Simulated pattern from a conceptual curve, not measurements of any named model. Position effects vary with model, prompt, task, length, and eval setup. Newer models narrow the dip, and a middle miss does not mean the model cannot see middle tokens.