Long-context models overemphasize book endings:One interesting observation is that Claude-3-Opus and GPT-4-Turbo, which both have chunk sizes \(\geq\) 100K, tend to place more emphasis on the endings of the books to the detriment of the beginning.