A Bigger Context Window Doesn't Mean Better Quality
When a company says their model has 1 million tokens of context, everyone assumes bigger is better. I thought the same thing. But after running LLMs in production for a while, I found out it's not tha
