Glossary
Context window
The maximum amount of text, in tokens, a model can take in and produce in a single request.
A context window is the total number of tokens a language model can handle in one request, counting your instructions, any documents you include, the conversation so far and the answer it writes. It is the model's working memory for that request, not permanent memory.
Context windows have grown a great deal, but a bigger window does not mean every part of it is used equally well. Models can miss details buried in the middle of very long inputs, and long inputs cost more and respond more slowly.
When your content does not fit, or is mostly irrelevant, teams retrieve only the useful passages with RAG or summarize earlier turns. Context sizes per model are listed on the LLM pricing page.
Start in 60 seconds
Put this to work on your project.
Get an AI-assisted, architect-reviewed scope, cost range, and timeline. Free, no login.