What Is a Context Window? Why AI Forgets — Explained with One Desk Metaphor


You explain your project carefully, the AI responds brilliantly — and twenty messages later it has forgotten the very constraints you started with. That frustrating amnesia has a name: the context window. Understand it once and most of AI's strange memory behavior becomes predictable — and avoidable. No technical background needed; one desk metaphor does most of the work.

The context window is a desk

A context window is the maximum amount of text an AI can consider at once. Picture a desk: everything the model uses to answer you — the conversation so far, pasted documents, your instructions — must physically fit on it. Papers that slide off the desk do not exist for the model. The AI is not "forgetting" the way people do; it simply cannot read what is no longer on the desk.

Why the beginning disappears first

When a long conversation overflows the desk, most services push the oldest papers off first. That is why the setup you gave in message one — the role, the tone, the constraints — is the first thing to vanish in a marathon session. A conversation that suddenly stops making sense is usually a full desk, not a worse model. The fix is unglamorous but reliable: restate the important premises periodically.

Desks are measured in tokens

Window size is counted in tokens — fragments of words, not characters or pages. A rough rule for English is that a token is about three-quarters of a word. Modern models advertise windows from tens of thousands to over a million tokens, and free tiers often get smaller windows than paid ones. The exact limit varies by service and changes often, so check the provider's current documentation rather than trusting any article's numbers — including this one.

A bigger desk is not automatically a smarter reader

Research on long-context models has repeatedly found a "lost in the middle" effect: information buried in the middle of a huge input is recalled less reliably than information at the start or end. Practical consequence: put your most important instruction at the top or bottom of the prompt, never in the middle of page forty. The same principle drives the summarization technique in our guide to summarizing long documents.

Three habits that work with the desk, not against it

  • Summarize and restart: in long sessions, ask "summarize what we've agreed so far," then paste that summary into a fresh conversation and continue.
  • Repeat what matters: restate key constraints at natural checkpoints instead of trusting message one to survive.
  • Paste less, not more: the relevant chapter beats the whole document — for accuracy and speed.

Deciding what goes on the desk, in what order, is itself becoming a named skill — that is exactly what context engineering is about.

Frequently asked questions

Why does my AI remember things from last week, then?

Some services add a separate memory feature that stores selected facts outside the conversation. That is a different mechanism from the context window, and you can usually view and delete what it holds in settings.

How is this different from RAG?

RAG is a librarian: instead of enlarging the desk, it fetches the relevant documents and places them on the desk right when they are needed. Window size limits how much fits; RAG improves what gets chosen.

Can I just paste an entire book?

If it fits the window, yes — but the lost-in-the-middle effect still applies. For anything where accuracy matters, work chapter by chapter and verify claims with our fact-checking routine.

Related on AI Learning Lab: Context Engineering · How to Summarize Long Documents with AI · What Is a Small Language Model?

Comments

Post a Comment

Popular posts from this blog

Free vs Paid AI Tools: When Is Upgrading Actually Worth It?

Image
Every AI assistant now has a free tier that's genuinely capable, and a paid tier that costs roughly the price of a couple of lunches per month. So the question isn't "is AI worth paying for" in the abstract — it's whether your specific usage crosses the line where paying changes anything . This article gives you that line. What you actually get when you pay Pricing and features shift constantly, so ignore the marketing lists and look at the three differences that persist across providers: Priority access. Free tiers get throttled or queued at busy hours. If your work happens during peak times, this is the difference between a tool you rely on and a tool that sometimes isn't there. The current top model. Free tiers usually route you to smaller or older models, with limited access to the best one. For simple tasks this doesn't matter. For reasoning-heavy work, it's the whole ballgame. Data handling. This is the one most people overlook. Paid and busin...
Read more

AI Search vs Traditional Search: How to Use Each in 2026

Image
Something changed in how people find things, and the numbers are unusually clear about it. According to a SparkToro analysis of Similarweb clickstream data published in June 2026, about 68% of U.S. Google searches between January and April 2026 ended without a click — up from roughly 60% in 2024. Answers are arriving without anyone visiting a page. That makes "which kind of search should I use?" a question worth having a real answer to. What the data actually says Two figures from that analysis matter most. AI Overviews now appear on more than 20% of Google searches, and click-through rates fall by roughly 60% when they do . The behavior shift is not that people stopped searching — it is that a search increasingly ends where it used to begin. For anyone doing research, the tradeoff is speed against provenance. You get an answer faster, and you can see less about where it came from. When AI search is the right tool You do not know the vocabulary yet — "the clause that l...
Read more

Are AI Certifications Worth It in 2026? A Practical ROI Test

Image
AI certifications have become a crowded market. Some are free and take an afternoon; others run into the thousands of dollars. The honest answer to "is it worth it?" is: it depends entirely on what you expect it to do for you . This article gives you a framework for judging that before you pay. What a certification can and can't do A credential is evidence, not a qualification. In practice it does three useful things: Gets you past a filter. When a job posting lists a certification, having it keeps you in the pile. Signals seriousness in a career change. If you're moving from a non-technical role into AI-adjacent work, a recognized credential shows you invested real effort. Forces structured learning. Many people need a syllabus and a deadline. That's a legitimate reason to pay. What it almost never does is produce a salary increase on its own. Employers pay for demonstrated capability. The certificate opens the conversation; your work wins it. A four-question ...
Read more