☀️ AI Morning Minute: Context Window

The "Post-it Note" of AI: The limit on how much a model can remember at once.

What it means

The "Context Window" is the total amount of text an AI can keep in its active memory at one time. This includes everything you’ve typed in that session and everything the AI has said back. It is measured in tokens. Once your conversation hits this limit, the AI starts "forgetting" the earliest parts to make room for new information.

Why it matters

• Short-Term Memory: Think of it like a scrolling whiteboard. As you write new things at the bottom, the stuff at the very top gets erased. This is why an AI might suddenly forget a specific instruction or a name you mentioned 20 messages ago.

• Size Matters: Different AI models have different “window” sizes. A small window is fine for a quick chat, but if you want the AI to analyze a 100-page PDF, you need a model with a very large context window so it can “see” the whole document at once.

Simple example

Imagine you are giving an AI instructions for a long story. If your conversation exceeds the "window," the AI might forget the main character’s name by Chapter 5. It’s not being glitchy; that name has simply "fallen off" the back of its memory to make room for the new sentences you're writing.