Every chatbot you use is following orders you never wrote. Before your first message reaches the model, somebody else’s instructions got there first: who it’s supposed to be, what it’s not allowed to say, how to handle you when you ask something strange.
That block of text is the system prompt. Most of what makes one AI product feel different from another lives in there, and you’ll probably never see a word of it. It’s less like a setting and more like a job description the model got handed on its way in the door.
What it means
A system prompt is a standing set of instructions a company sends to the model with every request, separate from whatever you type. It sets the role (you’re a support agent for a regional bank), the rules (don’t give legal advice, don’t discuss competitors), and the tone. You write the prompt. The company wrote the system prompt. The model reads both together and can’t really tell you which one it’s obeying at any given moment.
Why it matters
Two companies can build on the exact same model and ship products that behave nothing alike. A tax software chatbot and a kids’ homework helper can be running identical machinery underneath. The difference is a few thousand words of instructions sitting in front of it, written by a product manager who was mostly guessing.
The system prompt gets resent with every single request, which means it takes up room in your context window and you pay for those tokens on every turn. A bloated one is a running cost and a reason the model starts forgetting things sooner than you’d expect.
They leak. People talk chatbots into reciting their own instructions all the time, and the results end up posted online within hours. Anthropic sidesteps the whole game by publishing Claude’s system prompts in its release notes, which is either real transparency or a quiet admission that keeping them secret was never going to work. Probably some of both.
Simple example
A note taped to the register at a coffee shop. No free refills. Push the pastries. If somebody asks about the Wi-Fi, the password is on the receipt.
The cashier reads it before every customer and never mentions it out loud. You just order your coffee. And if the owner wrote something dumb on that note, every person who walks in gets the dumb version, all day, without ever knowing why.