Okay right out of the gate, this one isn’t an AI specific term. APIs are decades older than any of this and they’d be running the internet just fine if machine learning had never happened. On most days I’d leave it alone.
But the word turns up constantly in pricing pages and vendor pitches, and it just gets assumed that people know what this is. But if feels like about half the AI vocabulary you’ve already learned sits directly on top of it. So: API. Stands for application programming interface, which honestly tells you nothing.
What it means
An API is an agreed-on way for one piece of software to ask another piece of software for something. There are rules for how you ask and rules for what comes back, and no human is involved at either end. Your phone’s weather app didn’t measure the temperature outside. It asked a weather service through an API and got a number back.
Why it matters
Most of the AI you run into isn’t the AI company’s product. When your bank’s chatbot answers a question, or a feature inside some app you already pay for drafts a paragraph for you, that’s usually an API call to OpenAI or Anthropic or Google, billed to whoever built the app. You’ve been using these models without ever visiting their websites.
API access and app access are two different businesses with the same model behind them. The chat subscription is a flat monthly fee with memory, an interface, and a system prompt somebody else wrote. The API is metered per token, has no memory of anything, and shows up with none of that. People are often surprised the outputs don’t match.
It’s also what keeps the vendors swappable, at least on paper. A company that built its feature against one provider’s interface can move to another one without starting over. That’s the premise behind model routing, and a decent part of why no AI vendor can quietly raise prices.
Simple example
A drive-thru. You never go inside the building, you never see the kitchen, and you don’t get to wander back and ask the fryer cook a question. There’s a speaker box, a menu of things they’ve agreed to make, and a specific way you’re expected to ask for them.
Order something that isn’t on the menu and you don’t get a creative interpretation. You get confusion, and a car behind you.