☀️ AI Morning Minute: Data Center
You likely already know what a data center is. You probably don't know what an AI one costs to run.
Everybody has a rough picture of a data center: a warehouse full of servers, humming somewhere off a highway. That picture was accurate for about twenty years. The AI version is a different animal, and it's the reason your utility company is suddenly in the news.
What it means
A data center is a building full of computers that store data and run software for other people. A traditional one is mostly storage and web traffic: your email, your company’s files, the website you’re reading. Power draw is steady and modest.
An AI data center is built around racks of GPUs training and running models. Those chips pull far more electricity and throw off far more heat, so the whole building changes shape around them. Denser racks. Liquid cooling instead of fans. A power hookup that looks less like an office park and more like a small city. A traditional rack might draw 5 to 10 kilowatts. An AI rack can pull 100 or more.
That’s why the new ones get measured in gigawatts now instead of square feet. When OpenAI says it’s deploying chips at gigawatt scale, it’s describing a power budget, not a floor plan.
Why it matters
The electricity is the real constraint, not the chips. Data centers used about 4% of US power in 2023. Projections put that closer to 9% by 2030, driven almost entirely by AI. In some regions, utilities can’t connect new capacity fast enough, and AI companies are signing deals for their own nuclear and gas generation to skip the line.
This is why inference cost matters so much to the people running these models. Every response you get costs real electricity in a real building. That’s the whole argument behind custom chips like Google’s TPUs and OpenAI’s Jalapeño: shave the watts per answer, and the math on serving hundreds of millions of users changes.
Where they get built is becoming a local political fight. Communities are pushing back on water use for cooling, on power prices, and on getting a warehouse instead of jobs. A data center employs maybe a few dozen people. It’s not a factory, and towns are figuring that out after the ribbon cutting.
Simple example
A restaurant kitchen with a few burners and an oven runs fine on a normal commercial power hookup. Now put in ten industrial pizza ovens that run at full heat, all day, every day. You aren’t just adding equipment. You need new wiring, a bigger service line from the street, and a ventilation system to move all that heat out of the room.
Same building. Same idea. But the power bill and the plumbing are somebody else’s problem now, and that somebody is the town.