☀️ AI Morning Minute: Weights
A model’s weights are the closest thing it has to memory. They’re also the most valuable thing a lab owns.
It’s not AI related but...
My wife and I are launching a new service called PostARTing — an art subscription that mails original, handmade art postcards to your door. Neat right?
We’re opening a limited Charter Club before we officially launch. Founding pricing locked in forever, plus a free card to send a friend. And there are just a few dozen spots left.
If getting real art in the mail sounds like your kind of thing, claim a spot before they’re all gone.
When an AI model finishes training, it doesn’t save its work the way a student might write notes. Instead, the results of all that training get stored as billions of numerical values called weights. Those numbers encode everything the model learned: grammar, facts, reasoning patterns, coding conventions, and more. The model itself is just the architecture. The weights are what make it smart. And increasingly, the weights are what the whole industry is fighting over.
What it means
Weights (also called model weights or parameters) are the numerical values inside a neural network that get adjusted during training to make the model better at its task. A large language model has hundreds of billions of weights. During training, the model sees enormous amounts of data, makes predictions, compares them to correct answers, and nudges each weight slightly in the direction that reduces error. Do that billions of times and you get a model that can write, reason, and code. Once training is done, the weights are fixed. Running the model, called inference, just means passing your input through the network with those weights applied. Changing the model means changing the weights, by retraining or fine-tuning.
Why it matters
Weights represent the economic value of AI. Training a frontier model costs tens to hundreds of millions of dollars in compute. The weights that come out the other side are the product of that investment. This is why labs guard them carefully, and why leaked weights, like early Llama releases, cause significant controversy about competitive advantage and safety.
Open weights versus closed weights is one of the defining fault lines in AI right now. A closed model keeps its weights proprietary; you can only access it through an API. An open weights model releases the weights publicly, letting anyone run, modify, or fine-tune it. The debate over which is better for safety, innovation, and competition is genuinely unsettled.
Fine-tuning works by adjusting weights. When a company builds a specialized AI tool, they run additional training that modifies a subset of the weights to improve performance on their specific task. Understanding weights is understanding why fine-tuning is possible, and why it’s cheaper than training from scratch.
Simple example
Think of weights like the settings on a very complex mixing board with a hundred billion knobs. Training turns all those knobs until the output sounds right. Once the knobs are set, that’s the model. Running it is just playing music through those settings. Fine-tuning means adjusting a small section for a specific sound. Retraining means starting over at zero.