I asked an AI about owls. The answer came back with a message about my dogs. I hadn’t mentioned my dogs. IT can’t connect those dots. AI can. That is a glimpse into AI inference.
In June 2025, thinking about the owls perched above my neighbor’s deck, I asked ChatGPT what kind of owls live in my neighborhood. It said probably a Great Horned Owl. Then it added something I had not asked for.
AI will soon have the “infinite, perfect memory” no human has — and today we are only in “the GPT-2 era of memory.”
Paraphrasing Sam Altman, CEO, OpenAI — Big Technology Podcast, Dec 18, 2025
That is inference: the model combined things it already held about me and reached a conclusion nobody asked for. Everything useful about AI starts there — and so does everything you have to govern.
Your AI holds a picture of you that nobody wrote down. Where it lives is a decision.
Weeks earlier, in a different conversation, I had mentioned my dogs by name. The model kept that. When owls came up it put the two together on its own: owls hunt small animals, small dogs go out in the evening, this person has small dogs. Nobody built that connection.
Traditional IT cannot do this. A search returns what matches your words. It carries nothing from last month into today’s question. That difference is the point of AI — and the risk.
An AI that links facts across teams and years knows more about how your company works than any one employee does.
It builds those links from what your people typed. A question from Finance can meet a document from Legal without anyone deciding it should.
You can delete a file. You cannot un-say what a model already learned from it.
Inference is not the problem. Where it happens is. The model runs on NetApp® storage you own, so the links it builds stay on your hardware and under your own access rules.
Reaching a conclusion nobody told you. You see a leash by the door and know there is a dog, even though no one said so. AI does this constantly, across everything it has ever been told.
What the system holds on to after the conversation ends. Some fades when you close the window. Some is written into the model itself, where you cannot reach in and take it back.
Full paper, 7 pages — iterate.ai/partners/netapp/papers.
On what a model keeps after you log off: The Oohs, Awes, and Dangers of AI Memory.
A joint educational series on private AI and the AIPod Mini. NetApp — the governed data-control layer. Iterate.ai — the private intelligence layer.