I asked ChatGPT about owls. The answer came back with
a message about my dogs. I hadn’t mentioned my dogs. Traditional IT can’t connect those dots.
AI can. That is a glimpse into AI memory and the power of inference.
By Jon Nordmark, CEO, Iterate.ai
In June 2025, thinking about the owls perched above my neighbor’s deck, I asked ChatGPT what kind of owls live in my neighborhood. It said the owl was probably a Great Horned Owl. Then it brought up things I hadn't asked for: the AI mentioned Rosie, Sammie, and Charlie, my dogs.
AI will soon have the “infinite, perfect memory” no human has — and today we are only in “the GPT-2 era of memory.”
Paraphrasing Sam Altman, CEO, OpenAI — Big Technology Podcast, Dec 18, 2025
That is inference: the model combined things it already knew about me and predicted a future action. Everything useful about AI starts there — and so does everything you have to govern.
Weeks earlier, in a different conversation with ChatGPT, I had mentioned my dogs by name. The model kept that. When owls came up, the AI put the two together on its own: owls hunt small animals, small dogs go out in the evening, this person has small dogs. AI built that connection.
A traditional database query doesn't do this. A search returns the exact match of what is asked, nothing more. It doesn't carry anything from last month into today’s question. That difference is the point of AI — and the risk.
An AI linked to institutional data across departments knows more about how your company works than any one employee does.
AI works on inference, and builds connections from what your people typed. A question from Finance can surface in a document from Legal without anyone deciding it should.
You can delete a file. You cannot un-prompt what a model already learned.
Inference is a good thing, but where that inference happens is important. The AIPod Mini runs the model privately, so the semantic relationships it builds stay on your hardware and under your own access rules.
Reaching a conclusion nobody told you. You see a leash by the door and know there is a dog, even though no one said so. AI does this constantly, across everything it has been told.
What the system retains after the conversation ends. Some fades when you close the window. Some is written into the model itself, where you cannot reach in and take it back.
The starter pack for AI Certification - The full certification series | Never Train Your Rival's Model - How you work with AI | The 5 risk vectors of AI memory - On what a model keeps after you log off.
A joint educational series on private AI and the AIPod Mini. NetApp — the governed data-control layer. Iterate.ai — the private intelligence layer.
