Building a useful agent · Memory
How a conversation becomes a memory
July 21, 2026 · 6 min read
Some experiences stay with you for life. Others disappear almost as soon as they happen. We built our agents' memory to work the same way.
Of everything you experience in a day, only some of it becomes a memory. Two parts of your brain decide that. The hippocampus creates the memory, the what, the when, the who. The amygdala decides how strong it is.
For an agent, that experience is the conversations you have with it and the work it does.
Conversation becomes memory
The memories you keep of things that happened are episodic memories: what happened, when, and who said it. Someone tells you there's a meeting Wednesday, and that's what you keep. An agent makes the same kind of memory out of a conversation.
It runs in the background, not mid-reply. Once a conversation goes quiet, the hippocampus reads a window of recent messages in one pass. It's a single model call. Out come episodes: one per distinct thing that happened, tagged with what kind of moment it was, each linked back to the conversation it came from.
Some memories outrank others
Not every episode counts the same. The agent has your meeting down for Wednesday. Tell it no, it moved to Thursday, and you're correcting a fact it already had, not adding a new one. Capture marks that as its own kind of thing.
That kind is called an act, and who did what decides how much it carries. A correction from you sets the record straight, the highest authority there is. The agent taking back something it said matters too, but that's the agent fixing itself, not you. Yours wins.
Who said it changes what it's worth.
Later on, that's how conflicts get settled. So the tag had better be right.
What the memory weighs
How much an episode is worth comes from two things. The act sets a floor: a correction stays heavy even said flatly, a routine lookup starts near nothing. The other is intensity, how forcefully you said it, judged against your own usual tone. A normally terse person who suddenly types in capitals is a spike; the same words from someone who always writes that way are just their normal. The weight is whichever of the two is higher. That's the amygdala's job, and the number it lands on is called salience.
no, it's Thursday, not Wednesday
ordinary punctuation, occasional emphasis
Weight becomes lifespan
A routine lookup fades quickly. A peak moment holds far longer. Salience seeds that lifespan too.
That curve isn't ours. It's a model of human forgetting whose shape traces to 220 million real recall events, logged from people studying vocabulary in a language app. It turns on a single number: how long a memory lasts. We set that number from salience the moment the memory forms.
Every memory fades, but none is ever deleted. Fading only decides what comes back first. When you think about something, or experience it again, a new memory forms, with its own fresh fade. Same with the agent: when something comes up again in a later conversation, that's a fresh experience, and another new memory. The pile of them is what makes a thing stick.
Tell an agent something once, and weeks later it can seem gone. It wasn't erased. It went in weighed low, so it faded, and a passing question might not be enough to pull it back up past everything newer. But give it enough of the context and it surfaces again. It's the same for us, sometimes you just need a bigger reminder before it comes back.
What is actually worth capturing?
Step back to where capture starts. The first question is what's even worth writing down. A language tutor kept correcting one user's Spanish, and capture wrote down every correction. What the agent came away holding was the grammar: moto is feminine, gracias is spelled gracias. For someone learning the language, that's the right thing to keep. But it came from what the model already knew, nothing about the person.
The obvious fix is to record only what the user says and drop the rest. We tried it. It cut a big chunk of the episodes, and a lot of those were things the agent had found out for the user while working. The part that looked like the agent talking to itself was where the memory was. Real, and gone.
What's worth keeping is narrower, and it's about the person: that the user used the wrong gender for moto.
What capture hands off
Episodic memories just keep accumulating over time, but things we experience multiple times start to become semantic memories, facts. How those facts are created and updated is a job for the neocortex. The only memories that matter are the ones you can recall.