Control over AI
Blog
AI data leakage 7 min read

Who decides what an AI assistant remembers?

Memory became a setting, and settings have owners. Sometimes you, sometimes your administrator, sometimes the vendor deciding for both of you.

Abstract spiral with data points in teal
Quick answer

On most assistants memory is on by default and the user manages it: you can view the stored facts, edit them and delete them. In enterprise tenants that control moves to the administrator, who can switch memory off for the whole organisation or make it mandatory. And with assistants embedded in your workspace, the vendor decides what gets pulled in as context regardless of what you deliberately asked it to remember. So the question is not whether AI remembers, but who owns the switch and whether anyone has looked at it.

01

Memory across conversations is separate from the context window within one

02

On consumer accounts the user manages it, usually with memory on by default

03

In enterprise tenants the control moves to the administrator

04

Context pulled in automatically is not memory, but it feels exactly the same

05

Review what has been remembered, because errors get repeated

A consultant has worked with the same assistant for months. He no longer explains what he does, which sector his clients are in or how he structures a report. That is the point, and it works well.

Then, in a conversation about an entirely different client, a detail surfaces that he mentioned about the first client three months ago. Nobody did anything wrong. The switch was simply on.

Memory is not the conversation

First, the distinction, because this is where assessments most often go wrong.

The context window is the working space of one conversation. When the conversation ends, that space is empty. What was in it remains in your history, but the model does not carry it into the next exchange.

Memory is a separate feature. The assistant extracts facts that look worth keeping and stores them as discrete notes: your role, your preferences, what you are working on, how you like to be addressed. When you start a new conversation, those notes are sent along with your first message.

Two systems, two retention periods, two switches.

Three owners of the same switch

The user. On consumer accounts you manage it. The major assistants offer a view of what has been remembered, and you can remove entries from it. The default is usually on.

The administrator. In enterprise tenants the control moves. The organisation can switch memory off for everyone, switch it on for everyone or configure it per group. It is one of those settings that survives a rollout on its default value because nobody went looking for it.

The vendor. The third owner and the least visible. Assistants embedded in your workspace pull in context automatically: recent documents, your calendar, the thread you are reading. Technically that is not memory, because nothing is stored as a note, but to the user it feels exactly the same. The assistant knows things you never told it. See how AI tools reach files you never uploaded.

Why this is more than a setting

Three consequences that turn up in practice.

Errors get repeated. If the assistant stored a wrong assumption (a role you do not hold, a client you no longer serve), it returns in every conversation and is treated as a given. It is harder to catch than a one-off mistake, because there is no source attached.

Third-party data ends up in it. Memory is meant for facts about you. In practice it also retains what you mention often, and that means client names, matters and cases. That is processing personal data belonging to someone who was never part of the conversation.

Information leaks from one context to another. What you say in one role can surface in a conversation held in another. For anyone serving multiple clients, that is not a theoretical concern.

What to do

For an organisation:

  1. Choose the memory setting deliberately rather than leaving it at the default. Both choices are defensible; not choosing is not.
  2. Treat memory as a distinct processing operation in your DPIA, with its own purpose and retention.
  3. Explain what happens. People who know something is being retained behave differently towards it.

For yourself, if it is on:

Read the memory list once a month. Not because something alarming is in there, but because it shows you what the assistant believes it knows. It usually makes for illuminating reading, and it is the only way to remove a wrong assumption before it gets repeated fifty times.

How memory works in each tool, and how to manage it with each provider, is covered in how AI memory works.

So the question is not whether an assistant remembers, because it does, but who owns the switch and whether anyone has ever looked at it. In most organisations nobody has. That is where you start.

FAQ

Common questions

What is the difference between memory and the context window?

The context window is the working space of one conversation and empties when it ends. Memory is a separate feature that holds facts from one conversation to the next, so in a new chat the assistant still knows what you told it before.

Can I see what an assistant has remembered about me?

With the major assistants, yes. There is usually a settings view listing the stored facts, which you can edit or delete. Reviewing that periodically is more useful than switching memory off entirely.

Can my administrator turn memory off?

In enterprise tenants, usually yes. It becomes an organisational setting rather than a personal preference. During a rollout it is one of the first switches to set deliberately rather than leave on its default.

What happens to incorrect memories?

They get repeated. If the assistant stored a wrong assumption about your role or your client, it returns in every subsequent conversation and gets treated as established fact. That is why review matters more than people expect.

Is memory a processing operation under the GDPR?

Yes. Data about a person is stored for later use, with a purpose and a retention period. If third-party personal data ends up in there, such as a client name you mention often, that is processing your organisation is accountable for.

Portrait of Rens Timmermans from BeeSensible

Prefer someone to walk you through it?

Rens, BeeSensible

I'm happy to give you a twenty-minute tour. Leave your details and I'll find a time that suits you. You're also welcome to call or email.

Prefer to talk to someone first?

Want a live demo, or a quote for 100+ users? Leave your details and we'll be in touch within one working day.