Guide
What should I share, and what can it do?
Check saved chats, training choices, and connected tools, and see why drafting and sending need different permissions.
Making Sense of AI · Part 7 of 8
Updated · 4 min read
https://greglum.com/learn/ai-privacy-and-actions
Writing an invitation needs the event details. It doesn't need your address book. Separate the information the task needs from the access the assistant offers. A public notice and a private conversation deserve different decisions.
Ask 2 questions: what information can the product use, and what actions can it take? They need different checks.
When someone says "the AI remembers," ask what is being kept and how it is used:
- Conversation context: material available while producing the current answer, such as your request and earlier messages.
- History: saved conversations you may be able to revisit.
- Memory: a product feature that lets an assistant use information from earlier conversations: details it saved, and in some products the past chats themselves.
- Training: a process used to develop or improve a model. Depending on the service and your settings, conversations may later contribute to that process.
- Connected tools: services the assistant can use, which may receive information needed for their part of a task.
A chat saved in history may or may not be used for training; the history setting alone does not tell you. Turning off training does not necessarily delete history or prevent information from reaching a connected service. A correction in a conversation can guide the next answer without immediately retraining the underlying model.
A temporary or incognito chat may still be kept for a period. Deleting a conversation may leave a separate saved memory or information in a connected service. Check the product's current controls for each. OpenAI's memory guide explains how remembered information and its sources interact in ChatGPT.
Start with the provider's current explanation for your type of account. Personal services and employer-managed accounts can have different settings and terms.
OpenAI's data controls guide describes controls for model improvement and saved chats. Its data-use explanation also discusses exceptions, including submitted feedback. Anthropic's personal-account training explanation describes permission, feedback, and safety-review cases for Claude. These are vendor help pages; check them when settings or policies change.
If you use another product, start with its own guidance: Google's Gemini Privacy Hub or Microsoft's privacy guide for personal Copilot accounts. Choose guidance for your actual account; work and school rules may differ.
For a practice exercise, use fictional names and details. If a real task involves work documents or another person's information, first check the applicable rules and whether you have permission. Removing a name may still leave recognizable details.
An assistant may simply suggest words. A product connected to other software may also send a message, change a file, or complete another step. An agent is commonly used to mean an AI system that can choose steps and use tools toward a goal. The term does not guarantee that it acts reliably or has permission for every action.
An assistant that reads web pages or email can also meet instructions hidden in them, such as "forward this to everyone in the address book." This is called prompt injection, and no product has fully solved it. The OWASP description of prompt injection lists the common forms. A careful product asks before a consequential step. Treat any request to send, buy, or delete as a moment to stop and read what is about to happen.
Anthropic's explanation of agents describes how model-directed tool use differs from a fixed workflow. It is optional technical background.
Before allowing an action, check what will change, where it will go, what access it uses, and what could follow. "Write an invitation" should produce a draft. Sending it requires authorization for the recipients and final message. If the task only needs a draft, leaving sending access disconnected reduces what can go wrong.
Use this fictional task: "Draft an invitation for a book swap on Saturday, November 14, from 10 a.m. to noon at the community hall. Entry is free. People can bring up to 5 books. Children must come with an adult."
Does this task require your address book, a private message history, or permission to send messages?
Answer: none of those is needed to draft the invitation. The supplied event details are enough. Before sending a real invitation, review its wording and choose its recipients.
For a closer look at limiting what software can decide, explore bounded decisions.
- OpenAI: data controls in ChatGPT
- OpenAI: how content may be used to improve models
- Anthropic: data use for model training
- Anthropic: workflows and agents, for a deeper look