The three options in 2026
Local inference keeps everything on your hardware. Tools like Ollama have made this realistic even on laptops, and the ecosystem reported record usage in August 2026 after model performance crossed 100 tokens per second on modest hardware. The privacy guarantee is absolute - the model never leaves the device - but the model quality ceiling is lower than frontier APIs.
Zero-retention cloud APIs keep the frontier models but promise not to keep your data. OpenAI's preview of Private Safety Processing, for example, separates safety checks from customer data retention so that regulated and confidential workloads can use frontier models without the provider retaining prompts. The guarantee is contractual and architectural rather than physical.
The middle ground is a no-log or private inference provider - services that route your request to a frontier model and retain nothing. The trade-off is trust: you are relying on the provider's policy and infrastructure rather than on the physics of local hardware.
What each option actually protects
Local inference protects against everything except your own device's compromise - if the machine is lost or the software supply chain is attacked, the data is at risk. It also protects against metadata leakage at the network level, since nothing leaves the device.
Zero-retention APIs protect against the provider using your data for training or selling it, and against long-term retention in breach events. They do not protect against a provider-side compromise while a request is in flight, nor against your own network observing the request. Private safety processing adds the architectural guarantee that safety filtering does not become an excuse for retention.
For most people, the honest answer is that local is safest, zero-retention is strong, and the difference matters most for regulated data - health records, legal work, unreleased code, personal documents.
Cost and quality: the real trade-off
Local is the cheapest at scale - the marginal cost of an extra request approaches zero after the hardware is bought - but quality varies. A 30B-class local model is closer to frontier for reasoning and structured tasks than most people expect in 2026, and far behind on knowledge breadth and long-form creative work.
Zero-retention cloud APIs cost per token like any API, and the prices keep falling - several frontier-adjacent models now price below $1 per million input tokens. The operational cost is paying for quality and convenience, not for privacy, which comes as a default property of the offering rather than a paid add-on.
A decision framework
Ask two questions about every workload. First: what is the worst outcome if the prompt is observed or retained? If the answer is serious - client secrets, health data, trade secrets - prefer local, then zero-retention cloud. Second: what quality does the task need? If a strong local model can do it, local wins on every axis.
A workable default setup in 2026: a local model for drafting, summarising and personal documents; a zero-retention API for complex reasoning and writing where quality matters; and a clear policy of never sending regulated data to any service without a written zero-retention commitment. Tools like a password manager and a browser configured for privacy complete the stack, covered in related guides on this site.

