Tagged:

2 posts

• Cross-Tenant Data Leakage in Multi-Tenant LLM Deployments: Incidents, Architecture, and What to Demand from Providers

  When an LLM service hosts multiple customers on shared infrastructure, failures in conversation isolation, prompt cache sharing, or conversation history storage can expose one customer's data to another. This post covers the documented failure modes, the March 2023 ChatGPT Redis incident, batch inference and system prompt bleed risks, and what enterprise architects should demand from LLM providers before trusting them with sensitive data.

  Jul 15, 2026 llm-security multi-tenant data-leakage inference-infrastructure privacy prompt-caching gdpr enterprise-security defense-patterns

• Cross-Tenant Contamination in LLM APIs: When Other Users' Context Leaks Into Your Session

  Multi-tenant LLM deployments — shared inference infrastructure, KV cache reuse, batched requests — create subtle cross-tenant data exposure risks that differ from classical API security vulnerabilities. This post maps the threat surface unique to shared AI inference.

  Jul 2, 2026 prompt-caching timing-attacks kv-cache side-channel llm-security