Tagged:

5 posts

• Model Inversion Attacks: Reconstructing Private Training Data from Model Confidence Scores

  A model's output probability scores are not neutral summaries — they encode information about the training data that produced them. Model inversion attacks exploit this to reconstruct representative training examples from API-level confidence values. This post covers the foundational Fredrikson et al. work, black-box and GAN-based variants, conditions for vulnerability, and how to distinguish this class from membership inference and training data extraction.

  Jul 13, 2026 privacy adversarial-ml model-inversion differential-privacy attack-defense training-data

• Differential Privacy in Practice: What the Math Guarantees (and What It Doesn't) for AI Training Data

  Differential privacy is the strongest mathematical privacy guarantee for ML training data — but the gap between formal ε-DP and deployed reality means many 'private' AI systems aren't nearly as private as advertised. This post bridges the math and the practice.

  Jul 6, 2026 privacy differential-privacy dp-sgd membership-inference training-data epsilon attack-defense llm-security

• Membership Inference Attacks: Detecting What Was in an AI Model's Training Data

  Membership inference attacks let adversaries determine—with significant accuracy—whether a specific data record was used to train a model. This post covers the attack mechanisms, why models leak this information, real-world threat scenarios, and how differential privacy and machine unlearning address (and fail to fully close) the gap.

  Jul 5, 2026 privacy membership-inference differential-privacy machine-unlearning attack-defense gdpr overfitting

• Gradient Inversion Attacks: Reconstructing Private Training Data from Model Updates

  Gradients are not safe summaries of training data. In federated learning and fine-tuning pipelines where model updates are shared, a malicious aggregator can run gradient inversion to recover original training samples with alarming fidelity — and the defenses have hard limits.

  Jul 4, 2026 federated-learning privacy gradient-inversion differential-privacy training-data attack-defense

• Adaptive Red Teaming via GRPO: When the Attacker and Defender Train Together

  AdvGRPO introduces a co-training framework where attacker and defender language models evolve together, producing attacks that are both highly effective and transferable — and defenders that outperform safety baselines.

  Jun 13, 2026 red-teaming adversarial-training reinforcement-learning ai-safety attack-defense