Privacy Attacks Repository

Title Authors Year Data Type (Inputs) Type of Data Release (Outputs) Attacker Objectives Research Type BibTeX Code Links Submitter
The 2010 Census Confidentiality Protections Failed, Here's How and Why
John M. Abowd, Tamara Adams, Robert Ashmead, David Darais, Sourya Dey, Simson L. Garfinkel, Nathan Goldschlag, Daniel Kifer, Philip Leclerc, Ethan Lew, Scott Moore, Rolando A. Rodríguez, Ramy N. Tadros, Lars Vilhuber
 2023 Tabular Linear-Queries Reconstruction Empirical Download Code Paper John Abowd, Cornell
One-shot Empirical Privacy Estimation for Federated Learning
Galen Andrew, Peter Kairouz, Sewoong Oh, Alina Oprea, H. Brendan McMahan, Vinith M. Suriyakumar
 2024 Image Predictive-Model Membership-Inference Empirical Download Paper Yash Maurya, Independent Researcher
A linear reconstruction approach for attribute inference attacks against synthetic data
Meenatchi Sundaram Muthu Selva Annamalai, Andrea Gadotti, Luc Rocher
 2024 Tabular Generative-Model Attribute inference Empirical Download Code Paper Georgi Ganev, UCL
"What do you want from theory alone?" Experimenting with Tight Auditing of Differentially Private Synthetic Data Generation
Meenatchi Sundaram Muthu Selva Annamalai, Georgi Ganev, Emiliano De Cristofaro
 2024 Tabular Generative-Model Membership-Inference Empirical Download Code Paper Yash Maurya, Independent Researcher
Reconstructing training data with informed adversaries
Borja Balle, Giovanni Cherubin, Jamie Hayes
 2022 Image Predictive-Model Reconstruction Empirical Download Paper Georgi Ganev, UCL
Scalable Membership Inference Attacks via Quantile Regression
Martin Betram, Shuai Tang, Michael Kearns, Jamie Morgenstern, Aaron Roth, Zhiwei Steven Wu
 2024 Image Predictive-Model Membership-Inference Empirical Download Paper Johan Östman, AI Sweden
DP-Sniper: Black-Box Discovery of Differential Privacy Violations using Classifier
Benjamin Bichsel, Samuel Steffen, Ilija Bogunovic, Martin Vechev
 2021 Tabular NaN Information Leakage Empirical Download Paper Georgi Ganev, UCL
When the Curious Abandon Honesty: Federated Learning Is Not Private
Franziska Boenisch, Adam Dziedzic, Roei Schuster, Ali Shahin Shamsabadi, Ilia Shumailov, Nicolas Papernot
 2023 Image Predictive-Model Reconstruction Empirical Download Code Paper Dmitrii Usynin, TUM/Imperial College London
Membership inference attacks against synthetic data through overfitting detection
Boris van Breugel, Hao Sun, Zhaozhi Qian, Mihaela van der Schaar
 2023 Tabular Generative-Model Membership-Inference Empirical Download Paper Georgi Ganev, UCL
Extracting training data from diffusion models
Nicholas Carlini, Jamie Hayes, Milad Nasr, Matthew Jagielski, Vikash Sehwag, Florian Tramèr, Borja Balle, Daphne Ippolito, Eric Wallace
 2023 Image Generative-Model Data-Extraction Empirical Download Paper Georgi Ganev, UCL
Extracting training data from large language models.
Nicolas Carlini, Florian Tramèr, Eric Wallace, Matthew Jagielski, Ariel Herbert-Voss, Katherine Lee, Adam Roberts, Tom Brown, Dawn Song, Úlfar Erlingsson, Alina Oprea, and Colin Raffel
 2021 Text Generative-Model Data-Extraction Applications Download Paper Jon Ullman, Northeastern University
Stealing Part of a Production Language Model
Nicholas Carlini, Daniel Paleka, Krishnamurthy (Dj) Dvijotham, Thomas Steinke, Jonathan Hayase, A. Feder Cooper, Katherine Lee, Matthew Jagielski, Milad Nasr, Arthur Conmy, Eric Wallace, David Rolnick, Florian Tramèr
 2024 Text Generative-Model Data-Extraction Applications Download Paper Daniil Filienko, University of Washington
The Secret Sharer: Evaluating and Testing Unintended Memorization in Neural Networks
Nicholas Carlini, Chang Liu, Úlfar Erlingsson, Jernej Kos, Dawn Song
 2019 Text Generative-Model Data-Extraction Empirical Download Paper Georgi Ganev, UCL
Membership Inference Attacks From First Principles
Carlini et al.
 2022 Tabular Predictive-Model Membership-Inference Theoretical Download Paper Yves-Alexandre de Montjoye, Imperial College
The Privacy Onion Effect: Memorization is Relative
Carlini et al.
 2022 Tabular Predictive-Model Membership-Inference Empirical Download Paper Yves-Alexandre de Montjoye, Imperial College
Gan-leaks: a taxonomy of membership inference attacks against generative models
Dingfan Chen, Ning Yu, Yang Zhang, Mario Fritz
 2020 Image Generative-Model Membership-Inference Empirical Download Paper Georgi Ganev, UCL
Label-only membership inference attacks
Christopher A. Choquette-Choo, Florian Tramer, Nicholas Carlini. Nicolas Papernot
 2021 Image Predictive-Model Membership-Inference Empirical Download Paper Johan Östman, AI Sweden
Privacy Threats in Stable Diffusion Models
Thomas Cilloni, Charles Fleming, Charles Walter
 2023 Image Generative-Model Membership-Inference Applications Download Paper Saraswathy RV, HP Inc.
Linear program reconstruction in practice.
Aloni Cohen and Kobbi Nissim
 2018 Tabular Linear-Queries Reconstruction Applications Download Paper Jon Ullman, Northeastern University
Empirical privacy and empirical utility of anonymized data.
Cormode, G., Procopiuc, C.M., Shen, E., Srivastava, D. and Yu, T
 2013 Tabular Linear-Queries Reconstruction Empirical Download Paper James Honaker, Anonym
QuerySnout: Automating the Discovery of Attribute Inference Attacks against Query-Based Systems
Ana-Maria Cretu, Florimond Houssiau, Antoine Cully, Yves-Alexandre de Montjoye
 2022 Tabular Linear-Queries Attribute-Inference Empirical Download Paper Ana-Maria Cretu, EPFL
Privacy Side Channels in Machine Learning Systems
Edoardo Debenedetti, Giorgio Severi, Nicholas Carlini, Christopher A. Choquette-Choo, Matthew Jagielski, Milad Nasr, Eric Wallace, Florian Tramèr
 2024 Text NaN Information Leakage Empirical Download Paper Yash Maurya, Independent Researcher
Confidence-ranked reconstruction of census microdata frompublished statistics
Travis Dick, Cynthia Dwork, Michael Kearns, Terrance Liu, Aaron Roth, Giuseppe Vietri, and Zhiwei Steven Wu
 2023 Tabular Linear-Queries Membership-Inference Empirical Download Paper Audra McMillan, Apple
SPEAR:Exact Gradient Inversion of Batches in Federated Learning
Dimitar I. Dimitrov, Maximilian Baader, Mark Niklas Müller, Martin Vechev
 2024 Image Predictive-Model Reconstruction Theoretical Download Paper Prahaladh Chandrahasan, Carnegie Mellon University
Revealing Information While Preserving Privacy
Irit Dinur and Kobbi Nissim
 2003 Tabular Linear-Queries Reconstruction Theoretical Download Paper Jon Ullman, Northeastern University
Do Membership Inference Attacks Work on Large Language Models?
Michael Duan, Anshuman Suri, Niloofar Mireshghallah, Sewon Min, Weijia Shi, Luke Zettlemoyer, Yulia Tsvetkov, Yejin Choi, David Evans, Hannaneh Hajishirzi
 2024 Text Generative-Model Membership-Inference Empirical Download Code Paper Daniil Filienko, University of Washington
Exposed! a survey of attacks on private data.
Dwork, C., Smith, A., Steinke, T. and Ullman, J.
 2017 Tabular NaN NaN Theoretical Download Paper James Honaker, Anonym
New Efficient Attacks on Statistical Disclosure Control Mechanisms
Dwork, Cynthia, Yekhanin, Sergey
 2008 Tabular Linear-Queries Information Leakage Theoretical Download Paper Saraswathy RV, HP Inc.
Decepticons: Corrupted Transformers Breach Privacy in Federated Learning for Language Models
Liam Fowl, Jonas Geiping, Steven Reich, Yuxin Wen, Wojtek Czaja, Micah Goldblum, Tom Goldstein
 2022 Text Predictive-Model Reconstruction Empirical Download Code Paper Dmitrii Usynin, TUM/Imperial College London
Robbing the Fed: Directly Obtaining Private Data in Federated Learning with Modified Models
L Fowl, J Geiping, W Czaja, M Goldblum, T Goldstein
 2021 Image Predictive-Model Reconstruction Empirical Download Code Paper Dmitrii Usynin, TUM/Imperial College London
On the Inadequacy of Similarity-based Privacy Metrics: Reconstruction Attacks against "Truly Anonymous Synthetic Data"
Georgi Ganev, Emiliano De Cristofaro
 2023 Tabular Generative-Model Reconstruction Empirical Download Paper Georgi Ganev, UCL
Understanding database reconstruction attacks on public data
Simson Garfinkel, John M Abowd, Christian Martindale
 2019 Tabular Linear-Queries Reconstruction Empirical Download Paper Georgi Ganev, UCL
Inverting Gradients -- How easy is it to break privacy in federated learning?
Geiping et al.
 2020 Image Predictive-Model Reconstruction Empirical Download Code Paper Aurélien Bellet, Inria
A Unified Framework for Quantifying Privacy Risk in Synthetic Data
Matteo Giomi, Franziska Boenisch, Christoph Wehmeyer, Borbála Tasnádi
 2023 Tabular Generative-Model Membership-Inference Empirical Download Paper Georgi Ganev, UCL
Synthetic is all you need: removing the auxiliary data assumption for membership inference attacks against synthetic data
Florent Guépin, Matthieu Meeus, Ana-Maria Cretu, Yves-Alexandre de Montjoye
 2023 Tabular Generative-Model Membership-Inference Empirical Download Paper Georgi Ganev, UCL
Reconstructing Training Data from Trained Neural Networks
Niv Haim, Gal Vardi, Gilad Yehudai, Ohad Shamir, Michal Irani
 2022 Image Predictive-Model Reconstruction Empirical Download Code Paper Georgi Ganev, UCL
LOGAN: Membership Inference Attacks Against Generative Models
Jamie Hayes, Luca Melis, George Danezis, Emiliano De Cristofaro
 2019 Image Generative-Model Membership-Inference Empirical Download Paper Georgi Ganev, UCL
Monte Carlo and Reconstruction Membership Inference Attacks against Generative Models
Benjamin Hilprecht, Martin Härterich, and Daniel Bernau
 2019 Image Generative-Model Membership-Inference Empirical Download Paper Georgi Ganev, UCL
Tapas: Toolbox for Adversarial Privacy Auditing of Synthetic Data
Florimond Houssiau, James Jordon, Samuel N. Cohen, Owen Daniel, Andrew Elliott, James Geddes, Callum Mole, Camila Rangel-Smith, Lukasz Szpruch
 2022 Tabular NaN NaN NaN Download Paper Daniil Filienko, University of Washington
Auditing Differentially Private Machine Learning: How Private is Private SGD?
Matthew Jagielski, Jonathan Ullman, Alina Oprea
 Image Predictive-Model Membership-Inference Empirical Download Paper Tudor Cebere, Inria
Are We There Yet? Timing and Floating-Point Attacks on Differential Privacy Systems
Jin, McMurtry, Rubinstein, Ohrimenko
 2022 NaN NaN Reconstruction Applications Download Paper Zachary Ratliff, Harvard + OpenDP
User Inference Attacks on Large Language Models
Nikhil Kandpal, Krishna Pillutla, Alina Oprea, Peter Kairouz, Christopher A. Choquette-Choo, Zheng Xu
 2023 NaN Generative-Model Membership-Inference Empirical Download Paper Peter Kairouz, Google
Cocktail Party Attack: Breaking Aggregation-Based Privacy in Federated Learning Using Independent Component Analysis
Sanjay Kariyappa, Chuan Guo, Kiwan Maeng, Wenjie Xiong, G. Edward Suh, Moinuddin K Qureshi, Hsien-Hsin S. Lee
 2023 Image Predictive-Model Reconstruction Theoretical Download Paper Dmitrii Usynin, TUM/Imperial College London
PANORAMIA: Privacy Auditing of Machine Learning Models without Retraining
Mishaal Kazmi, Hadrien Lautraite, Alireza Akbari, Qiaoyue Tang, Mauricio Soroco, Tao Wang, Sébastien Gambs, Mathias Lécuyer
 2024 Image, Tabular, Text Predictive-Model Membership-Inference Empirical Download Code Paper Yash Maurya, Independent Researcher
Membership inference attacks by exloiting loss trajectories
Yiyong Liu, Zhengyu Zhao, Michael Backes, Yang Zhang
 2022 Image Predictive-Model Membership-Inference Empirical Download Code Paper Johan Östman, AI Sweden
Group and Attack: Auditing Differential Privacy
Johan Lokna, Anouk Paradis, Dimitar I. Dimitrov, Martin Vechev
 2023 NaN NaN Information Leakage Empirical Download Code Paper Georgi Ganev, UCL
Antipodes of Label Differential Privacy: PATE and ALIBI
Mani Malek, Ilya Mironov, Karthik Prasad, Igor Shilov, Florian Tramèr
 2021 Image Predictive-Model Attribute inference Empirical Download Code Paper Ilya Mironov, Meta
Membership Inference Attacks against Language Models via Neighbourhood Comparison
Justus Mattern et al.
 2023 Text Generative-Model Membership-Inference Applications Download Code Paper Hamid Mozaffari, Oracle Labs
Quantifying Privacy Risks of Masked Language Models Using Membership Inference Attacks
Fatemehsadat Mireshghallah, Kartik Goyal, Archit Uniyal, Taylor Berg-Kirkpatrick, Reza Shokri
 2022 Text Generative-Model Membership-Inference Applications Download Paper Daniil Filienko, University of Washington
Privacy Attacks in Decentralized Learning
Abdellah El Mrini, Edwige Cyffers, Aurélien Bellet
 2024 Image Predictive-Model Reconstruction Empirical Download Code Paper Aurélien Bellet, Inria
Adversary instantiation: lower bounds for differentially private machine learning
Milad Nasr, Shuang Song, Abhradeep Thakurta, Nicolas Papernot, Nicholas Carlini
 2021 Image Predictive-Model Membership-Inference Empirical Download Paper Georgi Ganev, UCL
Scalable extraction of training data from (production) language models
Milad Nasr, Nicholas Carlini, Jonathan Hayase, Matthew Jagielski, A. Feder Cooper, Daphne Ippolito, Christopher A. Choquette-Choo, Eric Wallace, Florian Tramèr, Katherine Lee
 2023 Text Generative-Model Data-Extraction Empirical Download Paper Georgi Ganev, UCL
Tight Auditing of Differentially Private Machine Learning
Milad Nasr, Jamie Hayes, Thomas Steinke, Borja Balle, Florian Tramèr, Matthew Jagielski, Nicholas Carlini, Andreas Terzis
 2023 Image Predictive-Model Membership-Inference Empirical Download Paper Georgi Ganev, UCL
On utility and privacy in synthetic genomic data
Bristena Oprisanu, Georgi Ganev, Emiliano De Cristofaro
 2022 Tabular Generative-Model Membership-Inference Empirical Download Paper Georgi Ganev, UCL
SoK: Security and Privacy in Machine Learning
Nicolas Papernot, Patrick McDaniel, Arunesh Sinha, Michael P. Wellman
 2018 NaN NaN NaN survey Download Paper Ilya Mironov, Meta
Scaling Up Membership Inference: When and How Attacks Succeed on Large Language Models
Haritz Puerto, Martin Gubri, Sangdoo Yun, Seong Joon Oh
 2024 Text Generative-Model Membership-Inference Empirical Download Paper
Knock Knock, Who's There? Membership Inference on Aggregate Location Data
Apostolos Pyrgelis, Carmela Troncoso, Emiliano de Cristofaro
 2017 Tabular Linear-Queries Membership-Inference Empirical Download Paper Ana-Maria Cretu, EPFL Yves-Alexandre de Montjoye, Imperial College
On the Difficulty of Membership Inference Attacks
Shahbaz Rezaei, Xin Liu
 2021 Image Predictive-Model Membership-Inference Empirical Download Code Paper
SoK: Let the Privacy Games Begin! A Unified Treatment of Data Inference Privacy in Machine Learning
Ahmed Salem, Giovanni Cherubin, David Evans, Boris Köpf, Andrew Paverd, Anshuman Suri, Shruti Tople, Santiago Zanella-Béguelin
 2023 NaN NaN NaN Theoretical Download Paper Ilya Mironov, Meta
Updates-leak: Data set inference and reconstruction attacks in online learning
Ahmed Salem, Apratim Bhattacharya, Michael Backes, Mario Fritz, Yang Zhang
 2020 Image Predictive-Model Reconstruction Empirical Download Paper Georgi Ganev, UCL
Detecting Pretraining Data from Large Language Models
Weijia Shi et al.
 2023 Text Generative-Model Membership-Inference Applications Download Code Paper Hamid Mozaffari, Oracle Labs
Shokri, R., Stronati, M., Song, C. and Shmatikov
Shokri, R., Stronati, M., Song, C. and Shmatikov
 2017 NaN NaN Membership-Inference Empirical Download Paper James Honaker, Anonym
Synthetic Data - Anonymisation Groundhog Day
Stadler et al.
 2022 Tabular Generative-Model Membership-Inference Empirical Download Paper Yves-Alexandre de Montjoye, Imperial College
Privacy Auditing with One (1) Training Run.
Steinke, T., Nasr, M. and Jagielski, M.
 2024 NaN NaN Membership-Inference Empirical Download Paper James Honaker, Anonym
QueryCheetah: Fast Automated Discovery of Attribute Inference Attacks Against Query-Based Systems
Bozhidar Stevanoski, Ana-Maria Cretu, Yves-Alexandre de Montjoye
 2024 Tabular Linear-Queries Attribute inference Empirical Download Code Paper Bozhidar Stevanoski, Imperial College London
Do Parameters Reveal More than Loss for Membership Inference?
Anshuman Suri, Xiao Zhang, David Evans
 2024 Tabular Predictive-Model Membership-Inference Theoretical Download Code Paper Anshuman Suri, UVA
Debugging Differential Privacy: A Case Study for Privacy Auditing
Florian Tramer, Andreas Terzis, Thomas Steinke, Shuang Song, Matthew Jagielski, Nicholas Carlini
 2022 Image Predictive-Model Information Leakage Empirical Download Paper Georgi Ganev, UCL
Demystifying Membership Inference Attacks in Machine Learning as a Service
Stacey Truex, Ling Liu, Mehmet Emre Gursoy, Lei Yu, and Wenqi Wei
 2021 Image, tabular Predictive-Model Membership-Inference Empirical Download Paper Ilya Mironov, Meta
Beyond Gradients: Exploiting Adversarial Priors in Model Inversion Attacks
Dmitrii Usynin, Daniel Rueckert, Georgios Kaissis
 2023 Image Predictive-Model Reconstruction Empirical Download Paper Dmitrii Usynin, TUM/Imperial College London
Technical privacy metrics: a systematic survey.
Wagner, I. and Eckhoff, D.
 Tabular Linear-Queries Information Leakage Theoretical Paper James Honaker, Anonym
Curator Attack: When Blackbox Differential Privacy Auditing Loses Its Power
Shiming Wang, Liyao Xiang, Bowei Cheng, Zhe Ji, Tianran Sun, Xinbing Wang
 2024 Tabular Predictive-Model Information Leakage Empirical Download Code Paper Yash Maurya, Independent Researcher
On the Importance of Difficulty Calibration in Membership Inference Attacks
Lauren Watson, Chuan Guo, Graham Cormode, Alex Sablayrolles
 2022 Image, tabular Predictive-Model Membership-Inference Empirical Download Code Paper Ilya Mironov, Meta
Fishing for User Data in Large-Batch Federated Learning via Gradient Magnification
Yuxin Wen, Jonas Geiping, Liam Fowl, Micah Goldblum, Tom Goldstein
 2022 Image Predictive-Model Reconstruction Empirical Download Code Paper Dmitrii Usynin, TUM/Imperial College London
You only query once: an efficient label-only membership inference attack
Yutong Wu, Han Qiu, Shangwei Guo, Jiwei Li, Tianwei Zhang
 Image Predictive-Model Membership-Inference Empirical Download Code Paper Johan Östman, AI Sweden
DeSIA: Attribute Inference Attacks Against Limited Fixed Aggregate Statistics
Yifeng Mao*, Bozhidar Stevanoski*, Yves-Alexandre de Montjoye
 2025 Tabular Linear queries Attribute inference attack Empirical Download Paper Bozhidar Stevanoski, Imperial College London
Enhanced Membership Inference Attacks against Machine Learning Models
Jiayuan Ye, Aadyaa Maddi, Sasi Kumar Murakonda, Vincent Bindschaedler, Reza Shokri
 2022 Tabular Predictive-Model Membership-Inference Empirical Download Paper
Privacy Risk in Machine Learning: Analyzing the Connection to Overfitting
Samuel Yeom; Irene Giacomelli; Matt Fredrikson; Somesh Jha
 2018 Text Generative-Model Membership-Inference Empirical Download Paper Daniil Filienko, University of Washington
See Through Gradients: Image Batch Recovery via GradInversion
Hongxu Yin, Arun Mallya, Arash Vahdat, Jose M. Alvarez, Jan Kautz, Pavlo Molchanov
 2021 Image Predictive-Model Reconstruction Empirical Download Code Paper Dmitrii Usynin, TUM/Imperial College London
Bayesian Estimation of Differential Privacy
Santiago Zanella-Béguelin, Lukas Wutschitz, Shruti Tople, Ahmed Salem, Victor Rühle, Andrew Paverd, Mohammad Naseri, Boris Köpf, Daniel Jones
 2023 Image Predictive-Model Information Leakage Empirical Download Paper Georgi Ganev, UCL
Low-Cost High-Power Membership Inference Attacks
Sajjad Zarifzadeh, Philippe Liu, Reza Shokri
 2024 Tabular Predictive-Model Membership-Inference Empirical Download Code Paper Luca Melis, Meta
Min-K%++: Improved Baseline for Detecting Pre-Training Data from Large Language Models
Jingyang Zhang et al.
2024 Text Generative-Model Membership-Inference Applications Download Code Paper Hamid Mozaffari, Oracle Labs 
<div class="side-panel">
    <div class="side-panel-content" id="attack-details">
    </div>
</div>