Skip to content

Latest commit

 

History

27 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Adversarial Defense Methods Banner

🛡️ Adversarial Defense Methods

The World's Most Comprehensive Archive of Adversarial Machine Learning Research

Papers Years License Contributions Welcome


A meticulously curated, year-by-year directory of the highest-quality research papers in Adversarial ML, AI Security, Robustness, and Privacy — spanning from the foundational discoveries of 2013 to the cutting-edge LLM security research of 2026.


Explore Papers · Taxonomy · How to Use · Contribute


🌟 Why This Repository?

Traditional paper lists are flat, unsorted, and overwhelming. This repository is different. Every single paper has its own dedicated file containing a BibTeX citation, a concise Motivation (why the research matters), a clear Contribution (what's novel), and a Summary — making it the fastest way to navigate 14 years of adversarial ML research.


🗺️ Research Taxonomy

The following flowchart illustrates how the field of Adversarial Machine Learning is organized within this repository:

graph TD
    A["🛡️ Adversarial Machine Learning"] --> B["⚔️ Attack Methods"]
    A --> C["🔒 Defense Methods"]
    A --> D["📊 Surveys & Overviews"]
    A --> E["🔗 Related Fields"]

    B --> B1["White-box Attacks"]
    B --> B2["Black-box Attacks"]
    B --> B3["Physical Attacks"]
    B --> B4["Poisoning & Backdoors"]
    B --> B5["LLM Jailbreaks & Prompt Injection"]

    C --> C1["Adversarial Training"]
    C --> C2["Certified Robustness"]
    C --> C3["Adversarial Purification"]
    C --> C4["LLM Alignment & Guardrails"]

    D --> D1["Comprehensive Surveys"]
    D --> D2["Benchmarks & Evaluations"]

    E --> E1["Interpretability & Explainability"]
    E --> E2["Deepfakes & Generative AI Security"]
    E --> E3["Federated Learning Privacy"]
    E --> E4["Dataset Distillation"]

    style A fill:#6C3483,stroke:#5B2C6F,color:#FFFFFF,stroke-width:3px
    style B fill:#E74C3C,stroke:#C0392B,color:#FFFFFF,stroke-width:2px
    style C fill:#2ECC71,stroke:#27AE60,color:#FFFFFF,stroke-width:2px
    style D fill:#3498DB,stroke:#2980B9,color:#FFFFFF,stroke-width:2px
    style E fill:#F39C12,stroke:#E67E22,color:#FFFFFF,stroke-width:2px
Loading

🏆 Start Here: The Top 10 Must-Read Papers

If you are new to Adversarial Machine Learning, the 400+ papers in this repository can be overwhelming. We have curated the Top 10 most influential papers in the history of the field. Each paper has a dedicated, humanized summary explaining exactly why you need to read it and what it contributed.

  1. Intriguing properties of neural networks (Szegedy et al., 2013) - The discovery of adversarial examples.
  2. Explaining and Harnessing Adversarial Examples (Goodfellow et al., 2014) - The invention of FGSM.
  3. Towards Evaluating the Robustness of Neural Networks (Carlini & Wagner, 2017) - The ultimate attack benchmark.
  4. Towards Deep Learning Models Resistant to Adversarial Attacks (Madry et al., 2017) - PGD-based adversarial training.
  5. Obfuscated Gradients Give a False Sense of Security (Athalye et al., 2018) - Breaking flawed defenses.
  6. Certified Adversarial Robustness via Randomized Smoothing (Cohen et al., 2019) - Provable mathematical guarantees.
  7. Adversarial Examples Improve Image Recognition (Xie et al., 2020) - Using attacks to improve clean accuracy.
  8. Universal and Transferable Adversarial Attacks on Aligned Language Models (Zou et al., 2023) - The breakthrough LLM jailbreak (GCG).
  9. Nightshade: Prompt-Specific Poisoning Attacks on Text-to-Image Generative Models (Shan et al., 2024) - Using poisoning to protect artist copyrights.
  10. Systematization of Agentic LLM Defenses (2026) - Securing autonomous AI agents.

📚 Browse by Year

Click on any year below to explore the full, categorized list of papers and their individual summaries:

Era Years Focus
🌱 Foundation 2013 · 2014 · 2015 Discovery of adversarial examples, FGSM, early defenses
🔬 Expansion 2016 · 2017 · 2018 C&W attack, PGD adversarial training, certified robustness
🚀 Maturity 2019 · 2020 · 2021 AutoAttack, AdvProp, robustness benchmarks, neural ODE defenses
🧠 Generative AI 2022 · 2023 · 2024 LLM jailbreaks, diffusion model attacks, prompt injection, RAG poisoning
🔮 Frontier 2025 · 2026 Agentic AI attacks, post-quantum adversarial ML, self-healing models

📈 Evolution of the Field

The following diagram traces the landmark papers and paradigm shifts across the history of adversarial ML:

timeline
    title Timeline of Adversarial Machine Learning Breakthroughs
    2013 : Szegedy et al. discover adversarial examples
    2014 : Intriguing Properties of Neural Networks (ICLR)
    2015 : FGSM introduced by Goodfellow et al.
    2016 : Adversarial training at scale begins
    2017 : Carlini & Wagner attack breaks all defenses
         : Ensemble adversarial training proposed
    2018 : Madry PGD-based adversarial training (ICLR)
         : Obfuscated gradients exposed (ICML)
    2019 : Certified defenses via randomized smoothing
         : Adversarial robustness as a prior
    2020 : AdvProp - adversarial examples improve accuracy (CVPR)
         : AutoAttack benchmark established
    2021 : Vision Transformers meet adversarial robustness
         : Neural ODE-based defenses
    2022 : Diffusion model purification defenses
         : First LLM prompt injection attacks
    2023 : GCG universal jailbreak (NeurIPS)
         : SmoothLLM defense (NeurIPS)
         : Glaze artist protection (USENIX)
    2024 : Nightshade data poisoning (IEEE S&P)
         : Llama Guard (ICML)
         : Multi-modal jailbreaks (CVPR)
    2025 : Agentic AI jailbreaks emerge
         : Constitutional AI defenses
         : Spatial computing attacks
    2026 : Post-quantum adversarial ML
         : Self-healing AI models
         : Agent-to-agent attacks
Loading

🧬 Attack vs. Defense Arms Race

graph LR
    subgraph "⚔️ Attack Evolution"
        direction TB
        A1["FGSM (2015)"] --> A2["PGD (2018)"]
        A2 --> A3["AutoAttack (2020)"]
        A3 --> A4["GCG Jailbreak (2023)"]
        A4 --> A5["Agentic Attacks (2025)"]
    end

    subgraph "🛡️ Defense Evolution"
        direction TB
        D1["Adversarial Training (2015)"] --> D2["PGD-AT (2018)"]
        D2 --> D3["Certified Robustness (2019)"]
        D3 --> D4["Diffusion Purification (2022)"]
        D4 --> D5["LLM Guardrails (2024)"]
    end

    A1 -.->|"breaks"| D1
    A2 -.->|"breaks"| D1
    D2 -.->|"defends"| A2
    A3 -.->|"evaluates"| D2
    A4 -.->|"breaks"| D4
    D5 -.->|"defends"| A4

    style A1 fill:#E74C3C,stroke:#C0392B,color:#fff
    style A2 fill:#E74C3C,stroke:#C0392B,color:#fff
    style A3 fill:#E74C3C,stroke:#C0392B,color:#fff
    style A4 fill:#E74C3C,stroke:#C0392B,color:#fff
    style A5 fill:#E74C3C,stroke:#C0392B,color:#fff
    style D1 fill:#2ECC71,stroke:#27AE60,color:#fff
    style D2 fill:#2ECC71,stroke:#27AE60,color:#fff
    style D3 fill:#2ECC71,stroke:#27AE60,color:#fff
    style D4 fill:#2ECC71,stroke:#27AE60,color:#fff
    style D5 fill:#2ECC71,stroke:#27AE60,color:#fff
Loading

📂 Repository Structure

adversarial-defense-methods/
│
├── 📁 2013/                          # Foundation era
│   ├── README.md                     # Year overview & paper index
│   └── [Paper_Title].md              # Individual paper summaries
│
├── 📁 2014/
│   ├── README.md
│   ├── Intriguing_properties_of_neural_networks.md
│   └── ...
│
├── 📁 2015/
│   ├── README.md
│   ├── Explaining_and_Harnessing_Adversarial_Examples.md
│   └── ...
│
│   ... (2016 through 2022)
│
├── 📁 2023/                          # LLM jailbreak era begins
│   ├── README.md
│   ├── universal_and_transferable_adversarial_attacks_on_aligned_language_models_gcg.md
│   └── ...
│
├── 📁 2024/                          # Multi-modal attacks
│   ├── README.md
│   ├── nightshade_prompt_specific_poisoning_attacks_on_text_to_image_generative_models.md
│   └── ...
│
├── 📁 2025/                          # Agentic AI security
│   ├── README.md
│   └── ...
│
├── 📁 2026/                          # Frontier research
│   ├── README.md
│   └── ...
│
├── 📁 asset/                         # Repository assets
├── 📁 pics/                          # Diagrams and figures
├── README.md                         # ← You are here
├── LICENSE
└── .gitattributes

📖 How to Use This Repository

flowchart LR
    A["🔍 Pick a Year"] --> B["📂 Open Year Folder"]
    B --> C["📋 Read README.md\n(Full Paper Index)"]
    C --> D["📄 Click a Paper"]
    D --> E["📝 Read Summary\n+ Motivation\n+ Contribution"]
    E --> F["🔗 Follow Links\nto arXiv / GitHub"]
    
    style A fill:#6C3483,stroke:#5B2C6F,color:#fff
    style B fill:#3498DB,stroke:#2980B9,color:#fff
    style C fill:#2ECC71,stroke:#27AE60,color:#fff
    style D fill:#F39C12,stroke:#E67E22,color:#fff
    style E fill:#E74C3C,stroke:#C0392B,color:#fff
    style F fill:#1ABC9C,stroke:#16A085,color:#fff
Loading

For Researchers

  1. Navigate to the year folder relevant to your research.
  2. Browse the README.md for a categorized overview of all papers.
  3. Click into any individual paper file for the full summary, motivation, contribution, and citation.
  4. Copy the BibTeX block directly into your LaTeX document.

For Students

  1. Start with the Foundation era (2013–2015) to understand the origins.
  2. Follow the timeline to see how attacks and defenses co-evolved.
  3. Use the taxonomy flowchart above to find papers in your area of interest.

For Engineers & Practitioners

  1. Jump to the Defense Methods sections in recent years (2023–2026).
  2. Follow GitHub links in each paper file to find open-source implementations.
  3. Focus on Certified Robustness papers if you need provable guarantees.

🏛️ Venue Coverage

This repository exclusively indexes papers from the world's top-tier venues:

Category Venues
Machine Learning NeurIPS · ICML · ICLR
Computer Vision CVPR · ICCV · ECCV
AI General AAAI · IJCAI
Security IEEE S&P · USENIX Security · ACM CCS · NDSS
Journals IEEE TPAMI · ACM Computing Surveys · TNNLS

🤝 Contributing

Contributions are highly welcome! If you know of a high-impact paper that is missing from this archive, please:

  1. Fork this repository.

  2. Create a new .md file in the appropriate year folder using the standard template:

    ```bibtex
    @inproceedings{...}

    Motivation

    • ...

    Contribution

    • ...

    Summary

    ...

    Links

  3. Submit a Pull Request with a clear description of the paper and why it meets the quality threshold.


⚖️ Legal & Ethical Notice

This repository is a curated bibliography and research guide. It does not host, distribute, or reproduce any copyrighted material (such as PDFs or full-text articles). This repository is intended for educational and research purposes and only includes bibliographic metadata, contributor-written summaries, and links to official sources.


📊 Repository Statistics

pie title Papers by Research Category
    "Attack Methods" : 45
    "Defense Methods" : 30
    "Surveys & Overviews" : 10
    "Related Fields" : 15
Loading

⭐ Star History

If this repository helps your research, please consider giving it a ⭐ — it helps others discover it too!



Built with ❤️ by Dev Chiniwala

Curating the world's most comprehensive adversarial ML research archive, one paper at a time.


GitHub

About

A curated collection of adversarial machine learning attacks, defenses, papers, and robustness research.

Resources

Stars

2 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors