| Method | Clean Acc (%) | PGD-10 Acc (%) | PGD-20 Acc (%) | PGD-50 Acc (%) | AA Acc (%) | CR Acc (%) | Training Time (s) | Memory (GB) |
|---|
A Comprehensive Framework for Fair Evaluation of Fast Adversarial Training Methods
The FastAT Benchmark provides a rigorous and fair evaluation framework for fast adversarial training methods. Unlike public leaderboards that allow diverse combinations of model architectures, data sources, and computational budgets, our benchmark establishes conditions where all methods compete on equal footing.
This platform implements over a dozen representative FastAT methods with a unified codebase, ensuring fair and reproducible comparison across different algorithmic innovations. The benchmark systematically removes advantages from massive computational resources and unlimited external data, providing the research community with a transparent baseline for evaluating fast adversarial training techniques.
All methods are evaluated on identical network structures, eliminating performance differences arising from architectural advantages rather than training procedures.
Consistent training schedules, optimizers, learning rate policies, and data augmentation strategies prevent the experimental setup from favoring any particular method.
Strict prohibition of using additional or synthetic data beyond the original benchmark training set ensures observed gains stem solely from the learning algorithm.
Evaluates both robustness performance (accuracy against strong attacks) and computational cost (GPU hours and memory footprint).
Includes diverse attack methods: PGD with varying iterations, AutoAttack, and CR Attack for thorough robustness assessment.
Re-implemented over a dozen FastAT methods with a common interface for data loading, model initialization, training loops, and evaluation protocols.
ICLR 2020
NeurIPS 2020
NeurIPS 2019
ECCV 2022
ICCV 2023
ICCV 2023
ECCV 2024
AAAI 2021
NeurIPS 2021
NeurIPS 2022
ISWA 2023
NeurIPS 2020
NeurIPS 2023
ICLR 2024
ICLR 2015
ICLR 2018
UAI 2018
AAAI 2023
AAAI 2023
AAAI 2023
ICCV 2025
| Method | Clean Acc (%) | PGD-10 Acc (%) | PGD-20 Acc (%) | PGD-50 Acc (%) | AA Acc (%) | CR Acc (%) | Training Time (s) | Memory (GB) |
|---|