α

Published on arXiv

2604.11487

Output Integrity Attack

OWASP ML Top 10 — ML09

Key Finding

20 teams submitted robust detection solutions evaluated across 42 generators and 36 image transformations representing real-world deployment scenarios


This paper presents an overview of the NTIRE 2026 Challenge on Robust AI-Generated Image Detection in the Wild, held in conjunction with the NTIRE workshop at CVPR 2026. The goal of this challenge was to develop detection models capable of distinguishing real images from generated ones in realistic scenarios: the images are often transformed (cropped, resized, compressed, blurred) for practical usage, and therefore, the detection models should be robust to such transformations. The challenge is based on a novel dataset consisting of 108,750 real and 185,750 AI-generated images from 42 generators comprising a large variety of open-source and closed-source models of various architectures, augmented with 36 image transformations. Methods were evaluated using ROC AUC on the full test set, including both transformed and untransformed images. A total of 511 participants registered, with 20 teams submitting valid final solutions. This report provides a comprehensive overview of the challenge, describes the proposed solutions, and can be used as a valuable reference for researchers and practitioners in increasing the robustness of the detection models to real-world transformations.


Key Contributions

  • Novel dataset of 294,500 images (108,750 real, 185,750 AI-generated) from 42 diverse generators with 36 realistic transformations
  • Benchmark challenge with 511 participants and 20 validated detection solutions evaluated on robustness to real-world image transformations
  • Comprehensive evaluation framework using ROC AUC on mixed transformed/untransformed test set for realistic detection scenarios

🛡️ Threat Analysis

Output Integrity Attack

Challenge focuses on AI-generated image detection (distinguishing real from synthetic images) and robustness to common transformations (compression, resizing, cropping) that could evade detection — core ML09 output integrity and content provenance task.


Details

Domains
visiongenerative
Model Types
diffusiongancnntransformer
Threat Tags
inference_timedigital
Datasets
NTIRE 2026 AI-Generated Image Detection Dataset
Applications
deepfake detectionsynthetic image detectioncontent authenticity verification