This thesis responds to these challenges by contributing to the development of forensic systems capable of operating effectively in uncontrolled environments, commonly referred to as ”in the wild”. The initial focus is on tackling the dataset mismatch problem, wherein test samples undergo post-processing pipelines or generated by new generative AI tools distinct from those encountered during system training. We introduce a Siamese network for detecting AI-synthetic images and a hybrid architecture, enhancing generalization and robustness against image processing operations. In the second part, we focus on the open-set scenario, devising solutions for synthetic image attribution and facial attribute classification. We develop classifiers with a rejection option, employing hybrid architectures and novel frameworks alongside a verification approach leveraging contrastive learning. These contributions fortify image authentication in uncontrolled environments, mitigating risks of fraud and disinformation.

Detection and Attribution of AI-generated Images in the Wild

WANG, JUN
2024

Abstract

This thesis responds to these challenges by contributing to the development of forensic systems capable of operating effectively in uncontrolled environments, commonly referred to as ”in the wild”. The initial focus is on tackling the dataset mismatch problem, wherein test samples undergo post-processing pipelines or generated by new generative AI tools distinct from those encountered during system training. We introduce a Siamese network for detecting AI-synthetic images and a hybrid architecture, enhancing generalization and robustness against image processing operations. In the second part, we focus on the open-set scenario, devising solutions for synthetic image attribution and facial attribute classification. We develop classifiers with a rejection option, employing hybrid architectures and novel frameworks alongside a verification approach leveraging contrastive learning. These contributions fortify image authentication in uncontrolled environments, mitigating risks of fraud and disinformation.
22-lug-2024
Inglese
BARNI, MAURO
TONDI, BENEDETTA
Università degli Studi di Siena
File in questo prodotto:
File Dimensione Formato  
phd_unisi_102607.pdf

accesso aperto

Dimensione 70.06 MB
Formato Adobe PDF
70.06 MB Adobe PDF Visualizza/Apri

I documenti in UNITESI sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14242/158412
Il codice NBN di questa tesi è URN:NBN:IT:UNISI-158412