This thesis responds to these challenges by contributing to the development of forensic systems capable of operating effectively in uncontrolled environments, commonly referred to as ”in the wild”. The initial focus is on tackling the dataset mismatch problem, wherein test samples undergo post-processing pipelines or generated by new generative AI tools distinct from those encountered during system training. We introduce a Siamese network for detecting AI-synthetic images and a hybrid architecture, enhancing generalization and robustness against image processing operations. In the second part, we focus on the open-set scenario, devising solutions for synthetic image attribution and facial attribute classification. We develop classifiers with a rejection option, employing hybrid architectures and novel frameworks alongside a verification approach leveraging contrastive learning. These contributions fortify image authentication in uncontrolled environments, mitigating risks of fraud and disinformation.
Detection and Attribution of AI-generated Images in the Wild
WANG, JUN
2024
Abstract
This thesis responds to these challenges by contributing to the development of forensic systems capable of operating effectively in uncontrolled environments, commonly referred to as ”in the wild”. The initial focus is on tackling the dataset mismatch problem, wherein test samples undergo post-processing pipelines or generated by new generative AI tools distinct from those encountered during system training. We introduce a Siamese network for detecting AI-synthetic images and a hybrid architecture, enhancing generalization and robustness against image processing operations. In the second part, we focus on the open-set scenario, devising solutions for synthetic image attribution and facial attribute classification. We develop classifiers with a rejection option, employing hybrid architectures and novel frameworks alongside a verification approach leveraging contrastive learning. These contributions fortify image authentication in uncontrolled environments, mitigating risks of fraud and disinformation.File | Dimensione | Formato | |
---|---|---|---|
phd_unisi_102607.pdf
accesso aperto
Dimensione
70.06 MB
Formato
Adobe PDF
|
70.06 MB | Adobe PDF | Visualizza/Apri |
I documenti in UNITESI sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
https://hdl.handle.net/20.500.14242/158412
URN:NBN:IT:UNISI-158412