IDRetracor: Towards Visual Forensics Against Malicious Face Swapping
The face swapping technique based on deepfake methods poses significant social risks to personal identity security. While numerous deepfake detection methods have been proposed as countermeasures against malicious face swapping, they can only output binary labels (Fake/Real) for distinguishing fake...
Gespeichert in:
Hauptverfasser: | , , , , , , |
---|---|
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The face swapping technique based on deepfake methods poses significant
social risks to personal identity security. While numerous deepfake detection
methods have been proposed as countermeasures against malicious face swapping,
they can only output binary labels (Fake/Real) for distinguishing fake content
without reliable and traceable evidence. To achieve visual forensics and target
face attribution, we propose a novel task named face retracing, which considers
retracing the original target face from the given fake one via inverse mapping.
Toward this goal, we propose an IDRetracor that can retrace arbitrary original
target identities from fake faces generated by multiple face swapping methods.
Specifically, we first adopt a mapping resolver to perceive the possible
solution space of the original target face for the inverse mappings. Then, we
propose mapping-aware convolutions to retrace the original target face from the
fake one. Such convolutions contain multiple kernels that can be combined under
the control of the mapping resolver to tackle different face swapping mappings
dynamically. Extensive experiments demonstrate that the IDRetracor exhibits
promising retracing performance from both quantitative and qualitative
perspectives. |
---|---|
DOI: | 10.48550/arxiv.2408.06635 |