Awesome
Overview
Paper Title: Am I a Real or Fake Celebrity? Evaluating the Robustness of Commercial Celebrity Recognition Web Services with Deepfakes
Short Description: Testing commerical APIs against the threat of deepfakes using Deepfake Impersonation Attack.
Dataset Request Form: [Link]
Main Contributions
- Deepfake Impersonation Attack: We introduce a novel approach to deceive and evaluate commercial celebrity recognition web services against deepfakes emulating impersonation attacks.We also create two novel datasets, Celebrity First Order Motion(CelebFOM) and the Celebrity Blend (CelebBlend), for evaluation.
- Extensive Evaluation of Commercial Web APIs: We evaluate how popular major commercial celebrity recognition web APIs from Amazon, Microsoft, and Naver respond to celebrity deepfakes using four different metrics. We demonstrate that celebrity deepfakes fool all three APIs with an attack successrate of up to 78.0% and 99.9% on targeted and non-targeted attacks, respectively.
- Defense Mechanism We present a defense mechanism against the above mentioned deepfake attacks and show that even in the worst-case scenario, our proposed mechanism significantly decreases the original attack success rate from 99.8% to 0.1%.
Dataset Samples
-
FCelebDF (Ours) [Link]
-
Real Gal Gadot - Played Wonder Woman in 2010s Movies (Left) [just a refernce image]
-
Real Lynda Carter - Played Wonder Woman in 1970s TV series (Center-Left) [just a refernce image]
-
Fake Gal Gadot playing Wonder Woman in 1970s series (Center-Right) [Originally played by Lynda Carter]
-
Fake Lynda Carter playing Wonder Woman in 2017 Wonder Woman Movie (Right) [Originally played by Gal Gadot]
<img src="https://i.ibb.co/DKLXhWc/Gal-Gadot-Original.png" alt="Gal-Gadot-Original" border="0" width="200" height="200"><img src="https://i.ibb.co/D4QrQgK/linda-carter-org.png" alt="linda-carter-org" border="0" width="200" height="200"><img src="https://i.ibb.co/gzCcjvQ/Gal-Gadot-wonder-woman-70-s.png" alt="Gal-Gadot-wonder-woman-70-s" border="0" width="200" height="200"><img src="https://i.ibb.co/McSmhzL/linda-carter-new-wonder-woman.png" alt="linda-carter-new-wonder-woman" border="0" width="200" height="200">
-
-
CelebDF [Link]
- Real Emma Watson (Left)
- Fake Scarlett Johansson (Right)
<img src="https://i.ibb.co/ngQcXCr/Emma-Watson-real.png" alt="Emma-Watson-real" border="0" width="250"><img src="https://i.ibb.co/j4zz0Fh/Scarlett-Johansson-fake.png" alt="Scarlett-Johansson-fake" border="0" width="250">
-
CelebFOM (Ours) [Link] [To view the images in the link click on the image and then scroll down the page to view them]
- Real Gal Gadot (Left)
- Fake Gal Gadot (Right) [Reenacted using a real video of Eva Mendes]
<img src="https://i.ibb.co/5K6kSRj/Gal-Gadot-real.png" alt="Gal-Gadot-real" border="0" width="200" height="200"><img src="https://i.ibb.co/dWPNG8W/Eva-Mendes-fake.png" alt="Eva-Mendes-fake" border="0" width="200" height="200">
-
VoxCelebTH [Link]
- Real Chris Hemsworth (Left) [just a reference image]
- Fake Chris Hemsworth (Right) [Reenacted using an unknown video]
<img src="https://i.ibb.co/6tXkzpM/Chris-Hemsworth.jpg" alt="Chris-Hemsworth" border="0" width="200" height="200"><img src="https://i.ibb.co/L9dwGj6/0004325.jpg" alt="Chris-Hemsworth-Fake" border="0" width="200" height="200">
-
CelebBlend (Ours) [Link] [To view the images in the link click on the image and then scroll down the page to view them]
- Real Aamir Khan (Left)
- Real Donald Trump (Center-Left)
- Fake Aamir Khan blended with Donald Trump (Center-Right)
- Fake Donald Trump blended with Aamir Khan (Right)
<img src="https://i.ibb.co/7QhvB2G/Amir-Khan-Real-3.jpg" alt="Amir-Khan-Real" border="0" width="200" height="200"><img src="https://i.ibb.co/LdnX7Yx/Donald-Trump-Real.jpg" alt="Donald-Trump-Real" border="0" width="200" height="200"><img src="https://i.ibb.co/VMR9sht/Amir-Khan-Fake.jpg" alt="Amir-Khan-Fake" border="0" width="200" height="200"><img src="https://i.ibb.co/z2WbhZQ/Donald-Trump-Fake.jpg" alt="Donald-Trump-Fake" border="0" width="200" height="200">