Fake Face Detection System Using MobileNets Architecture

Gabriel Indra Widi Tamtama, I Kadek Dendy Senapartha

Abstract


Sistem pengenalan wajah merupakan salah satu metode dalam teknik biometric yang menggunakan wajah untuk proses identifikasi atau verifikasi seseorang. Teknologi ini tidak memerlukan kontak fisik seperti verifikasi sidik jari dan diklaim lebih aman karena wajah setiap orang memiliki karakter yang berbeda-beda. Terdapat dua fase utama dalam sistem biometrik wajah, yaitu deteksi wajah palsu Presentation Attack (PA) detektor dan pengenalan wajah (face recognition). Penelitian ini melakukan eksperimen dengan tujuan membangun sebuah model pembelajaran mesin (machine learning) berbasis mobile untuk melakukan deteksi wajah palsu ataupun memverifikasi keaslian wajah dengan menggunakan arsitektur Mobilenets. Verifikasi keaslian wajah diperlukan untuk meningkatkan sistem pengenalan wajah sehingga bisa membedakan wajah palsu dengan asli. Wajah palsu bisa dihadirkan dengan menunjukkan rekaman video atau gambar wajah seseorang sehingga bisa memanipulasi sistem. Dengan adanya metode verifikasi wajah asli, maka keamanan sistem bisa ditingkatkan dan meminimalisir penyalahgunaan. Kami menggunakan tiga jenis dataset publik, yaitu Replay-Mobile, Record-MPAD, dan LLC-FSAD untuk bahan training terhadap model anti-spoof yang dibangun. Model anti-spoof wajah dibangun dengan menggunakan arsitektur MobilenetV2 dengan menambahkan 3 layer neural network yang digunakan sebagai layer klasifikasi. Kemudian pengujian secara terkontrol dilakukan dengan menggunakan program komputer menghasilkan nilai HTER 0.17. Sedangkan hasil pengujian secara tidak terkontrol menggunakan aplikasi prototipe Android menghasilkan nilai HTER sebesar 0.21. Hasil pengujian ini menghasilkan selisih nilai HTER sebesar 0.04 yang mengindikasikan bahwa model anti-spoof wajah akan memiliki performa yang cenderung menurun bila digunakan secara real.

 

The facial recognition system is a method in biometric techniques that use faces to identify or verify a person. This technology does not require physical contact such as fingerprint verification and is claimed to be safer because everyone's face has a different character. There are two main phases in the facial biometric system, namely fake face detection (Presentation Attack (PA) detector) and facial recognition. This study conducted experiments with the aim of building a mobile-based machine learning model to detect fake faces or verify facial authenticity using the MobileNets architecture. Verification of facial authenticity is needed to improve the facial recognition system so that it can distinguish fake faces from real ones. Fake faces can be presented by showing video recordings or pictures of someone's face so they can manipulate the system. The real-face verification method can improve system security and minimize misuse. We use three types of public datasets, namely Replay-Mobile, Record-MPAD, and LLC-FSAD for training materials for the built anti-spoof model. The facial anti-spoof model is built using the MobilenetV2 architecture by adding 3 neural network layers which are used as classification layers. Then controlled testing was carried out using a computer program to produce an HTER value of 0.17. While the results of uncontrolled testing using the Android prototype application produce an HTER value of 0.21. The results of this test produce a difference in the HTER value of 0.04, indicating that the facial anti-spoof model will have performance that tends to decrease when used in real terms.


Keywords


biometrics; fake face detection; facial recognition; machine learning; mobilenet

Full Text:

PDF

References


I. K. Dendy Senapartha and G. Indra Widi Tamtama, “Studi Literatur Presentation Attack dan Set Data Anti-Spoof Wajah,” J. Tek. Elektro, vol. 14, no. 1, p. 8, 2022, doi: https://doi.org/10.15294/jte.v14i1.36108.

C. Kong, S. Wang, and H. Li, “Digital and Physical Face Attacks: Reviewing and One Step Further.” arXiv, Sep. 29, 2022. Accessed: Oct. 26, 2022. [Online]. Available: http://arxiv.org/abs/2209.14692

Z. Yu, Y. Qin, X. Li, C. Zhao, Z. Lei, and G. Zhao, “Deep Learning for Face Anti-Spoofing: A Survey.” arXiv, May 16, 2022. doi: https://doi.org/10.48550/arXiv.2106.14948.

F. Zhuang et al., “A Comprehensive Survey on Transfer Learning.” arXiv, Jun. 23, 2020. doi: 10.48550/arXiv.1911.02685.

R. Hadiprakoso and I. Buana, “Deteksi Serangan Spoofing Wajah Menggunakan Convolutional Neural Network,” J. Tek. Inform. Dan Sist. …, no. Query date: 2023-06-14 05:44:29, 2021, [Online]. Available: http://114.7.153.31/index.php/jutisi/article/view/4001

G. Safri, D. Irawan, and R. Astutik, “Penerapan Liveness Sebagai Anti-Spoofing Citra Digital Pada Sistem Keamanan Akses Kontrol Ruang Server Berbasis Raspberry Pi,” E-Link J. Tek. Elektro Dan …, no. Query date: 2023-06-14 05:44:29, 2021, [Online]. Available: http://journal.umg.ac.id/index.php/e-link/article/view/3333

H. Agusti, “Pengenalan Wajah dengan Menggunakan Smartphone: Sistematik Review,” J. Forensik Dan Med. Indones., no. Query date: 2023-06-14 05:44:29, 2021, [Online]. Available: http://jos.unsoed.ac.id/index.php/jfmi/article/view/4528

M. Sandler, A. Howard, M. Zhu, A. Zhmoginov, and L.-C. Chen, “MobileNetV2: Inverted Residuals and Linear Bottlenecks.” arXiv, Mar. 21, 2019. Accessed: Sep. 22, 2022. [Online]. Available: http://arxiv.org/abs/1801.04381

L. Alzubaidi et al., “Review of deep learning: concepts, CNN architectures, challenges, applications, future directions,” J. Big Data, vol. 8, no. 1, p. 53, Mar. 2021, doi: 10.1186/s40537-021-00444-8.

Z. Ming, M. Visani, M. M. Luqman, and J.-C. Burie, “A Survey on Anti-Spoofing Methods for Face Recognition with RGB Cameras of Generic Consumer Devices.” arXiv, Oct. 08, 2020. Accessed: Jul. 20, 2022. [Online]. Available: http://arxiv.org/abs/2010.04145

A. Costa-Pazo, S. Bhattacharjee, E. Vazquez-Fernandez, and S. Marcel, “The Replay-Mobile Face Presentation-Attack Database,” in 2016 International Conference of the Biometrics Special Interest Group (BIOSIG), Darmstadt: IEEE, Sep. 2016, pp. 1–7. doi: 10.1109/BIOSIG.2016.7736936.

W. R. Almeida et al., “Detecting face presentation attacks in mobile devices with a patch-based CNN and a sensor-aware loss function,” PLOS ONE, vol. 15, no. 9, p. e0238058, Sep. 2020, doi: 10.1371/journal.pone.0238058.

D. Timoshenko, K. Simonchik, V. Shutov, P. Zhelezneva, and V. Grishkin, “Large Crowdcollected Facial Anti-Spoofing Dataset,” in 2019 Computer Science and Information Technologies (CSIT), Yerevan, Armenia: IEEE, Sep. 2019, pp. 123–126. doi: 10.1109/CSITechnol.2019.8895208.

C. Garbin, “Dropout vs. batch normalization: an empirical study of their impact to deep learning,” Multimed. Tools Appl., vol. 79, no. 19, pp. 12777–12815, 2020, doi: 10.1007/s11042-019-08453-9.

R. David et al., “TensorFlow Lite Micro: Embedded Machine Learning on TinyML Systems.” arXiv, Mar. 13, 2021. Accessed: Aug. 01, 2022. [Online]. Available: http://arxiv.org/abs/2010.08678




DOI: https://doi.org/10.24114/cess.v8i2.43762

Article Metrics

Abstract view : 161 times
PDF - 135 times

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

CESS (Journal of Computer Engineering, System and Science)

Creative Commons License
CESS (Journal of Computer Engineering, System and Science) is licensed under a Creative Commons Attribution 4.0 International License