Real-time Facial Expression Recognition to Track Non-verbal Behaviors as Lie Indicators During Interview

Authors

  • Arif Budi Setiawan Universitas Ahmad Dahlan
  • Kaspul Anwar Universitas Ahmad Dahlan
  • Laelatul Azizah Universitas Ahmad Dahlan
  • Adhi Prahara Universitas Ahmad Dahlan

DOI:

https://doi.org/10.31763/simple.v1i1.144

Keywords:

Lie detector, Facial expression, Nonverbal behaviors, Facial landmark, Face detection

Abstract

During interview, a psychologist should pay attention to every gesture and response, both verbal and nonverbal language/behaviors, made by the client. Psychologist certainly has limitation in recognizing every gesture and response that indicates a lie, especially in interpreting nonverbal behaviors that usually occurs in a short time. In this research, a real time facial expression recognition is proposed to track nonverbal behaviors to help psychologist keep informed about the change of facial expression that indicate a lie. The method tracks eye gaze, wrinkles on the forehead, and false smile using combination of face detection and facial landmark recognition to find the facial features and image processing method to track the nonverbal behaviors in facial features. Every nonverbal behavior is recorded and logged according to the video timeline to assist the psychologist analyze the behavior of the client. The result of tracking nonverbal behaviors of face is accurate and expected to be useful assistant for the psychologists.

Downloads

Published

2019-03-31

How to Cite

Setiawan, A. B., Anwar, K., Azizah, L., & Prahara, A. (2019). Real-time Facial Expression Recognition to Track Non-verbal Behaviors as Lie Indicators During Interview. Signal and Image Processing Letters, 1(1), 25–31. https://doi.org/10.31763/simple.v1i1.144

Issue

Section

Image Processing