Multimodal Deception Detection

This work proposes a new approach to deception detection, based on finding significant differences between liars and truth tellers through the analysis of their behavior, verbal and non-verbal. This is based on the combination of two factors: multimodal data collection, and t-pattern analysis. Multimodal approach has been acknowledged in literature about deception detection and on several studies concerning the understanding of any communicative phenomenon. We believe a methodology such as T-pattern analysis could be able to get the best advantages from an approach that combines data coming from multiple signaling systems. In fact, T-pattern analysis is a recent methodology for the analysis of behavior that unveil the complex structure at the basis of the organization of human behavior. For this work, we conducted an experimental study and analyzed data related to a single subject. Results showed how T-pattern analysis allowed to find differences between truth telling and lying. This work aims at making progress in the state of knowledge about deception detection, with the final goal to propose a useful tool for the improvement of public security and well-being.