As security is emphasized inside and outside the vehicle, research on driver identification technology using bio-signals is being actively studied. The bio-signals acquired by the behavioral characteristics of the driver include artifacts generated according to the driving environment, which could potentially degrade the accuracy of the identification system. Existing driver identification systems either remove the normalization process of bio-signals in the preprocessing stage or use artifacts included in a single bio-signals, resulting in low identification accuracy. To solve these problems in a real situation, we propose a driver identification system that converts ECG and EMG signals obtained from different driving conditions into 2D spectrograms through multi-TF image and uses multi-stream CNN. The proposed system consists of a preprocessing phase of ECG and EMG signals, a multi-TF image conversion process, and a driver identification stage using a multi-stream-based CNN. Under all driving conditions, the driver identification system reached an average accuracy of 96.8% and an F1 score of 0.973, which overperformed the existing driver identification systems by more than 1%.

Multi-modal Biometrics Based Implicit Driver Identification System Using Multi-TF Images of ECG and EMG

Esposito, Christian;
2023-01-01

Abstract

As security is emphasized inside and outside the vehicle, research on driver identification technology using bio-signals is being actively studied. The bio-signals acquired by the behavioral characteristics of the driver include artifacts generated according to the driving environment, which could potentially degrade the accuracy of the identification system. Existing driver identification systems either remove the normalization process of bio-signals in the preprocessing stage or use artifacts included in a single bio-signals, resulting in low identification accuracy. To solve these problems in a real situation, we propose a driver identification system that converts ECG and EMG signals obtained from different driving conditions into 2D spectrograms through multi-TF image and uses multi-stream CNN. The proposed system consists of a preprocessing phase of ECG and EMG signals, a multi-TF image conversion process, and a driver identification stage using a multi-stream-based CNN. Under all driving conditions, the driver identification system reached an average accuracy of 96.8% and an F1 score of 0.973, which overperformed the existing driver identification systems by more than 1%.
2023
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11386/4833931
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? 0
  • Scopus 6
  • ???jsp.display-item.citation.isi??? 6
social impact