Multimodal federated learning (MFL) enables privacy-preserving collaborative training across distributed clients with heterogeneous data modalities by leveraging cross-modal representation alignment and fusion to integrate modality-specific information from the same physical process. However, these mechanisms are also prone to emerging security vulnerabilities, which can be exploited to implant stealthy backdoors into the global model. Existing attack methods either focus on unimodal settings or rely on input-level triggers, overlooking coordinated cross-modal backdoors in MFL environments. To address this gap, we introduce an attack model named CMBA that implants a coordinated cross-modal multi-level backdoor attack by manipulating multiple learning components, including the classification objective, representation alignment, and latent structure. This design allows the backdoor to remain semantically consistent across modalities while manipulating the underlying multimodal representation space, enabling the attack to persist under federated aggregation.

Cross-Modal Multi-Level Backdoor Poisioning in Multimodal Federated Learning

Ibrar, Kainat
;
Palmieri, Francesco
2027

Abstract

Multimodal federated learning (MFL) enables privacy-preserving collaborative training across distributed clients with heterogeneous data modalities by leveraging cross-modal representation alignment and fusion to integrate modality-specific information from the same physical process. However, these mechanisms are also prone to emerging security vulnerabilities, which can be exploited to implant stealthy backdoors into the global model. Existing attack methods either focus on unimodal settings or rely on input-level triggers, overlooking coordinated cross-modal backdoors in MFL environments. To address this gap, we introduce an attack model named CMBA that implants a coordinated cross-modal multi-level backdoor attack by manipulating multiple learning components, including the classification objective, representation alignment, and latent structure. This design allows the backdoor to remain semantically consistent across modalities while manipulating the underlying multimodal representation space, enabling the attack to persist under federated aggregation.
2027
9783032295606
9783032295613
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11386/4968175
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact