This paper presents a historical conversational agent embodying Carlo Pisacane. Conversational agents based on Large Language Models offer new opportunities for education and cultural heritage. However, they suffer from inaccuracies and temporal inconsistencies. To address this, we adopt a Retrieval-Augmented Generation (RAG) approach that grounds responses in a historical documentary corpus. We propose a framework combining document grounding, temporal constraints, and persona modeling. Multiple language models were tested to evaluate narrative coherence, historical accuracy, and mitigation of hallucinations. Results show that medium-sized models provide the best trade-off between generative quality and factual fidelity. A user study (n=52) reports high usability, engagement, and educational value. These findings demonstrate the potential of RAG-based historical agents to enhance learning and cultural engagement.

Design and Evaluation of a Historical Conversational Agent Embodying Carlo Pisacane

Clarizia, Fabio
;
Esposito, Pasquale;Loffredo, Rocco
2026

Abstract

This paper presents a historical conversational agent embodying Carlo Pisacane. Conversational agents based on Large Language Models offer new opportunities for education and cultural heritage. However, they suffer from inaccuracies and temporal inconsistencies. To address this, we adopt a Retrieval-Augmented Generation (RAG) approach that grounds responses in a historical documentary corpus. We propose a framework combining document grounding, temporal constraints, and persona modeling. Multiple language models were tested to evaluate narrative coherence, historical accuracy, and mitigation of hallucinations. Results show that medium-sized models provide the best trade-off between generative quality and factual fidelity. A user study (n=52) reports high usability, engagement, and educational value. These findings demonstrate the potential of RAG-based historical agents to enhance learning and cultural engagement.
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11386/4956736
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact