Large Language Models (LLMs) are increasingly integrated into educational contexts due to their ability to process and generate text through prompt-based instructions. Their adoption enables personalized learning and automated assessment, but also raises concerns about accuracy, bias, and responsible use. In this work, we present CLUE LMS, a Learning Management System that combines standard functionalities, such as access to teaching materials and tests, with LLM-based features. Specifically, the system includes a conversational agent for topic clarification and automatic generation of self-assessment quizzes, both grounded in the teacher-provided materials. The architecture integrates Retrieval-Augmented Generation (RAG) to ensure that generated content remains consistent with course content. To assess its potential, we conducted a user study with four participants. Based on the preliminary results, CLUE LMS is simple to use and effectively supports learning, with the quiz generation feature being the most appreciated. These findings suggest that LLM-based tools, when properly constrained and aligned with educational material, can enhance learning while mitigating common risks associated with generative AI in academic settings.

Quiz Generation and Chat Interaction with LLMs: A Design and Implementation of an AI-Based LMS

Costagliola G.;De Rosa M.;Fuccella V.;Piscitelli A.;Tabari P.
2025

Abstract

Large Language Models (LLMs) are increasingly integrated into educational contexts due to their ability to process and generate text through prompt-based instructions. Their adoption enables personalized learning and automated assessment, but also raises concerns about accuracy, bias, and responsible use. In this work, we present CLUE LMS, a Learning Management System that combines standard functionalities, such as access to teaching materials and tests, with LLM-based features. Specifically, the system includes a conversational agent for topic clarification and automatic generation of self-assessment quizzes, both grounded in the teacher-provided materials. The architecture integrates Retrieval-Augmented Generation (RAG) to ensure that generated content remains consistent with course content. To assess its potential, we conducted a user study with four participants. Based on the preliminary results, CLUE LMS is simple to use and effectively supports learning, with the quiz generation feature being the most appreciated. These findings suggest that LLM-based tools, when properly constrained and aligned with educational material, can enhance learning while mitigating common risks associated with generative AI in academic settings.
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11386/4952115
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact