This paper illustrates the architecture and training of Unipa-GPT, a chatbot relying on a Large Language Model, developed for assisting students in choosing a bachelor/master degree course at the University of Palermo. Unipa-GPT relies on gpt-3.5-turbo, it was presented in the context of the European Researchers’ Night (SHARPER night). In our experiments we adopted both the Retrieval Augmented Generation (RAG) approach and fine-tuning to develop the system. The whole architecture of Unipa-GPT is presented, both the RAG and the fine-tuned systems are compared, and a brief discussion on their performance is reported. Further comparison with other Large Language Models and the experimental results during the SHARPER night are illustrated. Corpora and code are available on GitHub.

Siragusa, I., Pirrone, R. (2024). Unipa-GPT: Large Language Models for university-oriented QA in Italian. IJCOL, 10, 107-130 [10.17454/IJCOL102.06].

Unipa-GPT: Large Language Models for university-oriented QA in Italian

Irene Siragusa
Primo
;
Roberto Pirrone
Secondo
2024-12-01

Abstract

This paper illustrates the architecture and training of Unipa-GPT, a chatbot relying on a Large Language Model, developed for assisting students in choosing a bachelor/master degree course at the University of Palermo. Unipa-GPT relies on gpt-3.5-turbo, it was presented in the context of the European Researchers’ Night (SHARPER night). In our experiments we adopted both the Retrieval Augmented Generation (RAG) approach and fine-tuning to develop the system. The whole architecture of Unipa-GPT is presented, both the RAG and the fine-tuned systems are compared, and a brief discussion on their performance is reported. Further comparison with other Large Language Models and the experimental results during the SHARPER night are illustrated. Corpora and code are available on GitHub.
dic-2024
Siragusa, I., Pirrone, R. (2024). Unipa-GPT: Large Language Models for university-oriented QA in Italian. IJCOL, 10, 107-130 [10.17454/IJCOL102.06].
File in questo prodotto:
File Dimensione Formato  
ijcol-unipa-gpt.pdf

Solo gestori archvio

Tipologia: Versione Editoriale
Dimensione 791.99 kB
Formato Adobe PDF
791.99 kB Adobe PDF   Visualizza/Apri   Richiedi una copia
ijcol-1476.pdf

accesso aperto

Tipologia: Versione Editoriale
Dimensione 437.89 kB
Formato Adobe PDF
437.89 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10447/703120
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact