This article advances a proposal for building up adjusted composite indicators of the quality of university courses from students’ assessments. The flexible framework of Generalized Item Response Models is adopted here for controlling the sources of heterogeneity in the data structure that make evaluations across courses not directly comparable. Specifically, it allows us to: jointly model students’ ratings to the set of items which define the quality of university courses; explicitly consider the dimensionality of the items composing the evaluation form; evaluate and remove the effect of potential confounding factors which may affect students’ evaluation; model the intra-cluster variability at course level. The approach simultaneously deals with: (i) multilevel data structure; (ii) multidimensional latent trait; (iii) personal explanatory latent regression models. The paper pays attention to the potential of such a flexible approach in the analysis of students evaluation of university courses in order to explore both how the quality of the different aspects (teaching, management, etc.) is perceived by students and how to make meaningful comparisons across them on the basis of adjusted indicators.

Sulis, I., & Capursi, V. (2013). Building up adjusted indicators of students' evaluation of university courses using generalized item response models. JOURNAL OF APPLIED STATISTICS, 40(1), 88-102 [10.1080/02664763.2012.734796].

Building up adjusted indicators of students' evaluation of university courses using generalized item response models

CAPURSI, Vincenza
2013

Abstract

This article advances a proposal for building up adjusted composite indicators of the quality of university courses from students’ assessments. The flexible framework of Generalized Item Response Models is adopted here for controlling the sources of heterogeneity in the data structure that make evaluations across courses not directly comparable. Specifically, it allows us to: jointly model students’ ratings to the set of items which define the quality of university courses; explicitly consider the dimensionality of the items composing the evaluation form; evaluate and remove the effect of potential confounding factors which may affect students’ evaluation; model the intra-cluster variability at course level. The approach simultaneously deals with: (i) multilevel data structure; (ii) multidimensional latent trait; (iii) personal explanatory latent regression models. The paper pays attention to the potential of such a flexible approach in the analysis of students evaluation of university courses in order to explore both how the quality of the different aspects (teaching, management, etc.) is perceived by students and how to make meaningful comparisons across them on the basis of adjusted indicators.
Settore SECS-S/01 - Statistica
Settore SECS-S/05 - Statistica Sociale
Sulis, I., & Capursi, V. (2013). Building up adjusted indicators of students' evaluation of university courses using generalized item response models. JOURNAL OF APPLIED STATISTICS, 40(1), 88-102 [10.1080/02664763.2012.734796].
File in questo prodotto:
File Dimensione Formato  
SULIS-CAPURSI.pdf

non disponibili

Dimensione 410.59 kB
Formato Adobe PDF
410.59 kB Adobe PDF   Visualizza/Apri   Richiedi una copia

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/10447/68597
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 6
  • ???jsp.display-item.citation.isi??? 6
social impact