An element of evaluation of the quality of university teaching

Authors

  • Gianluca Sbardella Facoltà di Scienze Matematiche, Fisiche e Naturali, Università di Roma "La Sapienza"
  • Francesco Sebastianelli Facoltà di Scienze Matematiche, Fisiche e Naturali, Università di Roma "La Sapienza"
  • Carlo Mariani Facoltà di Scienze Matematiche, Fisiche e Naturali, Università di Roma "La Sapienza" http://orcid.org/0000-0002-7979-1700
  • Vincenzo Nesi Facoltà di Scienze Matematiche, Fisiche e Naturali, Università di Roma "La Sapienza"
  • Andrea Pelissetto Facoltà di Scienze Matematiche, Fisiche e Naturali, Università di Roma "La Sapienza"

DOI:

https://doi.org/10.13130/2282-5398/6862

Abstract

For many years, Italian Universities have been committed to to collecting "assessment questionnaires" of the courses from their students. It is not fully clear how to manage these questionnaires, though. In the present work, we propose a method to single out significant information from the wide amount of issues raised by the students. With this work, we aim at improving the services offered by Universities. Human resources dedicated to the evaluation of teaching are definitely scarse, if not absent. Thus, we believe that coordination committees must focus on the most critical issues, rather than dispersing information.

In this work, we show how an almost automatic method allows to single out a very limited fraction (about 7% in the case of our Faculty of Sciences at Sapienza University in Rome) of really critical courses. Our political objective is to give a clear and objective answer to the students' request of improving those courses. With this approach we do not consider the students' opinions as absolute. We rather aim at respecting their implicit request of verification of their opinions.

Our approach also suggests some improvements in the formulation of the questions raised in the questionnaires, so as to reduce ambiguity and obtain a more accurate statistical treatment. In the example presented here, a very high appreciation of our courses emerges if we focus on the average values. However, a punctual control of opinions for a fraction of courses is indispensable. Technically, we use the so called trimming method to single out the problematic courses. This method, used in a variety of fields, helps to control for carelessness of some students who may not take the questionnaires seriously. In our case, for each course and for each question, we delete 50% of the questionnaires, namely those corresponding to 25% of the most positive and 25% of the most negative. Still, our analysis leads to very stable results, if we focus onthe most critical courses, which is the main objective of this work.

References

Greco Pietro, Silvestrini Vittorio (2009) “La risorsa Infinita. Per una società democratica della conoscenza”. Editori Riuniti

Greco Pietro, Silvestrini Vittorio (2010) “The never-ending resource. For a democratic society of knowledge”. CUEN, Naples.

Hastings Cecil, Mosteller Frederick, Tukey John W., Winsor Charles P. (1947) “Low moments for small samples: a comparative study of order statistics” The Annals of Mathematical Statistics, 18: 413-426

Tukey John W. (1962) “The future of data analysis” The Annals of Mathematical Statistics, 33:1-67

Tukey John W. (1977), “Exploratory Data Analysis” Pearson

Published

2016-05-04

Issue

Section

Note & Documentazione/Notes & Documents