Abstract
Many universities conduct survey research in order to evaluate and improve quality of their education processes. Surprisingly, replacing traditional paper-based questionnaires with electronic ones usually decreases response rates and thus negatively affects overall reliability of results. In the paper, this issue is addressed and an effective approach to academic surveying is described, including a recommended strategy, matrix-based questionnaire representation, methods and technical framework for data handling. A crucial part of this method is the Survey Analyser – an innovative application, which automates the processing of questionnaire results using information extraction and transformation. The proposed surveying method and the corresponding software were successfully implemented into production environments at two universities, showing good performance based on real-life results.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
Response rate is the number of responders, who actually answered a survey, divided by the overall number of authorized participants.
- 2.
Including the reports described in Sect. 2.3.
References
Adams, M.J.D., Umbach, P.D.: Nonresponse and online student evaluations of teaching: understanding the influence of salience, fatigue, and academic environments. Res. High. Educ. 53(5), 576–591 (2012). https://doi.org/10.1007/s11162-011-9240-5
Bienkowska, A.: Teaching Quality Assurance in the Faculty of Computer Science and Management - A Report for the Academic Year 2014–2015. Wroclaw University of Technology, Wroclaw (2016). (in Polish)
Blair, E., Inniss, K.: Student evaluation questionnaires and the developing world: an examination of the move from a hard copy to online modality. Stud. Educ. Eval. 40, 36–42 (2014). https://doi.org/10.1016/j.stueduc.2014.01.001
Bootstrap Core Team: Bootstrap. https://getbootstrap.com
Cano-Hurtado, J.J., Carot-Sierra, J.M., Fernandez-Prada, M.A., Fargueta, F.: An Evaluation Model of the Teaching Activity of Academic Staff. Valencia University of Technology, Valencia (2009)
Ciesielski, P.: Remarks for Students’ Questionnaire Evaluation of Teaching. Jagiellonian University, Krakow (2012). (in Polish)
Cork, D.L., Cohen, M.L., Groves, R., Kalsbeek, W. (eds.): Survey Automation: Report and Workshop Proceedings. The National Academies Press, Washington, DC (2003). https://doi.org/10.17226/10695
Dudek, D.: Automated information extraction and classification of matrix-based questionnaire data. In: Swiatek, J., Tomczak, J.M. (eds.) Advances in Systems Science, Proceedings of the International Conference on Systems Science 2016 (ICSS 2016), Advances in Intelligent Systems and Computing, vol. 539, pp. 109–120. Springer, Heidelberg (2017). https://doi.org/10.1007/978-3-319-48944-5_11
Hazel, P.: PCRE – Perl Compatib. Regular Expressions (2018). http://www.pcre.org
Inter-University Computerization Center: USOS – University Study-Oriented System (2018). http://muci.edu.pl. (in Polish)
Izdebski, A., et al.: Report of the all-university teaching quality assessment survey. University of Warsaw, Poland (2015). (in Polish)
Kirchner, A., Norman, A.D.: Evaluation of electronic assessment systems within the USA and their ability to meet the National Council for Accreditation of Teacher Education (NCATE) Standard 2. Educ. Assess. Eval. Acc. 26(4), 393–407 (2014). https://doi.org/10.1007/s11092-014-9204-3
Leung, D.Y.P., Kember, D.: Comparability of data gathered from evaluation questionnaires on paper and through the internet. Res. High. Educ. 46(5), 571–591 (2005)
Mistry, R., Misner, S.: Introducing Microsoft SQL Server 2014: Technical Overview. Microsoft Press, Redmond (2014)
Moreno-Murcia, J.A., Torregrosa, Y.S., Pedreno, N.B.: Questionnaire evaluating teaching competencies in the university environment. Evaluation of teaching competencies in the university. New Approaches Educ. Res. 4(1), 54–61 (2015). https://doi.org/10.7821/naer.2015.1.106
Nikolaidis, Y., Dimitriadis, S.G.: On the student evaluation of university courses and faculty members’ teaching performance. Eur. J. Oper. Res. 238, 199–207 (2014). https://doi.org/10.1016/j.ejor.2014.03.018
Nulty, D.D.: The adequacy of response rates to online and paper surveys: what can be done? Assess. Eval. High. Educ. 33(3), 301–314 (2008)
Przybylski, W., Rudnicki, S., Szwed, A. (eds.): Evaluating Teaching Quality in Higher Education - Methods, Tools, Best Practice. Tischner European University, Krakow (2010). (in Polish)
Schmitz, C.: LimeSurvey: An Open Source Survey Tool. LimeSurvey Project Team, Hamburg, Germany (2018). https://www.limesurvey.org
Stein, S.J., Spiller, D., Terry, S., Harris, T., Deaker, L., Kennedy, J.: Tertiary teachers and student evaluations: never the twain shall meet? Assess. Eval. High. Educ. (2013). https://doi.org/10.1080/02602938.2013.767876
Stupans, I., McGuren, T., Babey, A.M.: Student evaluation of teaching: a study exploring student rating instrument free-form text comments. Innovative High. Educ. 41(1), 33–42 (2016). https://doi.org/10.1007/s10755-015-9328-5
Szaban, D., Kolodziej, T.: Report of academic teachers assessment 2016/2017. University of Zielona Gora, Poland (2017). (in Polish)
Tarasiuk, J.: Survey research in AGH - the system and sample results. The Fourth All-Poland Meeting of the Rectors’ Proxies for Education Quality, Wroclaw, Poland (2017). (in Polish)
The jQuery Foundation: jQuery. https://jquery.com
The PHP Group: PHP page. http://php.net
Thielsch, M.T., Brinkmoeller, B., Forthmann, B.: Reasons for responding in student evaluation of teaching. Stud. Educ. Eval. 56, 189–196 (2018). https://doi.org/10.1016/j.stueduc.2017.11.008
UMCS: Report of the evaluation survey of classes in the summer semester 2015–2016. Maria Curie-Sklodowska University, Lublin (2016). (in Polish)
Acknowledgments
The author wishes to thank the Karkonosze College in Jelenia Góra for sharing the results of survey research, which were presented in this paper.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Dudek, D. (2019). Survey Analyser: Effective Processing of Academic Questionnaire Data. In: Borzemski, L., Świątek, J., Wilimowska, Z. (eds) Information Systems Architecture and Technology: Proceedings of 39th International Conference on Information Systems Architecture and Technology – ISAT 2018. ISAT 2018. Advances in Intelligent Systems and Computing, vol 852. Springer, Cham. https://doi.org/10.1007/978-3-319-99981-4_23
Download citation
DOI: https://doi.org/10.1007/978-3-319-99981-4_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-99980-7
Online ISBN: 978-3-319-99981-4
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)