Document Type : Case Study

Authors

Faculty of Economics and Business, Paramadina University, Jakarta, Indonesia

Abstract

The study analyzed the evaluation of training programs provided to prospective assessors at the Ministry of Energy and Mineral Resources. The object of study is a trainee who is projected as an assessor.  The total number of participants was 23 people. Kirkpatrick's model served as the basis for evaluating the training program. The four evaluation levels analyzed include reactions, learning, behavior, and outcomes. The four stages of Kirkpatrick's model can provide a description of the training process and recommendation items to the organization. This recommendation is given for continuous improvement of training quality. Data analysis using a mix-method approach is due to the combination of primary and secondary data. The results of the study explained that the four levels in the Kirkpatrick model were adequacy in the implementation of the training program. The four models explain that all training components and processes are running well. Prospective assessors who are trained are given high expectations to remain in training at an advanced level. The evaluation level provides several recommendations including reformulation of training planning, learning related to accreditation standards, professional ethics-based behavior, and work results adjusted to excellent service accompanied by high quality. Recommendations on the results of training evaluations can be carried out to improve the quality of the program in accordance with the needs of the organization. Training should be conducted adaptively, with high flexibility, and new competencies for prospective assessors. The results of the training can make a significant contribution to the expectations of the organization.

Keywords

Main Subjects

COPYRIGHTS

©2023 The Author(s). This is an open access article distributed under the terms of the Creative Commons Attribution (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, as long as the original authors and source are cited. No permission is required from the authors or the publishers.

Alsalamah, A., & Callinan, C. (2021). Adaptation of Kirkpatrick’s four-level model of training criteria to evaluate training programmes for head teachers. Education Sciences, 11(3). https://doi.org/10.3390/educsci11030116
Baethge-Kinsky, V. (2020). Digitized Industrial Work: Requirements, Opportunities, and Problems of Competence Development. Frontiers in Sociology, 5. https://doi.org/10.3389/fsoc.2020.00033
Barba Aragón, M. I., Jiménez Jiménez, D., & Sanz Valle, R. (2014). Training and performance: The mediating role of organizational learning. BRQ Business Research Quarterly, 17(3). https://doi.org/10.1016/j.cede.2013.05.003
Bayraktar, Osman, & Şencan, H. (2017). Employees’ approaches to human resources from the asset-resource concepts perspective. International Journal of Business and Social Science, 8(9).
Bozionelos, N., Lin, C. H., & Lee, K. Y. (2020). Enhancing the sustainability of employees’ careers through training: The roles of career actors’ openness and of supervisor support. Journal of Vocational Behavior, 117. https://doi.org/10.1016/j.jvb.2019.103333
CAHAPAY, M. (2021). Kirkpatrick Model: Its Limitations as Used in Higher Education Evaluation. International Journal of Assessment Tools in Education, 8(1). https://doi.org/10.21449/ijate.856143
Carlucci, D., Mura, M., & Schiuma, G. (2020). Fostering Employees’ Innovative Work Behaviour in Healthcare Organisations. International Journal of Innovation Management, 24(2). https://doi.org/10.1142/S1363919620500140
Cascio, W. F. (2019). Training trends: Macro, micro, and policy issues. Human Resource Management Review, 29(2). https://doi.org/10.1016/j.hrmr.2017.11.001
Cheng, S. M., & Lunn, S. (2016). Training and qualification: Employee training at galaxy entertainment group. In Handbook of Human Resources Management. https://doi.org/10.1007/978-3-662-44152-7_8
Cohen, E. (2017). Employee Training and Development. In CSR for HR: A Necessary Partnership for Advancing Responsible Business Practice (p. 10). Routhledge - Taylor Francis Group. https://doi.org/10.9774/gleaf.978-1-907643-30-9_10
Creswell, J. W. (2013). Research Design Qualitative, Quantitative, and Mixed Method Approaches (4th ed.). SAGE Publications Inc.
Dessler, G. (2020). Human Resource Management Fifteenth edition. In Pearson Education.
Dorri, S., Akbari, M., & Dorri Sedeh, M. (2016). Kirkpatrick evaluation model for in-service training on cardiopulmonary resuscitation. Iranian Journal of Nursing and Midwifery Research, 21(5). https://doi.org/10.4103/1735-9066.193396
Eby, L. T., Allen, T. D., Conley, K. M., Williamson, R. L., Henderson, T. G., & Mancini, V. S. (2019). Mindfulness-based training interventions for employees: A qualitative review of the literature. Human Resource Management Review, 29(2). https://doi.org/10.1016/j.hrmr.2017.03.004
Fauth, F., & González-Martínez, J. (2021). On the concept of learning transfer for continuous and online training: A literature review. In Education Sciences (Vol. 11, Issue 3). https://doi.org/10.3390/educsci11030133
Gabčanová, I. (2011). the Employees – the Most Important Asset in the Organizations. Human Resources Management & Ergonomics, V.
Garavan, T., McCarthy, A., Lai, Y., Murphy, K., Sheehan, M., & Carbery, R. (2021). Training and organisational performance: A meta-analysis of temporal, institutional and organisational context moderators. Human Resource Management Journal, 31(1). https://doi.org/10.1111/1748-8583.12284
Guan, X., & Frenkel, S. (2019). How perceptions of training impact employee performance: Evidence from two Chinese manufacturing firms. Personnel Review, 48(1). https://doi.org/10.1108/PR-05-2017-0141
Kaufman, R., & Keller, J. M. (1994). Levels of evaluation: Beyond Kirkpatrick. Human Resource Development Quarterly, 5(4). https://doi.org/10.1002/hrdq.3920050408
Khan, M. M., Ahmad, R., & Fernald, L. W. (2020). A Conceptual Analysis of Training and Development Programs: Its Benefits for Employees and Organizations. Global Management Sciences Review, V(III). https://doi.org/10.31703/gmsr.2020(v-iii).02
Kirkpatrick, D. L., & Kirkpatrick, J. D. (2008). Evaluating Training Programs: The Four Levels. In Evaluating Training Programs.
Kirkpatrick, D. L., & Kirkpatrick, J. D. (2017). Kirkpatrick’s Four Levels of Training Evaluation. In BMC Public Health. ATD-Press.
Kirkpatrick, J. D., & Kirpatrick, W. K. (2016). Kirkpatrick’s Four Levels of Training Evaluation. In KirkPatrick Partners.
Krötz, M., & Deutscher, V. (2021). Quality of in-company training—A matter of perspective? Zeitschrift Fur Erziehungswissenschaft, 24(6). https://doi.org/10.1007/s11618-021-01041-4
Kumar, S. (2015). 5 Common Problems Faced By Students In eLearning And How To Overcome Them - eLearning Industry. In eLearning Industry.
Lantu, D. C., Labdhagati, H., Razanaufal, M. W., & Sumarli, F. D. (2021). Was the training effective? Evaluation of managers’ behavior after a leader development program in Indonesia’s best corporate university. International Journal of Training Research, 19(1). https://doi.org/10.1080/14480220.2020.1864446
Lourenco, D., & Ferreira, A. I. (2019). Self-regulated learning and training effectiveness. International Journal of Training and Development, 23(2). https://doi.org/10.1111/ijtd.12149
Mehale, K. D., Govender, C. M., & Mabaso, C. M. (2021). Maximising training evaluation for employee performance improvement. SA Journal of Human Resource Management, 19. https://doi.org/10.4102/sajhrm.v19i0.1473
Muchiri, M. K., McMurray, A. J., Nkhoma, M., & Pham, H. C. (2020). Mapping Antecedents of Innovative Work Behavior: A Conceptual Review. The Journal of Developing Areas, 54(4). https://doi.org/10.1353/jda.2020.0047
Muslihin, M. (2017). Evaluasi Program Pendidikan dan Pelatihan Kepemimpinan Tingkat IV Pemerintah Provinsi Nusa Tenggara Barat. JTP - Jurnal Teknologi Pendidikan. https://doi.org/10.21009/jtp1801.3
Noe, R. A., Hollenbeck, J. R., Gerhart, B., & Wright, P. M. (2009). Fundamentals of Human Resource Management. In Boston: McGraw-Hill. https://doi.org/10.1097/PRS.0b013e31822214c1
Reio, T. G., Rocco, T. S., Smith, D. H., & Chang, E. (2017). A Critique of Kirkpatrick’s Evaluation Model. New Horizons in Adult Education and Human Resource Development, 29(2). https://doi.org/10.1002/nha3.20178
Sahni, J. (2020). Managerial training effectiveness: An assessment through Kirkpatrick framework. TEM Journal, 9(3). https://doi.org/10.18421/TEM93-51
Schindler, P. S., & Cooper, D. R. (2014). Business Research Methods.
Stamatelatos, A., & Brooks, R. (2020). Simulated business effectiveness: learning and performance outcomes. Education and Training, 62(9). https://doi.org/10.1108/ET-04-2019-0084
Tasca, J. E., Ensslin, L., Ensslin, S. R., & Alves, M. B. M. (2010). An approach for selecting a theoretical framework for the evaluation of training programs. Journal of European Industrial Training, 34(7). https://doi.org/10.1108/03090591011070761
Teasdale, J. D., Segal, Z. V., & Williams, J. M. G. (2003). Mindfulness training and problem formulation. In Clinical Psychology: Science and Practice (Vol. 10, Issue 2). https://doi.org/10.1093/clipsy/bpg017
Topno, H. (2012). Evaluation of Training and Development: An Analysis of Various Models. IOSR Journal of Business and Management, 5(2). https://doi.org/10.9790/487x-0521622
Ulum, G. (2015). Program Evaluation through Kirkpatrick’s Framework. Pacific Business Review International, 8(1).
Vijayabanu, C., & Amudha, R. (2012). A study on efficacy of employee training: Review of literature. Business: Theory and Practice, 13(3). https://doi.org/10.3846/btp.2012.29
Waqanimaravu, M., & Arasanmi, C. N. (2020). Employee training and service quality in the hospitality industry. Journal of Foodservice Business Research, 23(3). https://doi.org/10.1080/15378020.2020.1724850