TRANSFORMING PUBLIC UNIVERSITIES TOWARD LEARNING ORGANIZATIONS: VALIDATING AND RECALIBRATING THE DLOQ FOR INDONESIAN HIGHER EDUCATION
DOI:
https://doi.org/10.5281/zenodo.21881340Keywords:
Higher Education, Instrument Non-Portability, Learning Organization, Public SectorAbstract
Transforming public universities into learning organizations requires measurement instruments that are psychometrically valid within public sector contexts, yet the Dimensions of Learning Organization Questionnaire (DLOQ), developed by Marsick & Watkins (1996; 2003), has been applied in such settings on an untested portability assumption. Employing a psychometric validation study design based on PLS-SEM via SmartPLS 4.0, this study administered the DLOQ to 100 civil servants at Sriwijaya University as a representative Indonesian state university (PTN) through proportionate random sampling. Outer model evaluation identified several items that failed to meet psychometric validity thresholds, and their elimination demonstrably improved overall model quality, providing empirical evidence of systematic instrument non-portability. A critical paradoxical finding emerged: dimensions receiving highly positive perceptual scores simultaneously produced items that failed psychometric validation, confirming a fundamental distinction between perceived learning culture and measured learning capability. This study yielded the DLOQ-PTN, a calibrated 14-item instrument that is valid, reliable, and contextually appropriate for learning organization research in Indonesian public universities, ready for replication by future researchers.
Downloads
References
Adler, N., & Docherty, P. (1998). Bringing business into sociotechnical theory and practice. Human Relations, 51(3), 319–345. https://doi.org/10.1023/A:1016996504881
Alerasoul, S. A., Afeltra, G., Hakala, H., Minelli, E., & Strozzi, F. (2022). Organisational learning, learning organisation, and learning orientation: An integrative review and framework. Human Resource Management Review, 32(3), 1–26. https://doi.org/10.1016/j.hrmr.2021.100854
Anand, A., & Brix, J. (2022). The learning organization and organizational learning in the public sector: A review and research agenda. The Learning Organization, 29(2), 129–156. https://doi.org/10.1108/TLO-05-2021-0061
Argyris, C., & Schon, D. A. (1978). Organizational Learning: A Theory of Action Perspective. Addison-Wesley.
Bagozzi, R. P., Yi, Y., & Phillips, L. W. (1991). Assessing construct validity in organizational research. Administrative Science Quarterly, 36(3), 421–458. https://doi.org/10.2307/2393203
Benitez, J., Henseler, J., Castillo, A., & Schuberth, F. (2020). How to perform and report an impactful analysis using partial least squares: Guidelines for confirmatory and explanatory IS research. Information & Management, 57(2), 103168. https://doi.org/10.1016/j.im.2019.05.003
Bui, H. T. M., & Baruch, Y. (2012). Learning organizations in higher education: An empirical evaluation within an international context. Management Learning, 43(5), 515–544. https://doi.org/10.1177/1350507611431212
Cousins, J. B., Goh, S. C., Elliott, C., Aubry, T., & Gilbert, N. (2014). Government and voluntary sector differences in organizational capacity to do and use evaluation. Evaluation and Program Planning, 44, 1–13. https://doi.org/10.1016/j.evalprogplan.2014.01.002
Cyert, R. M., & March, J. G. (1963). A Behavioral Theory of the Firm. Prentice-Hall.
Dekoulou, P., & Trivellas, P. (2014). Measuring the impact of learning organization on job satisfaction and individual performance in Greek advertising sector. Procedia: Social and Behavioral Sciences, 175, 367–375. https://doi.org/10.1016/j.sbspro.2015.01.1212
Dhananjaya, D. N., & Gamlath, S. (2013). Learning organization dimensions of the Sri Lanka Army. The Learning Organization, 20(3), 195–215. https://doi.org/10.1108/09696471311328451
Farrell, M. A., & Oczkowski, E. (2002). Are market orientation and learning orientation necessary for superior organizational performance? Journal of Market-Focused Management, 5(3), 197–217. https://doi.org/10.1023/A:1019519824126
Ferguson, S., Burford, S., & Kennedy, M. (2013). Divergent Approaches to Knowledge and Innovation in the Public Sector. International Journal of Public Administration, 36(3), 168–178. https://doi.org/10.1080/01900692.2012.749278
Fiol, C. M., & Lyles, M. A. (1985). Organizational learning. Academy of Management Review, 10(4), 803–813. https://doi.org/10.2307/258048
Garvin, D. A. (1993). Building a learning organization. Harvard Business Review, 71(4), 78–91.
Garvin, D. A. (2003). Learning in Action: A Guide to Putting the Learning Organization to Work. Harvard Business School Press.
Goh, S. C. (2019). Organizational learning and job satisfaction: An analysis of a Canadian federal government department. International Journal of Public Administration, 42(2), 103–114. https://doi.org/10.1080/01900692.2018.1428337
Goh, S. C., Elliott, C., & Quon, T. K. (2006). The relationship between learning capability and organizational performance: A meta-analytic examination. The Learning Organization, 19(2), 92–108. https://doi.org/10.1108/09696471211201461
Goh, S. C., & Richards, G. (1997). Benchmarking the learning capability of organizations. European Management Journal, 15(5), 575–583. https://doi.org/10.1016/S0263-2373(97)00036-4
Goula, A., Stamouli, M. A., Stavroulakis, D., Kyriakidou, N., & Siskou, O. (2020). Validation of dimensions of learning organization questionnaire (DLOQ) in health care setting in Greece. Healthcare, 8(4), 573. https://doi.org/10.3390/healthcare8040573
Gregor, S., & Hevner, A. R. (2013). Positioning and presenting design science research for maximum impact. MIS Quarterly, 37(2), 337–355. https://doi.org/10.25300/MISQ/2013/37.2.01
Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2022). A Primer on Partial Least Squares Structural Equation Modeling (PLS-SEM) (3rd ed.). SAGE Publications.
Harrison, G. L., & Baird, K. M. (2014). The organizational culture of public sector organisations in Australia. Australian Journal of Management, 40(2), 292–316. https://doi.org/10.1177/0312896213505095
Hatch, M. J., & Cunliffe, A. L. (2013). Organization Theory: Modern, Symbolic, and Postmodern Perspectives (3rd ed.). Oxford University Press.
Henseler, J., Ringle, C. M., & Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the Academy of Marketing Science, 43(1), 115–135. https://doi.org/10.1007/s11747-014-0403-8
Hevner, A. R., March, S. T., Park, J., & Ram, S. (2004). Design science in information systems research. MIS Quarterly, 28(1), 75–105. https://doi.org/10.2307/25148625
Hofstede Insights. (2024). Country comparison tool: Indonesia. https://www.hofstede-insights.com/country-comparison-tool?countries=indonesia
Huber, G. P. (1991). Organizational learning: The contributing processes and the literatures. Organization Science, 2(1), 88–115. https://doi.org/10.1287/orsc.2.1.88
Hulland, J. (1999). Use of partial least squares (PLS) in strategic management research: A review of four recent studies. Strategic Management Journal, 20(2), 195–204. https://doi.org/10.1002/(SICI)1097-0266(199902)20:2<195::AID-SMJ13>3.0.CO;2-7
Ionescu, C. A., Ionescu, A., Tudorache, F., Gutu, C., Anghel, L. T., Zamfir, A. E., & Oncioiu, I. (2019). Investigating the dimensions of learning organizations questionnaire (DLOQ) in a Romanian private ophthalmology organization. Healthcare, 7(1), 33. https://doi.org/10.3390/healthcare7010033
Ju, B., Chen, Z., & Zheng, J. (2021). Building a learning organization in the context of China’s public sector: The role of DLOQ. The Learning Organization, 28(4), 394–411. https://doi.org/10.1108/TLO-01-2020-0007
Kim, J., Egan, T., & Tolson, H. (2015). Examining the dimensions of the learning organization questionnaire: A review and critique of research utilizing the DLOQ. Human Resource Development Review, 14(1), 91–112. https://doi.org/10.1177/1534484314555402
Kim, S. H., & Kim, S. (2016). National culture and social desirability bias in measuring public service motivation. Administration & Society, 48(4), 444–476. https://doi.org/10.1177/0095399713498749
Kock, N., & Hadaya, P. (2018). Minimum sample size estimation in PLS-SEM: The inverse square root and gamma-exponential methods. Information Systems Journal, 28(1), 227–261. https://doi.org/10.1111/isj.12131
Kortsch, T., Paulsen, H., & Kauffeld, S. (2019). Validation of a German version of the dimensions of the learning organization questionnaire (DLOQ) in German craft companies. Zeitschrift für Arbeits-und Organisationspsychologie, 63, 15–31. https://doi.org/10.1026/0932-4089/a000282
Kwak, D. H., Shim, H., & Kim, S. (2021). Detection and reduction of social desirability bias in information systems research. Information & Management, 58(7), 103500. https://doi.org/10.1016/j.im.2021.103500
Lenart-Gansiniec, R., & Sułkowski, Ł. (2020). Organizational learning and value creation in local governance: The mediating role of crowdsourcing. The Learning Organization, 27(4), 321–335. https://doi.org/10.1108/TLO-12-2018-0213
Leufvén, M., Vitrakoti, R., Bergström, A., Kc, A., & Målqvist, M. (2015). Dimensions of Learning Organizations Questionnaire (DLOQ) in a low-resource health care setting in Nepal. Health Research Policy and Systems, 13(1), 6. https://doi.org/10.1186/1478-4505-13-6
Marquardt, M. J. (2002). Building the Learning Organization: Mastering the Five Elements for Corporate Learning (2nd ed.). Davies-Black Publishing.
Marsick, V. J. (2013). The dimensions of a learning organization questionnaire (DLOQ) introduction to the special issue examining DLOQ use over a decade. Advances in Developing Human Resources, 15(2), 127–132. https://doi.org/10.1177/1523422313475984
Marsick, V. J., & Watkins, K. E. (1996). Adult educators and the challenge of the learning organization. Adult Learning, 7(4), 18–20. https://doi.org/10.1177/104515959600700
Marsick, V. J., & Watkins, K. E. (2003). Demonstrating the value of an organization’s learning culture: The dimensions of the learning organization questionnaire. Advances in Developing Human Resources, 5(2), 132–151. https://doi.org/10.1177/1523422303005002002
Mujahidin, M., & Kusuma, F. K. (2025). Redesigning bureaucracy as a governmental strategy for enhancing public service effectiveness. Society, 13(1), 803–817. https://doi.org/10.33019/society.v13i1.766
Ndraha, T. (2005). Teori Budaya Organisasi. Rineka Cipta.
Nederhof, A. J. (1985). Methods of coping with social desirability bias: A review. European Journal of Social Psychology, 15, 263–280. https://doi.org/10.1002/ejsp.2420150303
Olejarski, A. M., Potter, M., & Morrison, R. L. (2018). Organizational learning in the public sector: Culture, politics and performance. Public Integrity, 21(2), 69–85. https://doi.org/10.1080/10999922.2018.1462207
Oosthuizen, R. M., & Pretorius, M. (2016). Design science research and its application in human resource management. SA Journal of Human Resource Management, 14(1), 1–10. https://doi.org/10.4102/sajhrm.v14i1.763
Panayides, P. (2007). The impact of organizational learning on relationship orientation, logistics service effectiveness and performance. Industrial Marketing Management, 36(1), 68–80. https://doi.org/10.1016/j.indmarman.2006.03.006
Pasmore, W. A., Francis, C., Haldeman, J., & Shani, A. (1982). Sociotechnical systems: A North American reflection on empirical studies of the seventies. Human Relations, 35(12), 1179–1204. https://doi.org/10.1177/001872678203501207
Rad, D., & Bocos, M. (2024). Rethinking learning organization antecedents in public institutions: A narrative review. Frontiers in Psychology, 15, 1389072. https://doi.org/10.3389/fpsyg.2024.1389072
Rashman, L., Withers, E., & Hartley, J. (2009). Organizational learning and knowledge in public service organizations: A systematic review of the literature. International Journal of Management Reviews, 11(4), 463–494. https://doi.org/10.1111/j.1468-2370.2009.00257.x
Robbins, S. P. (1990). Organization Theory: Structure, Design, and Applications (3rd ed.). Prentice-Hall.
Senge, P. M. (1990). The Fifth Discipline: The Art and Practice of the Learning Organization. Doubleday.
Sinkula, J. M., Baker, W. E., & Noordewier, T. (1997). A framework for market-based organizational learning: Linking values, knowledge, and behavior. Journal of the Academy of Marketing Science, 25(4), 305–318. https://doi.org/10.1177/0092070397254003
Syahrir, S., Sumarni, S., Murtadho, A., & Malik, M. (2020). Partial least squares-structural equation modeling (PLS-SEM) in social science research. Journal of Critical Reviews, 7(19), 67–88.
Tippins, M. J., & Sohi, R. S. (2003). IT competency and firm performance: Is organizational learning a missing link? Strategic Management Journal, 24(8), 745–761. https://doi.org/10.1002/smj.337
Trist, E. L. (1981). The Evolution of Socio-Technical Systems: A Conceptual Framework and an Action Research Program. Ontario Quality of Working Life Centre.
Varughese, B., & Rameshkumar, M. (2024). Validation of Dimensions of Learning Organization Questionnaire (DLOQ). International Journal of Educational Research, 127, 102416. https://doi.org/10.1016/j.ijer.2024.102416
Vom Brocke, J., Hevner, A., & Maedche, A. (2020). Introduction to design science research. In J. vom Brocke, A. Hevner, & A. Maedche (Eds.), Design Science Research. Cases (pp. 1–13). Springer. https://doi.org/10.1007/978-3-030-46781-4_1
Walker, G. H., Stanton, N. A., Salmon, P. M., & Jenkins, D. P. (2008). A review of sociotechnical systems theory: A classic concept for new command and control paradigms. Theoretical Issues in Ergonomics Science, 9(6), 479–499. https://doi.org/10.1080/14639220701635470
Watkins, K. E., & Dirani, K. M. (2013). A meta-analysis of the dimensions of a learning organization questionnaire: Looking across cultures, ranks, and industries. Advances in Developing Human Resources, 15(2), 148–162. https://doi.org/10.1177/1523422313475991
Watkins, K. E., & Kim, K. (2017). Current status and promising directions for research on the learning organization. Human Resource Development Quarterly, 29(1), 15–29. https://doi.org/10.1002/hrdq.21293
Watkins, K. E., & Marsick, V. J. (1996). Adult educators and the challenge of the learning organization. Adult Learning, 7(4), 18–20.
Yang, B., Watkins, K. E., & Marsick, V. J. (2004). The construct of the learning organization: Dimensions, measurement, and validation. Human Resource Development Quarterly, 15(1), 31–55. https://doi.org/10.1002/hrdq.1086
