Assessing organizational climatepsychometric properties of the CLIOR Scale

  1. Peña Suárez, Elsa 1
  2. Muñiz Fernández, José 1
  3. Campillo Álvarez, Ángela 1
  4. Fonseca Pedrero, Eduardo 2
  5. García Cueto, Eduardo 1
  1. 1 Universidad de Oviedo
    info

    Universidad de Oviedo

    Oviedo, España

    ROR https://ror.org/006gksa02

  2. 2 Universidad de La Rioja
    info

    Universidad de La Rioja

    Logroño, España

    ROR https://ror.org/0553yr311

Journal:
Psicothema

ISSN: 0214-9915

Year of publication: 2013

Volume: 25

Issue: 1

Pages: 137-144

Type: Article

DOI: 10.7334/PSICOTHEMA2012.260 DIALNET GOOGLE SCHOLAR lock_openOpen access editor

More publications in: Psicothema

Institutional repository: lock_openOpen access Editor

Abstract

Background: Organizational climate is the set of perceptions shared by workers who occupy the same workplace. The main goal of this study is to develop a new organizational climate scale and to determine its psychometric properties. Method: The sample consisted of 3,163 Health Service workers. A total of 88.7% of participants worked in hospitals, and 11.3% in primary care; 80% were women and 20% men, with a mean age of 51.9 years (SD= 6.28). Results: The proposed scale consists of 50 Likert-type items, with an alpha coefficient of 0.97, and an essentially one-dimensional structure. The discrimination indexes of the items are greater than 0.40, and the items show no differential item functioning in relation to participants� sex. A short version of the scale was developed, made up of 15 items, with discrimination indexes higher than 0.40, an alpha coefficient of 0.94, and its structure was clearly one-dimensional. Conclusions: These results indicate that the new scale has adequate psychometric properties, allowing a reliable and valid assessment of organizational climate.

Bibliographic References

  • American Educational Research Association, American Psychological Association, and National Council on Measurement in Education (1999). Standards for educational and psychological testing. Washington, DC: American Psychological Association.
  • Ashforth, B.E. (1995). Climate formation: Issues and extensions. Academy of Management Review, 10(4), 837-847.
  • Asif, F. (2011). Estimating the impact of Denison's (1996), "What is the difference between organizational culture and organizational climate? A native's point of view on a decade of paradigm wars". Journal of Business Research, 64, 454-459.
  • Bartram, D., & Hambleton, R.K. (Eds.) (2006). Computer-based testing and the Internet. Chichester, UK: Wiley and Sons.
  • Bartram, D., Robertson, I.T., & Callinan, M. (2002). A framework for examining organizational effectiveness. In I.T. Robertson, M. Callinan, & D. Bartram (Eds.), Organizational effectiveness: The role of psychology (pp. 1-10). Chichester, UK: Wiley and Sons.
  • Bermejo, R., Hidalgo, D., Parra, P., Más, A., & Gomis, R. (2011). Propiedades métricas de las escalas de competencia profesional y trato del personal sanitario de servicios de consultas externas hospitalarias [Metric properties of the scales of professional competence and behavior towards users of healthcare personnel in outpatient hospital services]. Psicothema, 23, 295-300.
  • Blake, R.R., & Mouton, J.S. (1981). Productivity: The human side. New York: AMACOM.
  • Blake, R.R., & Mouton, J.S. (1994). The managerial grid. Houston, TX: Gulf Publishing.
  • Boada-Grau, J., Diego-Vallejo, R., Llanos-Serra, E., & Vigil-Colet, A. (2011). Versión breve en español del Team Climate Inventory (TCI-14): desarrollo y propiedades psicométricas [Short version in Spanish of the Team Climate Inventory (TCI-14): Development and psychometric properties]. Psicothema, 23(2), 308-313.
  • Bowers, D.G., & Taylor, J.C. (1972). Survey of organizations. Ann Arbor, MI: Institute for Social Research, University of Michigan. Brennan, R.L. (Ed.) (2006). Educational measurement. Westport, CT: ACE/Praeger.
  • Campbell, J.J., Dunnette, M.D., Lawler, E.E., & Weick, K.E. (1970). Managerial behavior, performance, and effectiveness. New York: McGraw-Hill.
  • Carr, J.Z., Schmidt, A.M., Ford, J.K., & DeShon, R.P. (2003). Climate perceptions matter: A meta-analytic path analysis relating molar climate, cognitive and affective states, and individual level work outcomes. Journal of Applied Psychology, 88, 605-619.
  • Cole, L.L., Grubb, P.L., Sauter, S.L., Swanson, N.G., & Lawless, P. (1997). Psychosocial correlates of harassment, threats and fear of violence in the workplace. Scandinavian Journal of Work, Environment & Health, 23, 450-457.
  • Corral, S., & Pereña, J. (2010). Cuestionario de clima laboral. Manual [Work Climate Questionnaire. Manual] (2a ed.). Madrid: TEA Ediciones.
  • Cronbach, L.J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297-334.
  • Culbertson, A., & Rodgers, W. (1997). Improving managerial effectiveness in the workplace: The case of sexual harassment of Navy women. Journal of Applied Social Psychology, 27, 1953-1971.
  • Cummings, L.L., & deCotiis, T.A. (1973). Organizational correlates of perceived stress in a professional organization. Public Personnel Management, 2, 275-282.
  • Dawson, J.F., González-Romá, V., Davis, A., & West, M.A. (2008). Organizational climate and climate strength in UK hospitals. European Journal of Work and Organizational Psychology, 17(1), 89-111.
  • deCotiis, T.A., & Summers, T.P. (1987). A path analysis of a model of the antecedents and consequences of organizational commitment. Human Relations, 40, 445-470.
  • Delgado, A., Bellón, J.A., Martínez-Cañavete, M.T., Luna, J.D., López-Fernández, L.A., & Lardelli, P. (2006). Las dimensiones del clima organizacional percibidas por los médicos de familia [The dimensions of organizational climate perceived by family doctors]. Atención Primaria, 37(9), 489-497.
  • Denison, D.R. (1996). What is the difference between organizational culture and organizational climate? A native's point of view on a decade of paradigm wars. The Academy of Management Review, 21, 619-654.
  • Dieterly, D.L., & Schneider, B. (1974). The effect of organizational environment on perceived power and climate. A laboratory study. Organizational Behavior and Human Performance, 11, 316-337.
  • Downing, S.M., & Haladyna, T.M. (2006). Handbook of test development. Mahwah, NJ: Erlbaum.
  • Drasgow, F., Luecht, R.M., & Bennett, R.E. (2006). Technology and testing. In R.L. Brennan (Ed.), Educational measurement (pp. 471-515). Westport, CT: ACE/Praeger.
  • Ekvall, G. (1996). Organizational climate for creativity and innovation. European Journal of Work and Organizational Psychology, 5, 105-123.
  • Fernández-Ballesteros R., & Sierra, B (1984). Escalas de clima social: familia, trabajo, instituciones penitenciarias, centro escolar. Manual: investigación y publicaciones psicológicas [Social climate scales: Family, work, penitentiary institutions, school. Manual: Research and psychological publications]. Madrid: TEA Ediciones.
  • Fidalgo, A.M. (2010). GMHDIF: A computer program for detecting DIF in dichotomous and polytomous items using generalized Mantel-Haenszel statistics. Consulted on October 17, 2011, at: http://apm.sagepub.com.
  • Fleishman, E.A. (1953). A leadership climate, human relations training, and supervisory behavior. Personnel Psychology, 6, 205-222.
  • González, A., Padilla, J.L., Hidalgo, M.D., Gómez-Benito, J., & Benítez, I. (2011). EASY-DIF: Software for analyzing differential item functioning using the Mantel-Haenszel and standardization procedures. Applied Psychological Measurement, 35(6), 483-484.
  • González-Romá, V. (2011). El clima de los equipos de trabajo: una propiedad configuracional [The climate of work teams: A configurational property]. Papeles del Psicólogo, 32(1), 48-58.
  • González-Romá, V., Tomás, I., Peiró, J.M., Lloret, S., Espejo, B., Ferreres, D., y Hernández, A. (1996). Análisis de las propiedades psicométricas del cuestionario de clima organizacional FOCUS-93 [Analysis of the psychometric properties of the organizational climate questionnaire FOCUS-93]. Revista de Psicología Social Aplicada, 6(1), 5-22.
  • Haladyna, T.M. (2004). Developing and validating multiple-choice test item (3rd ed.). Hillsdale, NJ: Erlbaum.
  • Haladyna, T.M., Downing, S.M., & Rodríguez, M.C. (2002). A review of multiple-choice item-writing guidelines. Applied Measurement in Education, 15(3), 309-334.
  • Halpin, A.W. (1966). Theory and research in administration. New York: MacMillan.
  • Hu, L.-T., & Bentler, P.M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
  • James, L.R., Choi, C.C., Ko, C.E., McNeil, P.K., Minton, M.K., Wright, M.A., & Kim, K. (2008). Organizational and psychological climate: A review of theory and research. European Journal of Work and Organizational Psychology, 17(1), 5-32.
  • Jones, A.P., & James, L.R. (1979). Psychological climate: Dimensions and relationships of individual and aggregated work environment perceptions. Organizational Behavior and Human Performance, 23, 201-250.
  • Kopelman, R.E., Brief, A.P., & Guzzo, R.A. (1990). The role of climate and culture in productivity. In B. Schneider (Ed.), Organizational climate and culture (pp. 282-318). San Francisco: Jossey-Bass.
  • Koys, D.J., & deCotiis, T.A. (1991). Inductive measures of psychological climate. Human Relations, 44, 265-285.
  • Lawler, E.E., Hall, D.T., & Oldham, G.R. (1974). Organizational climate: Relationship to organizational structure, process and performance. Organizational Behavior & Human Decision Processes, 11, 139-155.
  • Lazarus, R.S. (1982). Thoughts on the relations between emotion and cognition. The American Psychologist, 37, 1019-1024.
  • Lazarus, R.S., & Folkman, S. (1984). Stress, appraisal, and coping. New York: Springer-Verlag.
  • Litwin, G.H., & Stringer, R.A. (1966). The influence of organizational climate. Boston, MD: Harvard University Press.
  • López-Fernández, L.A., Sánchez-Cantilejo, E., Calzas-Urrutia, D., Siles-Román, D., Sevilla-García, E., & de Oleaga-Usategui, I. (1988). Elaboración de un cuestionario para el estudio del clima organizacional de los centros de salud [Elaboration of a questionnaire to study organizational climate of health centers]. Atención Primaria, 5(10), 531-535.
  • Lorenzo-Seva, U., & Ferrando, P.J. (2006). FACTOR: A computer program to fit the exploratory factor analysis model. Behavioral Research Methods, Instruments and Computers, 38(1), 88-91.
  • Mantel, N., & Haenszel, W. (1959). Statistical aspects of the analysis of data from retrospective studies of disease. Journal of the National Cancer Institute, 22, 719-748.
  • Margulies, N. (1965). A study of organizational culture and the self- actualizing process. Los Angeles: University of California.
  • Mills, C.N., Potenza, M.T., Fremer, J.J., & Ward, W.C. (Eds.) (2002). Computer-based testing: Building the foundation for future assessments. Hillsdale, NJ: Erlbaum.
  • Moos, R., & Trickett, E.J. (1974). The Social Climate Scales: An overview. Palo Alto, CA: Consulting Psychologist Press.
  • Moreno, R., Martínez, R.J., & Muñiz, J. (2004). Directrices para la construcción de ítems de elección multiple [Guidelines for developing multiple-choice items]. Psicothema, 16(3), 490-497.
  • Moreno, R., Martínez, R., & Muñiz, J. (2006). New guidelines for developing multiple-choice items. Methodology, 2, 65-72.
  • Muñiz, J., & Fonseca-Pedrero, E. (2008). Construcción de instrumentos de medida para la evaluación universitaria [Developing measurement instruments for university assessment]. Revista de Investigación en Educación, 5, 13-25.
  • Muñiz, J., García-Cueto, E., & Lozano, L.M. (2005). Item format and the psychometric properties of the Eysenck Personality Questionnaire. Personality and Individual Differences, 38(1), 61-69.
  • Muthén, L.K., & Muthén, B.O. (2006). Mplus user's guide (4th ed.). Los Angeles: Muthén & Múthen.
  • Newman, J.E. (1975). Understanding the organizational structure-job attitude relationship though perceptions of the work environment. Organizational Behavior and Human Performance, 14, 371-397.
  • Newman, J.E. (1977). Development of a measure of Perceived Work Environment (PWE). Academy of Management Journal, 20(4), 520-534.
  • Ostroff, C. (1993). The effects of climate and personal influences on individual behavior and attitudes in organizations. Organizational Behavior and Human Decision Processes, 56, 56-90.
  • Ostroff, C., Kinicky, A., & Tamkins, M.M. (2003). Organizational culture and climate. In W.C. Borman, D.R. Ilgen, & R.J. Klimoski (Eds.), Handbook of psychology (Vol. 12 Industrial and Organizational). Hoboken, NJ: Wiley and Sons.
  • Patterson, M.G., West, M.A., Shackleton, V.J., Dawson, J.F., Lawthom, R., Maitlis, S., & Robinson, D.L. (2005). Validating the organizational climate measure: Links to managerial practices, productivity and innovation. Journal of Organizational Behavior, 26, 379-408.
  • Rafferty, A.E., & Jimmieson, N.L. (2009). Team change climate: A group-level analysis of the relationships among change information and change participation, role stressors and well-being. European Journal of Work and Organizational Psychology, 19(5), 551-586.
  • Schnake, M.E. (1983). An empirical assessment of the effects of affective response in the measurement of organizational climate. Personnel Psychology, 36, 791-807.
  • Schneider, B., & Bartlett, C.J. (1968). Individual differences and organizational climate: The research plan and questionnaire development. Personnel Psychology, 21, 323-333.
  • Schneider, B., & Bartlett, C.J. (1970). Individual differences and organizational climate II: Measurement of organizational climate by the multi-rater matrix. Personnel Psychology, 23, 493-512.
  • Steel, R.P., Shane, G.S., & Kennedy, K.A. (1990). Effects of social system factors on absenteeism, turnover, and job performance. Journal of Business and Psychology, 4, 423-430.
  • Stern, G.G. (1970). People in context: Measuring person-environment congruence in education and industry. New York: Wiley.
  • Tagiuri, R.I. (1968). The concept of organizational climate. In R.I. Tagiuri & G.H. Litwin (Eds.), Organizational climate: Exploration of a concept (pp. 1-34). Boston, MD: Harvard University.
  • Thumin, F.J., & Thumin, L.J. (2011). The measurement and interpretation of organizational climate. The Journal of Psychology, 145, 93-109.
  • van der Linden, W.J., & Glas, C.A. (Eds.) (2010). Elements of adaptive testing. London: Springer.
  • Vartia, M. (2008). The sources of bullying: Psychological work environment and organizational climate. European Journal of Work and Organizational Psychology, 5(2), 203-214.
  • Wilson, M. (2005). Constructing measures: An item response modeling approach. Mahwah, NJ: Erlbaum.
  • Zwick, R., Donoghue, J.R., & Grima, A. (1993). Assessment of differential item functioning for performance tasks. Journal of Educational Measurement, 30, 233-251.
Data source: Dialnet