Coefficient Alpha: Interpret With Caution

Panayiotis Panayides

Abstract


Heavy reliance on Cronbach’s alpha has been standard practice in many validation studies. However, there seem to be two misconceptions about the interpretation of alpha. First, alpha is mistakenly considered as an indication of unidimensionality and second, that the higher the value of alpha the better. The aim of this study is to clarify these misconceptions with the use of real data from the educational setting. Results showed that high alpha values can be obtained in multidimensional scales or tests given a sufficient number of items. Therefore, alpha cannot be an indication of unidimensionality. At the same time, after a certain point, higher values of alpha do not necessarily mean higher reliability and better quality scales or tests. In fact very high values of alpha could be an indication of lengthy scales, parallel items or a narrow coverage of the construct under consideration. Researchers are advised to apply caution when reporting alpha.


Keywords


coefficient alpha; reliability; unidimensionality

Full Text: PDF HTML

https://doi.org/10.5964/ejop.v9i4.653

Citing articles (via Crossref)

  • Manuela Mika Jomori, Rossana Pacheco da Costa Proença, Maria Elena Echevarria-Guanilo, Greyce Luci Bernardo, Paula Lazzarin Uggioni, Ana Carolina Fernandes (2017)
    Construct validity of Brazilian cooking skills and healthy eating questionnaire by the known-groups method
    British Food Journal, 119(5), p. 1003(ff.)
    doi: 10.1108/BFJ-10-2016-0448
  • Patrick Vermersch, Jeremy Hobart, Catherine Dive-Pouletty, Sylvie Bozzi, Steven Hass, Patricia K Coyle (2017)
    Measuring treatment satisfaction in MS: Is the Treatment Satisfaction Questionnaire for Medication fit for purpose?
    Multiple Sclerosis Journal, 23(4), p. 604(ff.)
    doi: 10.1177/1352458516657441
  • Terence V. Bowles (2016)
    Who's the Fairest of Them All and Does It Really Matter? Positive and Negative Affective Responses to Levels of Relational Equity in Adolescent Relationships
    Journal of Relationships Research, 7
    doi: 10.1017/jrr.2016.14
  • Sarah Keller, Timothy Wilkinson (2017)
    Variations in involvement: motivating bystanders to care for senior citizens
    International Journal of Pharmaceutical and Healthcare Marketing, 11(2), p. 117(ff.)
    doi: 10.1108/IJPHM-06-2016-0029
  • Yanda Sebega, Ernest Mnkandla (2017)
    Exploring Issues in Agile Requirements Engineering in the South African Software Industry
    The Electronic Journal of Information Systems in Developing Countries, 81(1), p. 1(ff.)
    doi: 10.1002/j.1681-4835.2017.tb00597.x
  • Stephan Schuler, Daniela Fanta, Frank Rosenkraenzer, Werner Riess (2017)
    Systems thinking within the scope of education for sustainable development (ESD) – a heuristic competence model as a basis for (science) teacher education
    Journal of Geography in Higher Education, p. 1(ff.)
    doi: 10.1080/03098265.2017.1339264
  • Boumediene Kebaili, Saif Saeed Al-Subyae, Fahed Al-Qahtani (2017)
    Barriers of entrepreneurial intention among Qatari male students
    Journal of Small Business and Enterprise Development, 24(4), p. 833(ff.)
    doi: 10.1108/JSBED-11-2016-0186
  • Stein J. Janssen, Teun Teunis, Eva van Dijk, Marco L. Ferrone, John H. Shin, Francis Hornicek, Joseph H. Schwab (2017)
    Validation of the Spine Oncology Study Group—Outcomes Questionnaire to assess quality of life in patients with metastatic spine disease
    The Spine Journal, 17(6), p. 768(ff.)
    doi: 10.1016/j.spinee.2015.07.456
  • Nur Ayalp, Kemal Yildirim, Müge Bozdayi, Kubulay Cagatay (2016)
    Consumers’ evaluations of fitting rooms in retail clothing stores
    International Journal of Retail & Distribution Management, 44(5), p. 524(ff.)
    doi: 10.1108/IJRDM-06-2015-0085
  • Ruth Martinez-Lopez, Carmen Yot, Iuliia Tuovila, Víctor-Hugo Perera-Rodríguez (2017)
    Online Self-Regulated Learning Questionnaire in a Russian MOOC
    Computers in Human Behavior, 75, p. 966(ff.)
    doi: 10.1016/j.chb.2017.06.015
  • Hamidreza Khalili, Ardalan Sameti (2017)
    Healthcare quality and medicine reimbursement criteria in Iran
    International Journal of Pharmaceutical and Healthcare Marketing, 11(4), p. 455(ff.)
    doi: 10.1108/IJPHM-06-2016-0032
  • Fatih Önder (2016)
    Development and validation of the photoelectric effect concept inventory
    European Journal of Physics, 37(5), p. 055709(ff.)
    doi: 10.1088/0143-0807/37/5/055709
  • Mrinalini Balki, David Hoppe, David Monks, Lynn Sharples, Mary Ellen Cooke, Lawrence Tsen, Rory Windrim (2017)
    The PETRA (Perinatal Emergency Team Response Assessment) Scale: A High-Fidelity Simulation Validation Study
    Journal of Obstetrics and Gynaecology Canada, 39(7), p. 523(ff.)
    doi: 10.1016/j.jogc.2016.12.036
  • Leila Itani, Hanadi Chatila, Hani Dimassi, Fikrat El Sahn (2017)
    Development and validation of an Arabic questionnaire to assess psychosocial determinants of eating behavior among adolescents: a cross-sectional study
    Journal of Health, Population and Nutrition, 36(1)
    doi: 10.1186/s41043-017-0086-0
  • Olivier D.R. van Wulfften Palthe, Stein J. Janssen, Jay S. Wunder, Peter C. Ferguson, Guo Wei, Peter S. Rose, Micheal J. Yaszemski, Franklin H. Sim, Patrick J. Boland, John H. Healey, Francis J. Hornicek, Joseph H. Schwab (2017)
    What questionnaires to use when measuring quality of life in sacral tumor patients: the updated sacral tumor survey
    The Spine Journal, 17(5), p. 636(ff.)
    doi: 10.1016/j.spinee.2016.11.004
  • Viviana QUIROZ, Daniela REINERO, Patricia HERNÁNDEZ, Johanna CONTRERAS, Rolando VERNAL, Paola CARVAJAL (2017)
    Development of a self-report questionnaire designed for population-based surveillance of gingivitis in adolescents: assessment of content validity and reliability
    Journal of Applied Oral Science, 25(4), p. 404(ff.)
    doi: 10.1590/1678-7757-2016-0511
  • Ladislav Baloun, Martin Kudlacek, Jana Sklenarikova, Ondrej Jesina, Alena Migdauova (2016)
    Czech self-efficacy scale for physical education majors towards children with disabilities
    Acta Gymnica
    doi: 10.5507/ag.2016.002