Ítems tipo Likert vs. Ítems continuos: ¿Qué opción es mejor?

Jaime García-Fernández; Marcelino  Cuesta; Álvaro Postigo; Álvaro  Menéndez-Aller; Covadonga González-Nuevo; Eduardo García-Cueto

doi:10.3989/ris.2024.82.2.M23-04

Autores/as

Jaime García-Fernández Universidad de Oviedo https://orcid.org/0000-0001-7414-8807
Marcelino Cuesta Universidad de Oviedo https://orcid.org/0000-0002-1060-9536
Álvaro Postigo Universidad de Oviedo https://orcid.org/0000-0003-4228-8965
Álvaro Menéndez-Aller Universidad de Oviedo https://orcid.org/0000-0002-4049-5488
Covadonga González-Nuevo Universidad de Oviedo https://orcid.org/0000-0003-0501-8907
Eduardo García-Cueto Universidad de Oviedo https://orcid.org/0000-0002-1059-117X

DOI:

https://doi.org/10.3989/ris.2024.82.2.M23-04

Palabras clave:

Likert, VAS, formato de respuesta, escalas psicológicas, test de personalidad

Resumen

Los ítems tipo Likert son comúnmente utilizados en ciencias sociales. Este estudio comprueba si se pueden mejorar las propiedades psicométricas de los autoinformes variando los formatos de respuesta. Los formatos comparados han sido el tipo Likert de cinco alternativas y el VAS (Visual Analog Scale). Para ello, 584 personas (75.2 % mujeres) con una edad media de 32.9 años (DT = 13.4) respondieron a dos cuestionarios online de personalidad que fueron aplicados una vez con formato tipo Likert (0-4) y una segunda vez con formato VAS (0-100). La discriminación, fiabilidad y pesos factoriales de las escalas con formato Likert han sido mayores que las del formato VAS. El formato de respuesta no afectó a la estructura factorial. Las escalas con formato VAS dan puntuaciones totales significativamente más altas. Aunque los ítems con formato de respuesta Likert muestran un mejor funcionamiento, estos resultados podrían estar influenciados por la longitud de la línea en el formato VAS.

Descargas

Los datos de descargas todavía no están disponibles.

Citas

Benítez, Isabel, Fons Van De Vijver y José Luis Padilla. 2022. "A Mixed Methods Approach to the Analysis of Bias in Cross-Cultural Studies". Sociological Methods & Research 51(1): 237-70. https://doi.org/10.1177/0049124119852390

Bijur, Polly E., Wendy Silver y John E. Gallagher. 2001. "Reliability of the Visual Analog Scale for Measurement of Acute Pain". Academic Emergency Medicine 8(12): 1153-57. https://doi.org/10.1111/j.1553-2712.2001.tb01132.x PMid:11733293

Briesch, Amy M., Stephen P. Kilgus, Sandra M. Chafouleas, T. Chris Riley-Tillman y Theodore J. Christ. 2013. "The Influence of Alternative Scale Formats on the Generalizability of Data Obtained From Direct Behavior Rating Single-Item Scales (DBR-SIS)". Assessment for Effective Intervention 38(2): 127-33. https://doi.org/10.1177/1534508412441966

Buskirk, Trent D. 2015. "Are Sliders Too Slick for Surveys? An Experiment Comparing Slider and Radio Button Scales for Smartphone, Tablet and Computer Based Surveys". Methods, Data, Analyses 9(2): 229-60.

Carifio, James y Rocco Perla. 2008. "Resolving the 50-Year Debate Around Using and Misusing Likert Scales". Medical Education 42(12): 1150-52. https://doi.org/10.1111/j.1365-2923.2008.03172.x PMid:19120943

Carifio, James y Rocco J. Perla. 2007. "Ten Common Misunderstandings, Misconceptions, Persistent Myths and Urban Legends about Likert Scales and Likert Response Formats and their Antidotes". Journal of Social Sciences 3(3): 106-16 https://doi.org/10.3844/jssp.2007.106.116

Christian, Leah Melani, Nicholas L. Parsons y Don A. Dillman. 2009. "Designing Scalar Questions for Web Surveys". Sociological Methods & Research 37(3): 393-425. https://doi.org/10.1177/0049124108330004

Cohen, Jacob. 1992. "A power primer". Psychological Bulletin 112(1): 155-59. https://doi.org/10.1037/0033-2909.112.1.155 PMid:19565683

Consejo General de la Psicología de España. 2015. Código Deontológico del Psicólogo. Consultado el 8 de febrero de 2024 (https://www.cop.es/index.php?page=CodigoDeontologico).

Cook, Colleen, Fred Heath, Russel L. Thompson y Bruce Thompson. 2001. "Score Reliability in Webor Internet-Based Surveys: Unnumbered Graphic Rating Scales versus Likert-Type Scales". Educational and Psychological Measurement 61(4): 697-706. https://doi.org/10.1177/00131640121971356

Couper, Mick P., Roger Tourangeau, Frederick G. Conrad y Eleanor Singer. 2006. "Evaluating the Effectiveness of Visual Analog Scales: A Web Experiment". Social Science Computer Review 24(2): 227-45. https://doi.org/10.1177/0894439305281503

Cox, Eli P. 1980. "The Optimal Number of Response Alternatives for a Scale: A Review". Journal of Marketing Research 17(4): 407-22. https://doi.org/10.1177/002224378001700401

Feldt, Leonard S. 1980. "A Test of the Hypothesis That Cronbach's Alpha Reliability Coefficient Is the Same for Two Tests Administered to the Same Sample". Psychometrika 45(1): 99-105. https://doi.org/10.1007/BF02293600

Freyd, Max. 1923. "The Graphic Rating Scale". Journal of Educational Psychology 14(2): 83-102. https://doi.org/10.1037/h0074329

Fuentealba Carrasco, Pablo Javier y Omar A. Barriga. 2017. "Primera aproximación a la construcción de una Escala de Adhesión a los Principios del Derecho Penal (EAPDP). Estudio piloto en el Conurbano del Gran Concepción, Chile". Revista Internacional de Sociología 75(2): e060. https://doi.org/10.3989/ris.2017.75.2.15.103

Funke, Frederik. 2016. "A Web Experiment Showing Negative Effects of Slider Scales Compared to Visual Analogue Scales and Radio Button Scales". Social Science Computer Review 34(2): 244-54. https://doi.org/10.1177/0894439315575477

Funke, Frederik y Ulf-Dietrich Reips. 2006. "Visual Analogue Scales in Online Surveys: Non-Linear Data Categorization by Transformation with Reduced Extremes". Presentado en General Online Research Conference, Bielefeld.

Funke, Frederik y Ulf-Dietrich Reips. 2012. "Why Semantic Differentials in Web-Based Research Should Be Made from Visual Analogue Scales and Not from 5-Point Scales". Field Methods 24(3): 310-27. https://doi.org/10.1177/1525822X12444061

García-Cueto, Eduardo 1994. "Coeficiente de Congruencia". Psicothema 6(3): 465-68.

Gómez-Leal, Raquel, Alberto Megías-Robles, María José Gutiérrez-Cobo, Rosario Cabello, Enrique G. Fernández-Abascal y Pablo Fernández-Berrocal. 2021. "Spanish Adaptation and Validation of the 34-Item Self-Report Psychopathy Scale (SRP)". Journal of Personality Disorders 35(2): 217-35. https://doi.org/10.1521/pedi_2019_33_434 PMid:31084555

Guyatt, Gordon H., Marie Townsend, Leslie B. Berman y Jana L. Keller. 1987. "A Comparison of Likert and Visual Analogue Scales for Measuring Change in Function". Journal of Chronic Diseases 40(12): 1129-33. https://doi.org/10.1016/0021-9681(87)90080-4 PMid:3680471

Hasson, Dan y Bengt B. Arnetz. 2005. "Validation and Findings Comparing VAS Vs. Likert Scales for Psychosocial Measurements". International Electronic Journal of Health Education 8: 178-92.

Hayes, Marry H.S. y Donald G. Patterson. 1921. "Experimental Development of the Graphic Rating Method". Psychological Bulletin 18(2): 98-99.

Hilbert, Sven, Helmut Küchenhoff, Nina Sarubin, Tristan T. Nakagawa y Markus Bühner. 2016. "The Influence of the Response Format in a Personality Questionnaire: An Analysis of a Dichotomous, a Likert-Type, and a Visual Analogue Scale". Testing, Psychometrics, Methodology in Applied Psychology 23(1): 3-24.

Huang-Isherwood, Ke M., Steffie S.Y. Kim, Dmitri Williams y Alexander J. Bisberg. 2022. "Las mujeres sostienen (más de) la mitad del cielo: examinando las motivaciones, los comportamientos y el capital social en un juego multijugador popular entre las jugadoras". Revista Internacional de Sociología 80(4): e219. https://doi.org/10.3989/ris.2022.80.4.M22-003

Jamieson, Susan. 2004. "Likert Scales: How to (Ab)Use Them". Medical Education 38(12): 1217-18. https://doi.org/10.1111/j.1365-2929.2004.02012.x PMid:15566531

Knapp, Thomas R. 1990. "Treating Ordinal Scales as Interval Scales: An Attempt To Resolve the Controversy". Nursing Research 39(2): 121-23. https://doi.org/10.1097/00006199-199003000-00019 PMid:2315066

Krieg, Edward F. 1999. "Biases Induced by Coarse Measurement Scales". Educational and Psychological Measurement 59(5): 749-66. https://doi.org/10.1177/00131649921970125

Kronsick, Jon A. y Leandre R. Fabrigar. 1997. "Designing Rating Scales for Effective Measurement in Surveys" Pp. 141-164 . en Survey Measurement and Process Quality, Wiley Series in Probability and Statistics, editado por Lars Lyberg, Paul Biemer, Martin Collins, Edith De Leeuw, Cathryn Dippo, Norbert Schwarz, y Dennis Trewin. New York: John Wiley.

Kuhlmann, Tim, Michael Dantlgraber y Ulf-Dietrich Reips. 2017. "Investigating Measurement Equivalence of Visual Analogue Scales and Likert-Type Scales in Internet-Based Personality Questionnaires". Behavior Research Methods 49(6): 2173-81. https://doi.org/10.3758/s13428-016-0850-x PMid:28130728

Kuzon, William M., Melanie G. Urbanchek y Steven McCabe. 1996. "The Seven Deadly Sins of Statistical Analysis". Annals of Plastic Surgery 37(3): 265-72. Doi: 10.1097/00000637-199609000-00006. https://doi.org/10.1097/00000637-199609000-00006 PMid:8883724

Van Laerhoven, H., Hj van der Zaag-Loonen y Bhf Derkx. 2004. "A Comparison of Likert Scale and Visual Analogue Scales as Response Options in Children's Questionnaires". Acta Paediatrica 93(6): 830-35. https://doi.org/10.1111/j.1651-2227.2004.tb03026.x PMid:15244235

Leung, Shing-On. 2011. "A Comparison of Psychometric Properties and Normality in 4-, 5-, 6-, and 11-Point Likert Scales". Journal of Social Service Research 37(4): 412-21. https://doi.org/10.1080/01488376.2011.580697

Ley Orgánica 3/2018, de 5 de diciembre, de Protección de Datos Personales y garantía de los derechos digitales. 2018. Boletín Oficial del Estado, 294: 119788-119857. Available at: https://www.boe.es/eli/es/lo/2018/12/05/3.

Likert, Rensis. 1932. "A Technique for the Measurement of Attitudes". Archives of Psychology 22(140): 5-55.

Lord, Frederic M. 1953. "On the Statistical Treatment of Football Numbers". American Psychologist 8(12): 750-51. https://doi.org/10.1037/h0063675

Lord, Frederic M., Melvin R. Novick y Allan Birnbaum. 1968. Statistical Theories of Mental Test Scores. Nachdr. Der Ausg. Reading, Mass. [u.a.]. Charlotte, NC: Information Age Publ.

Lorenzo-Seva, Urbano y Pere J. Ferrando. 2006. "Factor: A Computer Program to Fit the Exploratory Factor Analysis Model". Behavior Research Methods 38(1): 88-91. https://doi.org/10.3758/BF03192753 PMid:16817517

Lozano, Luis M., Eduardo García-Cueto y José Muñiz. 2008. "Effect of the Number of Response Categories on the Reliability and Validity of Rating Scales". Methodology 4(2): 73-79. https://doi.org/10.1027/1614-2241.4.2.73

Matejka, Justin, Michael Glueck, Tovi Grossman y George Fitzmaurice. 2016. "The Effect of Visual Appearance on the Performance of Continuous Sliders and Visual Analogue Scales". Pp. 5421-32 in Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, editado por Jofish Kaye, Allison Druin, Cliff Lampe, Dan Morris, Juan P. Hourcade, Loren Terveen, Scooter Morris. San Jose California USA: ACM. https://doi.org/10.1145/2858036.2858063

Myles, Paul S. y Nicole Urquhart. 2005. "The Linearity of the Visual Analogue Scale in Patients with Severe Acute Pain". Anaesthesia and Intensive Care 33(1): 54-58. https://doi.org/10.1177/0310057X0503300108 PMid:15957691

Myles, Paul S., Sally Troedel, Michael Boquest y Mark Reeves. 1999. "The Pain Visual Analog Scale: Is It Linear or Nonlinear?". Anesthesia & Analgesia 89(6): 1517-20. https://doi.org/10.1213/00000539-199912000-00038

Pell, Godfrey. 2005. "Use and Misuse of Likert Scales". Medical Education 39(9): 970-970. https://doi.org/10.1111/j.1365-2929.2005.02237.x PMid:16150039

Pineda, David, Bonifacio Sandín y Peter Muris. 2020. "Psychometrics properties of the Spanish version of two Dark Triad scales: The Dirty Dozen and the Short Dark Triad". Current Psychology 39(5): 1873-81. https://doi.org/10.1007/s12144-018-9888-5

Preston, Carolyn C. y Andrew M. Colman. 2000. "Optimal Number of Response Categories in Rating Scales: Reliability, Validity, Discriminating Power, and Respondent Preferences". Acta Psychologica 104(1): 1-15. https://doi.org/10.1016/S0001-6918(99)00050-5 PMid:10769936

R Core Team. 2022. R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing.

Reips, Ulf-Dietrich y Frederik Funke. 2008. "Interval-Level Measurement with Visual Analogue Scales in Internet-Based Research: VAS Generator". Behavior Research Methods 40(3): 699-704. https://doi.org/10.3758/BRM.40.3.699 PMid:18697664

Roster, Catherine A., Lorenzo Lucianetti y Gerald Albaum. 2015. "Exploring Slider vs. Categorical Response Formats in Web-Based Surveys". Journal of Research Practice 11(1): preprint 1.

Roncero, María, Gertrudis Fornés y Amparo Belloch. 2013. "Hexaco: Una nueva aproximación a la evaluación de la personalidad en español". Revista Argentina de Clínica Psicológica XXII(3): 205-217.

Schoene, Matthew. 2019. "European Disintegration? Euroscepticism and Europe's Rural/Urban Divide". European Politics and Society 20(3): 348-64. https://doi.org/10.1080/23745118.2018.1542768

Schwarz, Norbert. 1999. "Self-Reports: How the Questions Shape the Answers". American Psychologist 54(2): 93-105. https://doi.org/10.1037/0003-066X.54.2.93

Simms, Leonard J., Kerry Zelazny, Trevor F. Williams y Lee Bernstein. 2019. "Does the Number of Response Options Matter? Psychometric Perspectives Using Personality Questionnaire Data". Psychological Assessment 31(4):557-66. https://doi.org/10.1037/pas0000648 PMid:30869956

Stevens, Stanley S. 1946. "On the Theory of Scales of Measurement". Science 103(2684): 677-80. https://doi.org/10.1126/science.103.2684.677

Stoica, Cătălin Augustin y Radu Umbreș. 2021. "Suspicious Minds in Times of Crisis: Determinants of Romanians' Beliefs in COVID-19 Conspiracy Theories". European Societies 23(sup1): S246-61. https://doi.org/10.1080/14616696.2020.1823450

Svensson, Elisabeth. 2000. "Comparison of the Quality of Assessments Using Continuous and Discrete Ordinal Rating Scales". Biometrical Journal 42(4): 417-34. https://doi.org/10.1002/1521-4036(200008)42:4<417::AID-BIMJ417>3.0.CO;2-Z

Toland, Michael D., Caihong Li, Jonathan Kodet y Robert J. Reese. 2021. "Psychometric Properties of the Outcome Rating Scale: An Item Response Theory Analysis". Measurement and Evaluation in Counseling and Development 54(2): 90-105. https://doi.org/10.1080/07481756.2020.1745647

Voutilainen, Ari, Taina Pitkäaho, Tarja Kvist y Katri Vehviläinen-Julkunen. 2016. "How to Ask About Patient Satisfaction? The Visual Analogue Scale Is Less Vulnerable to Confounding Factors and Ceiling Effect Than a Symmetric Likert Scale". Journal of Advanced Nursing 72(4): 946-57. https://doi.org/10.1111/jan.12875 PMid:26689434