The Journey from Likert to Forced-Choice QuestionnairesEvidence of the Invariance of Item Parameters

Referencias bibliográficas

• Andrich, D. (1989). A probabilistic IRT model for unfolding preference data. Applied Psychological Measurement, 13, 193-216. https://doi. org/10.1177/014662168901300211
• Andrich, D. (1995). Hyperbolic cosine latent trait models for unfolding direct responses and pairwise preferences. Applied Psychological Measurement, 19, 269-290. https://doi.org/10.1177/014662169501900306
• Asparouhov, T., & Muthén, B. O. (2010). Computing the strictly positive Satorra-Bentler chi-square test in Mplus. Retrieved from https://www. statmodel.com/examples/webnotes/SB5.pdf
• Barrick, M. R., & Mount, M. K. (1991). The Big Five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44, 1-26. https://doi.org/10.1111/j.1744-6570.1991.tb00688.x
• Barrick, M. R., Mount, M. K., & Judge, T. (2001). Personality and performance at the beginning of the new millennium: What do we know and where do we go next? International Journal of Selection and Assessment, 9, 9-30. https://doi.org/10.1111/1468-2389.00160
• Bartram, D. (1996). The relationship between ipsatized and normative measures of personality. Journal of Occupational & Organizational Psychology, 69, 2539. https://doi.org/10.1111/j.2044-8325.1996.tb00597.x
• Bartram, D., Brown, A., Fleck, S., Inceoglu, I., & Ward, K. (2006). OPQ32 technical manual. Surrey, UK: SHL.
• Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In F. M. Lord & M. R. Novick (Eds.), Statistical theories of mental test scores. Reading, MA: Addison-Wesley Pub. Co.
• Brown, A. (2018). Item Response Theory approaches to test scoring and evaluating the score accuracy. In P. Irwing, T. Booth, & D. Hughes (Eds.), The Wiley handbook of psychometric testing. London, UK: John Wiley & Sons. https://doi.org/10.1002/9781118489772.ch20
• Brown, A., & Bartram, D. (2011). OPQ32r technical manual. Surrey, UK: SHL. Brown, A., & Maydeu-Olivares, A. (2011). Item response modeling of forced choice questionnaires. Educational and Psychological Measurement, 71, 460-502. https://doi.org/10.1177/0013164410375112
• Christiansen, N. D., Burns, G. N., & Montgomery, G. E. (2005). Reconsidering forced-choice item formats for applicant personality assessment. Human Performance, 18, 267-307. https://doi.org/10.1207/ s15327043hup1803_4
• Cornwell, J. M., & Dunlap, W. P. (1994). On the questionable soundness of factoring ipsative data: A response to Saville & Willson (1991). Journal of Occupational & Organizational Psychology, 67, 89-100. https://doi. org/10.1111/j.2044-8325.1994.tb00553.x
• Fisher, R. A. (1922). On the mathematical foundations of theoretical statistics. Philosophical Transactions of the Royal Society of London. Series A, Mathematical or Physical Character, 222(594-604), 309-368. https://doi.org/10.1098/rsta.1922.0009
• Ghiselli, E. E. (1954). The forced-choice technique in self-description. Personnel Psychology, 7, 201-208. https://doi.org/10.1111/j.1744-6570.1954.tb01593.x
• Goldberg, L. R. (1999). A broad-bandwidth, public domain, personality inventory measuring the lower-level facets of several five-factor models. In I. Mervielde, I. Deary, F. De Fruyt, & F. Ostendorf (Eds.), Personality psychology in Europe (Vol. 7, pp. 7-28). Tilburg, The Netherlands: Tilburg University Press.
• Hallquist, M. N., & Wiley, J. F. (2018). MplusAutomation: An R package for facilitating large-scale latent variable analyses in Mplus. Structural Equation Modeling: A Multidisciplinary Journal, 0, 1-18. https://doi.org /10.1080/10705511.2017.1402334
• Hicks, L. E. (1970). Some properties of ipsative, normative, and forcedchoice normative measures. Psychological Bulletin, 74, 167-184. https://doi.org/10.1037/h0029780
• Judge, T. A., Rodel, J. B., Klinger, R. L., Simon, L. S., & Crawford, E. R. (2013). Hierarchical representations of the five-factor model of personality in predicting job performance: Integrating three organizing frameworks with two theoretical perspectives. Journal of Applied Psychology, 98, 875-925. https://doi.org/10.1037/a0033901
• Kreitchmann, R. S., Morillo, D., Ponsoda, V., & Leenen, I. (2017). An optimization procedure for assembling multidimensional forcedchoice blocks. International Meeting of the Psychometric Society 2017. Zürich, Switzerland. Retrieved from https://www.psychometricsociety. org/sites/default/files/IMPS_2017_Talks_w_Cover.pdf
• Lee, P., Joo, S.-H., Stark, S., & Chernyshenko, O. S. (2018). GGUM-RANK statement and person parameter estimation with multidimensional forced choice triplets. Applied Psychological Measurement (Advance online publication). https://doi.org/10.1177/0146621618768294
• Lee, P., Lee, S., & Stark, S. (2018). Examining validity evidence for multidimensional forced choice measures with different scoring approaches. Personality and Individual Differences, 123, 229-235. https://doi.org/10.1016/j.paid.2017.11.031
• Lin, Y., & Brown, A. (2017). Influence of context on item parameters in forced-choice personality assessments. Educational and Psychological Measurement, 77, 389-414. https://doi.org/10.1177/0013164416646162
• Lozano, L. M., García-Cueto, E., & Muñiz, J. (2008). Effect of the number of response categories on the reliability and validity of rating scales. Methodology, 4, 73-79. https://doi.org/10.1027/1614-2241.4.2.73
• Maniaci, M. R., & Rogge, R. D. (2014). Caring about carelessness: Participant inattention and its effects on research. Journal of Research in Personality, 48, 61-83. https://doi.org/10.1016/j.jrp.2013.09.008
• McCrae, R. R., & John, O. P. (1992). An introduction to the five-factor model and its applications. Journal of Personality, 60, 175-215. https://doi. org/10.1111/j.1467-6494.1992.tb00970.x
• Morillo, D. (2018). Item response theory models for forced-choice questionnaires (Doctoral dissertation). Universidad Autónoma de Madrid. Retrieved from https://repositorio.uam.es/handle/10486/686097
• Morillo, D., Leenen, I., Abad, F. J., Hontangas, P., De la Torre, J., & Ponsoda, V. (2016). A dominance variant under the multi-unidimensional pairwise-preference framework: Model formulation and Markov chain Monte Carlo estimation. Applied Psychological Measurement, 40, 500516. https://doi.org/10.1177/0146621616662226
• Muthén, L. K., & Muthén, B. O. (1998). Mplus user’s guide (7th ed.). Los Angeles, CA: Muthén & Muthén.
• R Core Team. (2017). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Retrieved from https://www.R-project.org/
• Ryan, A. M., & Ployhart, R. E. (2014). A century of selection. Annual Review of Psychology, 65, 693-717. https://doi.org/10.1146/annurevpsych-010213-115134
• Salgado, J. F. (2017). Moderator effects of job complexity on the validity of forced-choice personality inventories for predicting job performance. Journal of Work and Organizational Psychology, 33, 229-238. https:// doi.org/10.1016/j.rpto.2017.07.001
• Salgado, J. F., Anderson, N., & Tauriz, G. (2015). The validity of ipsative and quasi-ipsative forced-choice personality inventories for different occupational groups: A comprehensive meta-analysis. Journal of Occupational and Organizational Psychology, 88, 797-834. https://doi. org/10.1111/joop.12098
• Salgado, J. F., & Lado, M. (2018). Faking resistance of a quasi-ipsative forcedchoice personality inventory without algebraic dependence. Journal of Work and Organizational Psychology, 34, 213-216. https://doi. org/10.5093/jwop2018a23
• Salgado, J. F., & Táuriz, G. (2014). The five-factor model, forced-choice personality inventories and performance: A comprehensive metaanalysis of academic and occupational validity studies. European Journal of Work and Organizational Psychology, 23, 3-30. https://doi. org/10.1080/1359432X.2012.716198
• Samejima, F. (1968). Estimation of latent ability using a response pattern of graded scores. ETS Research Report Series, 1968(1). https://doi. org/10.1002/j.2333-8504.1968.tb00153.x
• Satorra, A., & Bentler, P. M. (2010). Ensuring positiveness of the scaled difference chi-square test statistic. Psychometrika, 75, 243-248. https://doi.org/10.1007/s11336-009-9135-y
• Saville, P., & Willson, E. (1991). The reliability and validity of normative and ipsative approaches in the measurement of personality. Journal of Occupational Psychology, 64, 219-238. https://doi. org/10.1111/j.2044-8325.1991.tb00556.x
• Scott, W. A. (1968). Comparative validities of forced-choice and singlestimulus tests. Psychological Bulletin, 70, 231-244. https://doi. org/10.1037/h0026262
• Sisson, E. D. (1948). Forced choice The new Army rating. Personnel Psychology, 1, 365-381. https://doi.org/10.1111/j.1744-6570.1948. tb01316.x
• Stark, S., Chernyshenko, O. S., & Drasgow, F. (2005). An IRT approach to constructing and scoring pairwise preference items involving stimuli on different dimensions: The multi-unidimensional pairwisepreference model. Applied Psychological Measurement, 29, 184-203. https://doi.org/10.1177/0146621604273988
• Tett, R., Rothstein, M. G., & Jackson, D. J. (1991). Personality measures as predictors of job performance: A meta-analytic review. Personnel Psychology, 44, 703-742. https://doi.org/10.1111/j.1744-6570.1991. tb00696.x
• Thurstone, L. L. (1927). A law of comparative judgment. Psychological Review, 34, 273-286. https://doi.org/10.1037/h0070288
• Wilks, S. S. (1938). The large-sample distribution of the likelihood ratio for testing composite hypotheses. The Annals of Mathematical Statistics, 9, 60-62. https://doi.org/10.1214/aoms/1177732360
• Yousfi, S., & Brown, A. (2014). Optimal forced-choice measurement for workplace assessments. The 9th Conference of the ITC: Global and Local Challenges for Best Practices in Assessment. San Sebastián, Spain.
• Yuan, K.-H., & Bentler, P. M. (2000). Three likelihood-based methods for mean and covariance structure analysis with nonnormal missing data. Sociological Methodology, 3, 165-200. https://doi.org/10.1111/00811750.00078