Remember Me
Or use your Academic/Social account:


Or use your Academic/Social account:


You have just completed your registration at OpenAire.

Before you can login to the site, you will need to activate your account. An e-mail will be sent to you with the proper instructions.


Please note that this site is currently undergoing Beta testing.
Any new content you create is not guaranteed to be present to the final version of the site upon release.

Thank you for your patience,
OpenAire Dev Team.

Close This Message


Verify Password:
Verify E-mail:
*All Fields Are Required.
Please Verify You Are Human:
fbtwitterlinkedinvimeoflicker grey 14rssslideshare1
Brown, Anna; Maydeu-Olivares, Alberto (2011)
Languages: English
Types: Article
Subjects: HA
Multidimensional forced-choice formats can significantly reduce the impact of numerous response biases typically associated with rating scales. However, if scored with classical methodology, these questionnaires produce ipsative data, which lead to distorted scale relationships and make comparisons between individuals problematic. This research demonstrates how item response theory (IRT) modeling may be applied to overcome these problems. A multidimensional IRT model based on Thurstone’s framework for comparative data is introduced, which is suitable for use with any forced-choice questionnaire composed of items fitting the dominance response model, with any number of measured traits, and any block sizes (i.e., pairs, triplets, quads, etc.). Thurstonian IRT models are normal ogive models with structured factor loadings, structured uniquenesses, and structured local dependencies. These models can be straightforwardly estimated using structural equation modeling (SEM) software Mplus. A number of simulation studies are performed to investigate how latent traits are recovered under various forced-choice designs and provide guidelines for optimal questionnaire design. An empirical application is given to illustrate how the model may be applied in practice. It is concluded that when the recommended design guidelines are met, scores estimated from forced-choice questionnaires with the proposed methodology reproduce the latent traits well.
  • The results below are discovered through our pilot algorithms. Let us know how we are doing!

    • Hogan, R. (1983). A socioanalytic theory of personality. In M.M. Page (Ed.), Nebraska Symposium on Motivation (pp. 336-355). Lincoln: University of Nebraska Press.
    • Maydeu-Olivares, A. (1999). Thurstonian modeling of ranking data via mean and covariance structure analysis. Psychometrika, 64, 325-340.
    • Maydeu-Olivares, A. & Böckenholt, U. (2005). Structural equation modeling of paired comparisons and ranking data. Psychological Methods, 10, 285-304.
    • Maydeu-Olivares, A. & Coffman, D. L. (2006). Random intercept item factor analysis. Psychological Methods, 11, 344-362.
    • McCloy, R., Heggestad, E., Reeve, C. (2005). A Silk Purse From the Sow's Ear: Retrieving Normative Information From Multidimensional Forced-Choice Items. Organizational Research Methods, 8, 222-248.
    • McDonald, R.P. (1999). Test theory. A unified approach. Mahwah, NJ: Lawrence Erlbaum.
    • Meade, A. (2004). Psychometric problems and issues involved with creating and using ipsative measures for selection. Journal of Occupational and Organisational Psychology, 77, 531-552.
    • Muthén, L.K. & Muthén, B. (1998-2007). Mplus 5. Los Angeles, CA: Muthén & Muthén.
    • Reckase, M. (2009). Multidimensional Item Response Theory. New York: Springer.
    • Samejima, F. (1969). Calibration of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement, No. 17.
    • SHL. (1997). Customer Contact: Manual and User’s Guide. Surrey, UK. SHL Group.
    • SHL. (2006). OPQ32 Technical Manual. Surrey, UK. SHL Group.
    • Stark, S., Chernyshenko, O. & Drasgow, F. (2005). An IRT approach to constructing and scoring pairwise preference items involving stimuli on different dimensions: The Multi-Unidimensional Pairwise-Preference Model. Applied Psychological Measurement, 29, 184-203.
    • Stark, S., Chernyshenko, O., Drasgow, F. & Williams, B. (2006). Examining assumptions about item responding in personality assessment: should ideal point methods be considered for scale development and scoring? Journal of Applied Psychology, 91, 25- 39.
    • Tenopyr, M. L. (1988). Artifactual reliability of forced-choice scales. Journal of Applied Psychology, 73, 749-751.
    • Thurstone, L.L. (1927). A law of comparative judgment. Psychological Review, 79, 281-299.
    • Thurstone, L.L. (1931). Rank order as a psychological method. Journal of Experimental Psychology, 14, 187-201.
    • Van Herk, H., Poortinga, Y., & Verhallen, T. (2004). Response Styles in Rating Scales: Evidence of Method Bias in Data From Six EU Countries. Journal of Cross-Cultural Psychology, 35, 346.
  • No related research data.
  • Discovered through pilot similarity algorithms. Send us your feedback.

Share - Bookmark

Download from

Cite this article