File Download
There are no files associated with this item.
Links for fulltext
(May Require Subscription)
- Publisher Website: 10.1177/1094428116630065
- Scopus: eid_2-s2.0-84974527970
- WOS: WOS:000378754900007
- Find via
Supplementary
- Citations:
- Appears in Collections:
Article: Validity and Reliability of Situational Judgement Test Scores: A New Approach Based on Cognitive Diagnosis Models
Title | Validity and Reliability of Situational Judgement Test Scores: A New Approach Based on Cognitive Diagnosis Models |
---|---|
Authors | |
Keywords | cognitive diagnosis models |
Issue Date | 2016 |
Citation | Organizational Research Methods, 2016, v. 19, n. 3, p. 506-532 How to Cite? |
Abstract | © The Author(s) 2016.Conventional methods for assessing the validity and reliability of situational judgment test (SJT) scores have proven to be inadequate. For example, factor analysis techniques typically lead to nonsensical solutions, and assumptions underlying Cronbach’s alpha coefficient are violated due to the multidimensional nature of SJTs. In the current article, we describe how cognitive diagnosis models (CDMs) provide a new approach that not only overcomes these limitations but that also offers extra advantages for scoring and better understanding SJTs. The analysis of the Q-matrix specification, model fit, and model parameter estimates provide a greater wealth of information than traditional procedures do. Our proposal is illustrated using data taken from a 23-item SJT that presents situations about student-related issues. Results show that CDMs are useful tools for scoring tests, like SJTs, in which multiple knowledge, skills, abilities, and other characteristics are required to correctly answer the items. SJT classifications were reliable and significantly related to theoretically relevant variables. We conclude that CDM might help toward the exploration of the nature of the constructs underlying SJT, one of the principal challenges in SJT research. |
Persistent Identifier | http://hdl.handle.net/10722/228249 |
ISSN | 2021 Impact Factor: 8.247 2020 SCImago Journal Rankings: 5.901 |
ISI Accession Number ID |
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Sorrel, Miguel A. | - |
dc.contributor.author | Olea, Julio | - |
dc.contributor.author | Abad, Francisco J. | - |
dc.contributor.author | de la Torre, Jimmy | - |
dc.contributor.author | Aguado, David | - |
dc.contributor.author | Lievens, Filip | - |
dc.date.accessioned | 2016-08-01T06:45:34Z | - |
dc.date.available | 2016-08-01T06:45:34Z | - |
dc.date.issued | 2016 | - |
dc.identifier.citation | Organizational Research Methods, 2016, v. 19, n. 3, p. 506-532 | - |
dc.identifier.issn | 1094-4281 | - |
dc.identifier.uri | http://hdl.handle.net/10722/228249 | - |
dc.description.abstract | © The Author(s) 2016.Conventional methods for assessing the validity and reliability of situational judgment test (SJT) scores have proven to be inadequate. For example, factor analysis techniques typically lead to nonsensical solutions, and assumptions underlying Cronbach’s alpha coefficient are violated due to the multidimensional nature of SJTs. In the current article, we describe how cognitive diagnosis models (CDMs) provide a new approach that not only overcomes these limitations but that also offers extra advantages for scoring and better understanding SJTs. The analysis of the Q-matrix specification, model fit, and model parameter estimates provide a greater wealth of information than traditional procedures do. Our proposal is illustrated using data taken from a 23-item SJT that presents situations about student-related issues. Results show that CDMs are useful tools for scoring tests, like SJTs, in which multiple knowledge, skills, abilities, and other characteristics are required to correctly answer the items. SJT classifications were reliable and significantly related to theoretically relevant variables. We conclude that CDM might help toward the exploration of the nature of the constructs underlying SJT, one of the principal challenges in SJT research. | - |
dc.language | eng | - |
dc.relation.ispartof | Organizational Research Methods | - |
dc.subject | cognitive diagnosis models | - |
dc.title | Validity and Reliability of Situational Judgement Test Scores: A New Approach Based on Cognitive Diagnosis Models | - |
dc.type | Article | - |
dc.description.nature | link_to_subscribed_fulltext | - |
dc.identifier.doi | 10.1177/1094428116630065 | - |
dc.identifier.scopus | eid_2-s2.0-84974527970 | - |
dc.identifier.hkuros | 279719 | - |
dc.identifier.volume | 19 | - |
dc.identifier.issue | 3 | - |
dc.identifier.spage | 506 | - |
dc.identifier.epage | 532 | - |
dc.identifier.eissn | 1552-7425 | - |
dc.identifier.isi | WOS:000378754900007 | - |
dc.identifier.issnl | 1094-4281 | - |