File Download
There are no files associated with this item.
Supplementary
-
Citations:
- Appears in Collections:
Conference Paper: Do I complete Q?
Title | Do I complete Q? |
---|---|
Authors | |
Issue Date | 2018 |
Publisher | Psychometric Society. |
Citation | The International Meeting of the Psychometric Society, New York, NY, 10-13 July 2018 How to Cite? |
Abstract | A central component for most cognitive diagnosis models (CDMs) is an item and attribute association
matrix (Q‐matrix; Tatsuoka, 1983), which specifies whether an attribute is measured by each item. A
complete Q‐matrix, which may or may not involve an identity matrix, is necessary for the identification of
all attribute profiles. However, the completeness, or lack thereof, of a particular Q‐matrix may vary from
one CDM to another. A method that has been proposed by Kohn & Chiu (2017) to assess Q‐matrix
completeness is to compare the success probabilities across the items of the different attribute profiles.
This method presupposes that the underlying CDMs are known, a condition that is difficult to meet in
practice. The current work proposes a simulation‐based approach to assess Q‐matrix completeness. The
proposed method involves determining the simplest CDMs empirically, and disentangling completeness
from test reliability. A simulation study is conducted to evaluate the viability of the proposed method.
Results show that the simulation‐based method performs well under most conditions, but needs to be
used with caution when the sample size is small and items are of inadequate quality. A set of real data is
also analyzed to examine the proposed procedure. |
Persistent Identifier | http://hdl.handle.net/10722/259807 |
DC Field | Value | Language |
---|---|---|
dc.contributor.author | de la Torre, J | - |
dc.contributor.author | Ma, W | - |
dc.date.accessioned | 2018-09-03T04:14:21Z | - |
dc.date.available | 2018-09-03T04:14:21Z | - |
dc.date.issued | 2018 | - |
dc.identifier.citation | The International Meeting of the Psychometric Society, New York, NY, 10-13 July 2018 | - |
dc.identifier.uri | http://hdl.handle.net/10722/259807 | - |
dc.description.abstract | A central component for most cognitive diagnosis models (CDMs) is an item and attribute association matrix (Q‐matrix; Tatsuoka, 1983), which specifies whether an attribute is measured by each item. A complete Q‐matrix, which may or may not involve an identity matrix, is necessary for the identification of all attribute profiles. However, the completeness, or lack thereof, of a particular Q‐matrix may vary from one CDM to another. A method that has been proposed by Kohn & Chiu (2017) to assess Q‐matrix completeness is to compare the success probabilities across the items of the different attribute profiles. This method presupposes that the underlying CDMs are known, a condition that is difficult to meet in practice. The current work proposes a simulation‐based approach to assess Q‐matrix completeness. The proposed method involves determining the simplest CDMs empirically, and disentangling completeness from test reliability. A simulation study is conducted to evaluate the viability of the proposed method. Results show that the simulation‐based method performs well under most conditions, but needs to be used with caution when the sample size is small and items are of inadequate quality. A set of real data is also analyzed to examine the proposed procedure. | - |
dc.language | eng | - |
dc.publisher | Psychometric Society. | - |
dc.relation.ispartof | The International Meeting of the Psychometric Society | - |
dc.title | Do I complete Q? | - |
dc.type | Conference_Paper | - |
dc.identifier.email | de la Torre, J: jdltorre@hku.hk | - |
dc.identifier.authority | de la Torre, J=rp02159 | - |
dc.identifier.hkuros | 288996 | - |
dc.publisher.place | New York, NY | - |