Conference Paper: Considerations to evaluate equating results based on IRT calibration and equating

File Download
Supplementary
  • Basic View
  • Metadata View
  • XML View
TitleConsiderations to evaluate equating results based on IRT calibration and equating
AuthorsZhao, Y
Issue Date2011
PublisherThe Psychometric Society.
CitationThe 76th Annual and the 17th International Meeting of the Psychometric Society (IMPS 2011), Hong Kong, 18-22 July 2011. In Conference Program of the IMPS 2011, 2011, p. 232 [How to Cite?]
AbstractItem Response Theory (IRT) is commonly used to calibrate and equate the state assessment test programs. Equating is one of the crucial steps to generate score conversion table which is used for producing scale score and proficiency level for each individual student. Whether or not the equating is conducted properly considering its practical consequences? Whether or not the anchor set is appropriately applied for the use of equating? Are there any outlier anchor items to be removed from the anchor set? This presentation highlights some considerations to evaluate equating results, including IRT model fit, Test Characteristic Curves (TCCs), score distributions, the score and proficiency profile from the reference year, and property of the anchor set. Also, the consideration and alternative to remove outlier anchor items is discussed. Examples are illustrated as well to address the practical consequences of equating.
DescriptionParallel Session: Equating and Linking: no. D1-LP-06
DC Field
Value
dc.contributor.authorZhao, Y
dc.date.accessioned2012-08-16T06:25:31Z
dc.date.available2012-08-16T06:25:31Z
dc.date.issued2011
dc.description.abstractItem Response Theory (IRT) is commonly used to calibrate and equate the state assessment test programs. Equating is one of the crucial steps to generate score conversion table which is used for producing scale score and proficiency level for each individual student. Whether or not the equating is conducted properly considering its practical consequences? Whether or not the anchor set is appropriately applied for the use of equating? Are there any outlier anchor items to be removed from the anchor set? This presentation highlights some considerations to evaluate equating results, including IRT model fit, Test Characteristic Curves (TCCs), score distributions, the score and proficiency profile from the reference year, and property of the anchor set. Also, the consideration and alternative to remove outlier anchor items is discussed. Examples are illustrated as well to address the practical consequences of equating.
dc.description.naturelink_to_OA_fulltext
dc.descriptionParallel Session: Equating and Linking: no. D1-LP-06
dc.identifier.citationThe 76th Annual and the 17th International Meeting of the Psychometric Society (IMPS 2011), Hong Kong, 18-22 July 2011. In Conference Program of the IMPS 2011, 2011, p. 232 [How to Cite?]
dc.identifier.epage232
dc.identifier.hkuros203307
dc.identifier.spage232
dc.identifier.urihttp://hdl.handle.net/10722/160930
dc.languageeng
dc.publisherThe Psychometric Society.
dc.relation.ispartofConference Program of the 76th Annual and 17th International Meeting of the Psychometric Society, IMPS 2011
dc.titleConsiderations to evaluate equating results based on IRT calibration and equating
dc.typeConference_Paper