File Download
Supplementary
-
Citations:
- Appears in Collections:
Conference Paper: Summative clinical assessments: tensions between authenticity, reliability and assessment 'for' learning
Title | Summative clinical assessments: tensions between authenticity, reliability and assessment 'for' learning |
---|---|
Authors | |
Keywords | Medical sciences Dentistry |
Issue Date | 2015 |
Publisher | Blackwell Munksgaard. The Journal's web site is located at http://www.blackwellpublishing.com/journals/EJE |
Citation | The 40th Annual Meeting of the Association for Dental Education in Europe (ADEE 2014), Latvia, Riga, 28-30 August 2014. In European Journal of Dental Education, 2015, v. 19 n. 1, p. e11 How to Cite? |
Abstract | AIMS: The role of summative clinical performance tasks in an assessment ‘for’ learning philosophy potentially broadens thinking about their use. The aim of this study was to qualitatively explore student and staff perceptions of standards, judgment practices and feedback in summative clinical assessments. MATERIALS AND METHODS: Interviews were recorded with 3 focus groups of undergraduate dental students (n = 24) and 6 individual clinical academic staff. IRB approval was obtained. Interviews were transcribed and a thematic analysis was performed. RESULTS: Two key themes were identified: the tension between validity and reliability; and the role of assessment for learning. Positive and negative aspects were identified. Students and clinical staff recognized the value of the high-stakes summative clinical skills assessments as authentic and requisite for professional gate-keeping. While supporting the assessment for learning agenda, this perceived high validity, also raised complex issues regarding reliability. These issues included: task design, case complexity, assessor values and judgment practices, and interrater reliability. Student stress was seen as negative in terms of preparation and the procedure itself as well as issues of fairness in final judgments; however, stress was seen as positive with feedback on failure cases enhancing learning. Standards setting were perceived by staff as helpful in supporting reliability; however, counter to expectation, students did not value these as strongly nor did they perceive these to be part of an assessment for learning framework. Additionally, students felt feedback processes were variable with written comments perceived as mainly for faculty validation rather than for self-improvement. CONCLUSION: These highly valid, authentic assessments are required for determining competence and facilitating learning. Assessment managers should consider task design and clearly communicate aims and expectations to students, for example, through the use of exemplars and calibration practices. In addition, formative feedback should be detailed for such summative tasks. |
Description | Meeting Theme: Emerging New Approaches to Dental Education Poster Abstract Titles listed by theme - Posters selected for Oral Presentation: Assessment This journal issue pp. e1-e35 entitled: Proceedings: 40th Annual Meeting of the Association for Dental Education in Europe (ADEE) |
Persistent Identifier | http://hdl.handle.net/10722/207776 |
ISSN | 2023 Impact Factor: 1.7 2023 SCImago Journal Rankings: 0.633 |
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Botelho, M | - |
dc.contributor.author | Bridges, S | - |
dc.date.accessioned | 2015-01-19T10:34:50Z | - |
dc.date.available | 2015-01-19T10:34:50Z | - |
dc.date.issued | 2015 | - |
dc.identifier.citation | The 40th Annual Meeting of the Association for Dental Education in Europe (ADEE 2014), Latvia, Riga, 28-30 August 2014. In European Journal of Dental Education, 2015, v. 19 n. 1, p. e11 | - |
dc.identifier.issn | 1396-5883 | - |
dc.identifier.uri | http://hdl.handle.net/10722/207776 | - |
dc.description | Meeting Theme: Emerging New Approaches to Dental Education | - |
dc.description | Poster Abstract Titles listed by theme - Posters selected for Oral Presentation: Assessment | - |
dc.description | This journal issue pp. e1-e35 entitled: Proceedings: 40th Annual Meeting of the Association for Dental Education in Europe (ADEE) | - |
dc.description.abstract | AIMS: The role of summative clinical performance tasks in an assessment ‘for’ learning philosophy potentially broadens thinking about their use. The aim of this study was to qualitatively explore student and staff perceptions of standards, judgment practices and feedback in summative clinical assessments. MATERIALS AND METHODS: Interviews were recorded with 3 focus groups of undergraduate dental students (n = 24) and 6 individual clinical academic staff. IRB approval was obtained. Interviews were transcribed and a thematic analysis was performed. RESULTS: Two key themes were identified: the tension between validity and reliability; and the role of assessment for learning. Positive and negative aspects were identified. Students and clinical staff recognized the value of the high-stakes summative clinical skills assessments as authentic and requisite for professional gate-keeping. While supporting the assessment for learning agenda, this perceived high validity, also raised complex issues regarding reliability. These issues included: task design, case complexity, assessor values and judgment practices, and interrater reliability. Student stress was seen as negative in terms of preparation and the procedure itself as well as issues of fairness in final judgments; however, stress was seen as positive with feedback on failure cases enhancing learning. Standards setting were perceived by staff as helpful in supporting reliability; however, counter to expectation, students did not value these as strongly nor did they perceive these to be part of an assessment for learning framework. Additionally, students felt feedback processes were variable with written comments perceived as mainly for faculty validation rather than for self-improvement. CONCLUSION: These highly valid, authentic assessments are required for determining competence and facilitating learning. Assessment managers should consider task design and clearly communicate aims and expectations to students, for example, through the use of exemplars and calibration practices. In addition, formative feedback should be detailed for such summative tasks. | - |
dc.language | eng | - |
dc.publisher | Blackwell Munksgaard. The Journal's web site is located at http://www.blackwellpublishing.com/journals/EJE | - |
dc.relation.ispartof | European Journal of Dental Education | - |
dc.rights | The definitive version is available at www.blackwell-synergy.com | - |
dc.subject | Medical sciences | - |
dc.subject | Dentistry | - |
dc.title | Summative clinical assessments: tensions between authenticity, reliability and assessment 'for' learning | - |
dc.type | Conference_Paper | - |
dc.identifier.email | Botelho, M: botelho@hkucc.hku.hk | - |
dc.identifier.email | Bridges, S: sbridges@hku.hk | - |
dc.identifier.authority | Botelho, M=rp00033 | - |
dc.identifier.authority | Bridges, S=rp00048 | - |
dc.description.nature | link_to_OA_fulltext | - |
dc.identifier.doi | 10.1111/eje.12134 | - |
dc.identifier.hkuros | 242013 | - |
dc.identifier.volume | 19 | - |
dc.identifier.issue | 1 | - |
dc.identifier.spage | e11 | - |
dc.identifier.epage | e11 | - |
dc.publisher.place | Denmark | - |
dc.identifier.issnl | 1396-5883 | - |