Regulatory assessment of the consultation competence of Family Physicians in Hong Kong

Abstract

Objective: To evaluate the Consultation Skills Assessment (CSA) component of the Exit Assessment of the Higher Vocational Training Programme of the Hong Kong College of Family Physicians with particular reference to content validity and reliability. Design: An observational study in which candidates were directly observed and independently assessed by three assessors in the candidates' own practice setting during which they were expected to consult with six unselected and consecutive patients within two hours of consulting time. Subjects: Eighty-one candidates, 476 patients and 26 assessors (one external). Main outcome measures: Content validity and reliability (contributions to variance and generalisability) of the overall process. Results: Between 1997 and 2003, 81 clinical assessments were carried out. Internal assessors conducted a range of 1-19 assessments and the external assessor was present at 59 assessments (78.7%). The pass rate per CSA diet varied from 25-100%.