A systematic evaluation of payback of publicly funded health and health services research in Hong Kong

Abstract

Background: The Health and Health Services Research Fund (HHSRF) is dedicated to support research related to all aspects of health and health services in Hong Kong. We evaluated the fund's outcomes and explored factors associated with the translation of research findings to changes in health policy and provider behaviour. Methods: A locally suitable questionnaire was developed based on the "payback" evaluation framework and was sent to principal investigators of the completed research projects supported by the fund since 1993. Research "payback" in six outcome areas was surveyed, namely knowledge production, use of research in the research system, use of research project findings in health system policy/decision making, application of the research findings through changed behaviour, factors influencing the utilisation of research, and health /health service/ economic benefits. Results: Principal investigators of 178 of 205 (87%) completed research projects returned the questionnaire. Investigators reported research publications in 86.5% (mean = 5.4 publications per project), career advancement 34.3%, acquisition of higher qualifications 38.2%, use of results in policy making 35.4%, changed behaviour in light of findings 49.4%, evidence of health service benefit 42.1% and generated subsequent research in 44.9% of the projects. Payback outcomes were positively associated with the amount of funding awarded. Multivariate analysis found participation of investigators in policy committees and liaison with potential users were significantly associated with reported health service benefit (odds ratio [OR] participation=2.86, 95% confidence interval [CI] 1.28-6.40; OR liaison=2.03, 95% CI 1.05-3.91), policy and decision-making (OR participation=10.53, 95% CI 4.13-26.81; OR liaison=2.52, 95% CI 1.20-5.28), and change in behaviour (OR participation=3.67, 95% CI 1.53-8.81). Conclusions: The HHSRF has produced substantial outcomes and compared favourably with similar health research funds in other developed economies. Further studies are needed to better understand the factors and pathways associated with the translation of research findings into practice. N.B. Patrick Kwan and Janice Johnston contributed equally to this work. The results of this study were published in BMC Health Services Research 2007;7:121 (30 July 2007). Available at http://www.biomedcentral.com/1472-6963/7/121 or the Research Fund Secretariat website http://www.fhb.gov.hk/grants