Remember Me
Or use your Academic/Social account:


Or use your Academic/Social account:


You have just completed your registration at OpenAire.

Before you can login to the site, you will need to activate your account. An e-mail will be sent to you with the proper instructions.


Please note that this site is currently undergoing Beta testing.
Any new content you create is not guaranteed to be present to the final version of the site upon release.

Thank you for your patience,
OpenAire Dev Team.

Close This Message


Verify Password:
Verify E-mail:
*All Fields Are Required.
Please Verify You Are Human:
fbtwitterlinkedinvimeoflicker grey 14rssslideshare1
Bates, Imelda; Boyd, Alan; Aslanyan, Garry; Cole, Donald C. (2017)
Publisher: Oxford University Press
Languages: English
Types: Article
Subjects: capacity strengthening, f0e481db, wa_20_5, Original Articles, wa_30, health, Low- and middle-income countries, research

Classified by OpenAIRE into

mesheuropmc: macromolecular substances
Strengthening research capacity in low- and middle-income countries is one of the most effective ways of advancing their health and development but the complexity and heterogeneity of health research capacity strengthening (RCS) initiatives means it is difficult to evaluate their effectiveness. Our study aimed to enhance understanding about these difficulties and to make recommendations about how to make health RCS evaluations more effective. Through discussions and surveys of health RCS funders, including the ESSENCE on Health Research initiative, we identified themes that were important to health RCS funders and used these to guide a systematic analysis of their evaluation reports. Eighteen reports, produced between 2000 and 2013, representing 12 evaluations, were purposefully selected from 54 reports provided by the funders to provide maximum variety. Text from the reports was extracted independently by two authors against a pre-designed framework. Information about the health RCS approaches, tensions and suggested solutions was re-constructed into a narrative. Throughout the process contacts in the health RCS funder agencies were involved in helping us to validate and interpret our results. The focus of the health RCS evaluations ranged from individuals and institutions to national, regional and global levels. Our analysis identified tensions around how much stakeholders should participate in an evaluation, the appropriate balance between measuring and learning and between a focus on short-term processes vs longer-term impact and sustainability. Suggested solutions to these tensions included early and ongoing stakeholder engagement in planning and evaluating health RCS, modelling of impact pathways and rapid assimilation of lessons learned for continuous improvement of decision making and programming. The use of developmental approaches could improve health RCS evaluations by addressing common tensions and promoting sustainability. Sharing learning about how to do robust and useful health RCS evaluations should happen alongside, not after, health RCS efforts.
  • The results below are discovered through our pilot algorithms. Let us know how we are doing!

    • Agyepong I, Kitua A, Borleffs J. 2008. Mid-term Evaluation Report, NACCAP Programmes First Call: INTERACT. The Hague: NACCAP.
    • Bates I, Taegtmeyer M, Squire SB et al. 2011. Indicators of sustainable capacity building for health research: analysis of four African case studies. Health Research Policy and Systems 9: 1-9.
    • Bennett S, Paina L, Kim C et al. 2010. What must be done to enhance capacity for Health Systems Research? In: World Health Organization (ed). Background papers commissioned by the Symposium Secretariat for the First Global Symposium on Health Systems Research, November 16-19, 2010, Montreux, Switzerland. http://www.rockefellerfoundation.org/uploads/files/c4ccb675-f6f8- 47de-8552-e032d4c3fc20.pdf, accessed 3 March 2014.
    • Boyd A, Cole DC, Cho DB, Aslanyan G, Bates I. 2013. A comparison of frameworks for evaluating health research capacity strengthening: what can we learn? Health Research Policy and Systems 11: 46.
    • Breman JG, Bridbord K, Kupfer LE, Glass RI. 2011. Global health: the Fogarty International Center, National Institutes of Health: vision and mission, programs, and accomplishments. Infectious Disease Clinics of North America 25: 511-36.
    • Cole DC, Kakuma R, Fonn S et al. 2012. Evaluations of health research capacity development: a review of the evidence. American Journal of Tropical Medicine and Hygiene 87(5 Suppl. 1):801.
    • Day R, Stackhouse J, Geddes N. 2009. Evaluating Commonwealth Scholarships in the United Kingdom: Assessing Impact in Key Priority Areas. London: Commonwealth Scholarship Commission in the UK. http://cscuk.dfid.gov.uk/wp-content/uploads/2011/03/evaluationimpact-key-report.pdf, accessed 26 April 2013.
    • Erlandsson B, Gunnarsson V. 2005. Evaluation of HEPNet in SSA. Stockholm: Sida. http://www.sida.se/Publications/Import/pdf/sv/ Evaluation-of-HEPNet-in-SSA.pdf, accessed 26 April 2013.
    • ESSENCE on Health Research. 2011. Planning, Monitoring and Evaluation Framework for Capacity Strengthening in Health Research. Geneva: ESSENCE on Health Research. http://www.who.int/tdr/publica tions/non-tdr-publications/essence-framework/en/index.html, accessed 26 April 2013.
    • European Union. 2008. Developing Evaluation Capacity: Final Report on the Framework to Analyze the Development of Evaluation Capacity in the EU Member States. 2nd edn. Luxembourg: European Union. http://ec. europa.eu/regional_policy/sources/docgener/evaluation/pdf/report_ integrated_2007.pdf, accessed 26 April 2013.
    • Fetterman D. 2010. Empowerment Evaluation: Collaboration, Action Research, and a Case Example. http://preval.org/files/Fetterman.pdf, accessed 26 April 2013.
    • Ghaffar A, IJsselmuiden C, Zicker F (eds). 2008. Changing Mindsets: Research Capacity Strengthening in Low- and Middle-income Countries. Geneva: COHRED, Global Forum for Health Research, and UNICEF/UNDP/World Bank/WHO Special Programme for Research and Training in Tropical Diseases (TDR). http://www. who.int/tdr/publications/documents/changing_mindsets.pdf, accessed 26 April 2013.
    • Health Research for Action (HERA). 2007a. Review of DANIDAsupported Health Research in Developing Countries: Main Report Volume One. Reet: HERA. http://www.enrecahealth.dk/pdfs/20070309_ DANIDA-Research_FINAL_report_volume_I.pdf/, accessed 26 April 2013.
    • HERA. 2007b. Review of DANIDA-supported Health Research in Developing Countries: Annexes Volume Two. Reet: HERA.
    • House of Commons Science and Technology Committee (HCSTC). 2012. Building Scientific Capacity for Development Fourth Report of Session 2012-13 HCC 377. London: The Stationary Office Limited. http:// www.publications.parliament.uk/pa/cm201213/cmselect/cmsctech/ 377/377.pdf, accessed 26 April 2013.
    • Hovland I. 2007. Making a Difference: M&E of Policy Research (Working Paper 281). London: Overseas Development Institute. http://www.odi.org. uk/sites/odi.org.uk/files/odi-assets/publications-opinion-files/2426. pdf, accessed 26 April 2013.
    • Keown K, Van Eerd D, Irvin E. 2008. Stakeholder engagement opportunities in systematic reviews: knowledge transfer for policy and practice. Journal of Continuing Education in the Health Professions 28: 67-72.
    • Kubisch AC, Auspos P, Brown P, Dewar T. 2010. Voices from the Field III: Lessons and Challenges from Two Decades of Community Change Efforts. Washington: Aspen Institute. http://www.aspeninstitute.org/sites/ default/files/content/docs/pubs/VoicesIII_FINAL_0.pdf, accessed 26 April 2013.
    • Lincoln YS, Guba EG. 1985. Naturalistic Inquiry. Newbury Park: Sage Publications.
    • Maessen O. 2005. Intent to Build Capacity through Research Projects: An Examination of Project Objectives, Abstract and Appraisal Documents. Ottawa: International Development Research Centre. http://www. idrc.ca/uploads/user-S/11635261571Intent_to_Build_Capacity_ through_Research_Projects.pdf, accessed 26 April 2013.
    • Mills A, Pairamanzi R, Sewankambo N, Shasha W. 2010. Mid-term Evaluation of the Consortium for National Health Research, Kenya. Nairobi: Consortium for National Health Research [made available by the funders].
    • Minja H, Nsanzabana C. 2010. TDR Research Capacity Strengthening Programmes: Impact Assessment Study Review for the Period 2000-2008 (Draft). Basel: Swiss Tropical & Public Health Institute (SwissTPH).
    • Patton MQ. 1994. Developmental evaluation. American Journal of Evaluation 15: 311-9.
    • Patton MQ. 2011. Developmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use. New York: Guilford Press.
    • Pawson R, Sridharan S. 2009. Theory-driven evaluation of public health programmes. In: Killoran A, Kelly M (eds). Evidence-based Public Health: Effectiveness and Efficiency. Oxford: Oxford University Press, pp. 43-61.
    • Pederson JS, Chataway J, Marjanovic S. 2011. CARTA (Consortium for Advanced Research Training in Africa): The Second Year. Cambridge: RAND Europe [made available through the funder and contractors].
    • Peebles D, Sachdeva N. 2008. Gender Evaluation of Governance Equity and Health Program: Final Report on Phase 3-Gender Training Workshop. Ottawa: International Development Research Centre.
    • Podems D. 2010. Evaluation of the Regional Initiative in Science and Education. The Carnegie-IAS Regional Initiative in Science and Education (RISE). Cape Town: OtherWise.
    • Pope C, Ziebland S, Mays N. 2000. Qualitative research in health care: analysing qualitative data. British Medical Journal 320: 114-6.
    • Ransom J, Stackhouse J, Groenhout F, Geddes N, Darnbrough M. 2010. Evaluating Commonwealth Scholarships in the United Kingdom: Assessing Impact in the Health Sector. London: Commonwealth Scholarship Commission in the UK. http://cscuk.dfid.gov.uk/wp-content/up loads/2011/03/evaluation-impact-health-report.pdf, accessed 26 April 2013.
    • Sachdeva N, Jimeno C, Peebles D. 2008a. Gender Evaluation of Governance Equity and Health Program: Final Report on Phase I; Institutional Assessment. Ottawa: International Development Research Centre.
    • Sachdeva N, Peebles D. 2008. Gender Evaluation of Governance Equity and Health Program: Final Report; Summary and Way Forward/Next Steps. Ottawa: International Development Research Centre.
    • Sachdeva N, Peebles D, Tezare K. 2008b. Gender Evaluation of Governance Equity and Health Program: Final Report on Phase 2; Projects Review. Ottawa: International Development Research Centre.
    • Saini M, Shlonsky A. 2012. Systematic Synthesis of Qualitative Research: A Pocket Guide for Social Work Research Methods. New York: Oxford University Press.
    • Smith E, Donovan S, Beresford P et al. 2009. Getting ready for user involvement in a systematic review. Health Expectations 12: 197-208.
    • Sridharan S, Campbell B, Zinzow H. 2006. Developing a stakeholderdriven timeline of change for evaluations of social programs. American Journal of Evaluation 27: 148-62.
    • Sridharan S, Nakaima A. 2011. Ten steps to making evaluations matter. Evaluation and Program Planning 34: 135-46.
    • Srivastava CV, Hodges A, Chelliah S, Zuckerman B. 2009. Evaluation of the Global Research Initiative Program (GRIP) for New Foreign Investigators. Bethesda: National Institutes of Health.
    • van Velzen W, Kamal R, Meda N et al. 2009. Independent External Evaluation Report of the European and Developing Countries Clinical Trials Partnership (EDCTP programme). The Hague: EDCTP. http://ec. europa.eu/research/health/infectious-diseases/poverty-diseases/doc/ iee-report-edctp-programme_en.pdf, accessed 26 April 2013.
    • Vasquez EE, Hirsch JS, Giang LM, Parker RG. 2013. Rethinking health research capacity strengthening. Global Public Health. Special Issue: Social and Political Dimensions of HIV and AIDS in Vietnam 8(Suppl. 1): S104-24.
    • Vogel I. 2011. Research Capacity Strengthening: Learning from Experience. London: UKCDS. http://www.ukcds.org.uk/_assets/file/features/ UKCDS_Capacity_Building_Report_July_2012.pdf, accessed 26 April 2013.
    • Vullings W, Meijer I. 2009. NACCAP Mid term Review: Information Guide and Appendices. Amsterdam: Technopolis Group.
    • Whitworth JA, Kokwaro G, Kinyanjui S et al. 2008. Strengthening capacity for health research in Africa. Lancet 372: 1590-3.
    • Zuckerman B, Wilson A, Viola C, Lal B. 2006. Evaluation of the Fogarty International Research Collaboration Awards (FIRCA) Program: Phase II Outcome Evaluation. Bethesda: National Institutes of Health.
  • No related research data.
  • Discovered through pilot similarity algorithms. Send us your feedback.

Share - Bookmark

Funded by projects

  • WT

Cite this article