Email this article 
Frameworks of Performance Measurement in Public Health and Primary Care System: A Scoping Review and Meta‑Synthesis
Abstract
Background: This study was conducted to synthesize the evidence on the dimensions of performance appraisal of the public health and primary care system through a scoping review and meta‑synthesis.
Methods: The review conducted systematically in 2018 with a scoping review approach. To identify pertinent studies, the following electronic databases were systematically searched until December 20, 2017: Cochrane, ISI Web of Science, PubMed, Scopus, Science Direct, and Embase. Reviewing the studies found on the search bases was carried out in three stages by two persons individually. According to refined studies, the data were extracted to meet the objectives and respond to the research questions. The thematic analysis was used to identify and categorize the dimensions of performance measurement.
Results: Using this process, 20 studies were eligible for our research. The critical points in measuring the performance of the public health field were classified into eight main domains including leadership and stewardship, funding, resource generation, service delivery, quality, accessibility, efficiency/productivity, and community health status. The differences in measurement frameworks are inevitable. One reason for the differences in the health system performance measurement framework is the differences in the data or data collection, analysis, and reporting. Performance measurement in the field of health, especially primary care, was a multidimensional issue.
Conclusions: Each of the main dimensions had several sub‑criteria, indicating the broadness and complexity of the performance of first‑level care providers. Single‑dimensional performance measurement could underpin incorrect policies and decisions.
Keywords
Full Text:
PDFReferences
Team FME. PESTLE analysis. Strategy Skills. free-managementebooks. 2013. Available from: https://docplayer.net/9768722Pestle-analysis-strategy-skills-team-fme-www-free-managementebooks-com-isbn-978-1-62620-998-5.html. [Last accessed 2019
Oct 23].
Amuna YMA, Al Shobaki MJ, Naser SSA. Strategic
environmental scanning: An approach for crises management. Int
J Inf Technol Electr Eng 2017;6:28‑34.
Rajabi F, Esmailzadeh H, Rostamigooran N, Majdzadeh R,
Doshmangir L. Future of health care delivery in iran,
opportunities and threats. Iran J Public Health 2013;42:23‑30.
Bonu S, Gutierrez LC, Borghis A, Roche FC. Transformational
trends confounding the South Asian health systems. Health
Policy 2009;90:230‑8.
Shaw C. How can hospital performance be measured and
monitored?. World Health Organization Regional Office for
Europe; 2003. p. 17.
Shahri S, Tabibi SJ, Nasiripour A, Ghaffari F. The Dimensions
of health system performance evaluation with emphasis on the
coverage of the vulnerable groups in Iran. Int J Med Res Health
Sci 2016;5:9‑17.
Ofori‑Kuragu JK, Baiden BK, Badu E. Performance
measurement tools for Ghanaian contractors. Int J Constr
Manage 2016;16:13‑26.
Rahimi H, Bahmaei J, Shojaei P, Kavosi Z, Khavasi M.
Developing a strategy map to improve public hospitals
performance with balanced scorecard and DEMATEL approach.
Shiraz E‑Med J 2018;19:e64056.
Walburg J, Bevan H, Wilderspin J. Performance Management
in Health Care: Improving Patient Outcomes: An Integrated
Approach. New York: Psychology Press; 2006.
Tawfik‑Shukor AR, Klazinga NS, Arah OA. Comparing health
system performance assessment and management approaches
in the Netherlands and Ontario, Canada. BMC Health Serv Res
;7:25.
Kruk ME, Freedman LP. Assessing health system performance
in developing countries: A review of the literature. Health Policy
;85:263‑76.
Kelley E, Hurst J. Health care quality indicators project
conceptual framework paper. Paris: OECD, 2006. Available
from: http://www.oecd.org/health/health-systems/36262363.pdf
[Last accessed 2019 Oct 23].
van den Berg MJ, Kringos DS, Marks LK, Klazinga NS. The
Dutch health care performance report: Seven years of health care
performance assessment in the Netherlands. Health Res Policy
Syst 2014;12:1.
Handler A, Issel M, Turnock B. A conceptual framework to
measure performance of the public health system. Am J Public
Health 2001;91:1235‑9.
Fekri O, Macarayan ER, Klazinga N. Health System
Performance Assessment in the WHO European Region: Which
Domains and Indicators have been used by Member States for its
Measurement? Copenhagen: WHO Regional Office for Europe;
Kalinichenko O. Exploring performance assessment and
incentive regulation in the context of primary health care.
Portugal: Faculdade de Economia, Universidad do Algarve;
Carinci F, Van Gool K, Mainz J, Veillard J, Pichora EC,
Januel JM, et al. Towards actionable international comparisons
of health system performance: Expert revision of the OECD
framework and quality indicators. Int J Qual Health Care
;27:137‑46.
NasrollahpourShirvani SD. A review of health systems
performance assessment models. Clin Excellence 2016;5:98‑116.
World Health Organization. Everybody’s Business‑‑Strengthening
Health Systems to Improve Health Outcomes. WHO’s
Framework for Action. Geneva: World Health Organization;
Tashobya CK, da Silveira VC, Ssengooba F, Nabyonga‑Orem J,
Macq J, Criel B. Health systems performance assessment in
low‑income countries: Learning from international experiences.
Global Health 2014;10:5.
Gu X, Itoh K. Performance indicators: Healthcare professionals’
views. Int J Health Care Qual Assur 2016;29:801‑15.
Veillard J, Guisset A‑L, Garcia‑Barbero M. Selection of
Indicators for Hospital Performance Measurement: A Report
on the 3rd and 4th Workshop. Regional Office for Europe of the
World Health Organization; 2003. p. 37.
Mehrtak M, Yusefzadeh H, Jaafaripooyan E. Pabon lasso and data
envelopment analysis: A complementary approach to hospital
performance measurement. Global J Health Sci 2014;6:107‑16.
Tricco AC, Cardoso R, Thomas SM, Motiwala S, Sullivan S,
Kealey MR, et al. Barriers and facilitators to uptake of
systematic reviews by policy makers and health care managers:
A scoping review. Implement Sci 2015;11:4.
Arksey H, O’Malley L. Scoping studies: Towards a
methodological framework. Int J Social Res Methodol
;8:19‑32.
Levac D, Colquhoun H, O’Brien KK. Scoping studies:
Advancing the methodology. Implement Sci 2010;5:69.
Sheehan KJ, Sobolev B, Villán YFV, Guy P. Patient and system
factors of time to surgery after hip fracture: A scoping review.
BMJ Open 2017;7:e016939.
Silver MP, Hamilton AD, Biswas A, Warrick NI. A systematic
review of physician retirement planning. Human Resour Health
;14:67.
Vaismoradi M, Turunen H, Bondas T. Content analysis and
thematic analysis: Implications for conducting a qualitative
descriptive study. Nurs Health Sci 2013;15:398‑405.
Terner M, D’Silva J, Tipper B, Krylova O, Webster G. Assessing
primary healthcare using pan‑ Canadian indicators of health
and health system performance. Healthc Q (Toronto, Ont)
;16:9‑12.
Rohova M, Atanasova E, Dimova A, Koeva L, Koeva S. Health
system performance assessment-an essential tool for health
system improvement. J IMAB–Annual Proceeding Scientific
Papers 2017;23:1778-83.
Mutale W, Balabanova D, Chintu N, Mwanamwenge MT,
Ayles H. Application of system thinking concepts in health
system strengthening in low‑income settings: A proposed
conceptual framework for the evaluation of a complex health
system intervention: The case of the BHOMA intervention in
Zambia. J Eval Clin Pract 2016;22:112‑21.
Pallas SW, Curry L, Bashyal C, Berman P, Bradley EH.
Improving health service delivery organisational performance
in health systems: A taxonomy of strategy areas and conceptual
framework for strategy selection. Int Health 2012;4:20‑9.
Edward A, Kumar B, Kakar F, Salehi AS, Burnham G,
Peters DH. Configuring balanced scorecards for measuring
health system performance: Evidence from 5 years’ evaluation in
Afghanistan. PLoS Med 2011;8:e1001066.
World Health Organization. The world health report 2000:
health systems: Improving performance. Geneva: World Health
Organization; 2000.
Islam M. Health systems assessment approach: a how-to manual.
USA, Arlington: Rational Pharmaceutical Management Plus;
p. 374.
Makuta I, O’Hare B. Quality of governance, public spending
on health and health status in Sub Saharan Africa: A panel data
regression analysis. BMC Public Health 2015;15:932.
Lagomarsino G, Nachuk S, Kundra SS. Public stewardship of
private providers in mixed health systems: Synthesis report from
the Rockefeller Foundation‑sponsored initiative on the role of the
private sector in health systems in developing countries. Results
for Development Institute, 2009.
Santos MA, Salomon VA, Marins FA. Analytic Network Process
and balanced scorecard applied to the performance evaluation of
public health systems. Pesquisa Operacional 2015;35:353-61.
Huselid MA. The impact of human resource management
practices on turnover, productivity, and corporate financial
performance. Acad Manage J 1995;38:635‑72.
Forsberg E, Axelsson R, Arnetz B. Financial incentives in health
care. The impact of performance‑based reimbursement. Health
Policy 2001;58:243‑62.
Faraji Khiavi F, Maleki MR, Djafarian K, Vatan Khah S,
Tabibi SJ. A comparative study on identifying core stages of
policy-making in human resources for health: 2009, Jundishapur
J Health Sci 2012;4:e93975.
Dehnavieh R, Haghdoost A, Khosravi A, Hoseinabadi F,
Rahimi H, Poursheikhali A, et al. The district health information
system (DHIS2): A literature review and meta‑synthesis of its
strengths and operational challenges based on the experiences of
countries. Health Inf Manage J 2019;48:62‑75.
Organization WH. Monitoring the building blocks of health
systems: A handbook of indicators and their measurement
strategies. Geneva, Switzerland: World Health Organization;
Health Finance & Governance Project. Health Systems
Assessment Approach A How‑To Manual. Version 3.0. Bethesda,
MD: Health Finance & Governance Project, Abt Associates Inc.;
Sharifirad GR, Shamsi M, Pirzadeh A, Farzanegan PD. Quality
gap in primary health care services in Isfahan: Women’s
perspective. J Educ Health Promot 2012;1:45.
Yakob B, Ncama BP. Measuring health system responsiveness
at facility level in Ethiopia: Performance, correlates and
implications. BMC Health Serv Res 2017;17:263.
Jahanmehr N, Rashidian A, Khosravi A, Farzadfar F, Shariati M,
Majdzadeh R, et al. A conceptual framework for evaluation of
public health and primary care system performance in iran. Glob
J Health Sci 2015;7:341‑57.
Gauld R, Al‑wahaibi S, Chisholm J, Crabbe R, Kwon B, Oh T,
et al. Scorecards for health system performance assessment: The
New Zealand example. Health Policy 2011;103:200‑8.
Kontodimopoulos N, Nanos P, Niakas D. Balancing efficiency of
health services and equity of access in remote areas in Greece.
Health Policy 2006;76:49‑57.
Hollingsworth B. The measurement of efficiency and productivity
of health care delivery. Health Econ 2008;17:1107‑28.
Kringos DS, Boerma WGW, Hutchinson A, Van der Zee J,
Groenewegen PP. The breadth of primary care: A systematic
literature review of its core dimensions. BMC Health Serv Res
;10:65.
Marschall P, Flessa S. Efficiency of primary care in rural Burkina
Faso. A two‑stage DEA analysis. Health Econ Rev 2011;1:5.
Pelone F, Kringos DS, Romaniello A, Archibugi M, Salsiri C,
Ricciardi W. Primary care efficiency measurement using
data envelopment analysis: A systematic review. J Med Syst
;39:156.
Dehnavieh R, Noorihekmat S, Masoud A, Moghbeli MA, Rahimi H, Poursheikhali A, et al. Evaluating the Tabriz
health complex model, lessons to learn. Iran J Epidemiol
;13:59‑70.
Pasarin MI, Berra S, Gonzalez A, Segura A, Tebé C,
García‑Altés A, et al. Evaluation of primary care: The “Primary
Care Assessment Tools ‑ Facility version” for the Spanish health
system. Gac Sanit 2013;27:12‑8.
Khanassov V, Pluye P, Descoteaux S, Haggerty JL, Russell G,
Gunn J, et al. Organizational interventions improving access to
community‑based primary health care for vulnerable populations:
A scoping review. Int J Equity Health 2016;15:168.
Lafortune C, Huson K, Santi S, Stolee P. Community‑based
primary health care for older adults: A qualitative study of the
perceptions of clients, caregivers and health care providers.
BMC Geriatr 2015;15:57.
Hofmarcher MM, Simon J, Peric N, Or Z, Smith P, Busse R.
Indicators for structured monitoring of health system
performance. Eur J Public Health 2016;26:149.
Tian M, Feng D, Chen X, Chen Y, Sun X, Xiang Y, et al. China’s
rural public health system performance: A cross‑sectional study.
PLoS One 2013;8:e83822.
Sun D, Ahn H, Lievens T, Zeng W. Evaluation of the performance
of national health systems in 2004‑2011: An analysis of 173
countries. PLoS One 2017;12:e0173346.