Ethics code: IR.TUMS.SPH.REC.1401.061
1- Department of Health Management, Policy and Economics, School of Public Health, Tehran University of Medical Sciences, Tehran, Iran
Abstract: (74 Views)
Objective(s): The quality of hospital services should be constantly monitored and enhanced. Key performance indicators (KPIs) are as such essential to strengthen the supervision of the government, people, and other health system stakeholders and improve hospitals' performance. The present study thus seeks to identify the KPIs for ranking general hospitals in Iran.
Methods: This study adopted a mixed-method design at four stages. The researchers used a scoping review to identify the related indicators and frameworks in the literature. They further qualitatively identified local indicators for hospital ranking. An expert panel refined the pooled indicators, and the KPIs were finally prioritized using the decision matrix technique.
Results: Initially 233 and then 84 indicators were identified. The final 50 indicators were determined and prioritized. The number of medical staff per bed, mortality rate, patient satisfaction, staff satisfaction, and bed occupancy rate were among the highest-priority indicators.
Conclusion: Structure, process, and outcome-related indicators were proposed to rank general hospitals in Iran that could be utilized to strengthen the current hospital evaluation system. Using these indicators to evaluate and rank hospitals could hopefully improve transparency, public disclosure, organizational efficiency, and ultimately the quality of services.
Methods: This study adopted a mixed-method design at four stages. The researchers used a scoping review to identify the related indicators and frameworks in the literature. They further qualitatively identified local indicators for hospital ranking. An expert panel refined the pooled indicators, and the KPIs were finally prioritized using the decision matrix technique.
Results: Initially 233 and then 84 indicators were identified. The final 50 indicators were determined and prioritized. The number of medical staff per bed, mortality rate, patient satisfaction, staff satisfaction, and bed occupancy rate were among the highest-priority indicators.
Conclusion: Structure, process, and outcome-related indicators were proposed to rank general hospitals in Iran that could be utilized to strengthen the current hospital evaluation system. Using these indicators to evaluate and rank hospitals could hopefully improve transparency, public disclosure, organizational efficiency, and ultimately the quality of services.
type of study: Qualitative Study |
Subject:
Helath Services Management
Received: 2023/11/28 | Accepted: 2025/05/10 | ePublished ahead of print: 2025/07/1
Received: 2023/11/28 | Accepted: 2025/05/10 | ePublished ahead of print: 2025/07/1
References
1. World Health Organization. Hospitals [Internet] 2023 [Accessed: 2023 Oct]. Available from: https://www.who.int/health-topics/hospitals#tab=tab_1
2. Riewpaiboon A. Hospital Cost Analysis in Developing Countries: A Methodological Comparison in Vietnam. Asian Journal of Pharmaceutics 2018;12:59-70
3. Barnum H, Kutzin J, editors. Public Hospitals in Developing Countries: Resource Use, Cost, Financing. 1st Edition, The Johns Hopkins University Press: Baltimore: USA, 1993.
4. Esfahani P, Nezamdust F. Patients' Satisfaction in Hospitals of Iran: A Systematic Review and Meta-Analysis. Qom University of Medical Sciences Journal 2019;13:58-72 [Persian] [DOI:10.29252/qums.13.4.58]
5. Mosadeghrad A, Esfahani P, Nikafshar M. Hospitals' Efficiency in Iran: A Systematic Review and Meta-Analysis of Two Decades of Research. Payavard Salamat 2017;11:318-31 [Persian]
6. Isfahani P, Shamsaie M. Quality of Services in the Hospitals of Iran: A Systematic Review and Meta-Analysis. Health and Development Journal 2020;8:357-70 [Persian]
7. Mohammadi M, Raygani AAV, Jalali R, Ghobadi A, Salari N, Hemmati M. A Systematic Review of the Prevalence of Neonatal Mortality in the Intensive Care Unit of Hospitals in Iran. Tehran University Medical Journal 2019;77:539-47 [Persian]
8. Jafaryparvar Z, Adib M, Ghanbari A, Leyli E. Unplanned Readmission After Hospital Discharge in Burn Patients in Iran. European Journal of Trauma and Emergency Surgery 2019;45:1-10 [DOI:10.1007/s00068-018-0919-6]
9. Kalateh Sadati A, Bagheri Lankarani K, Tabrizi R, Rahnavard F, Zakerabasali S. Evaluation of 30-Day Unplanned Hospital Readmission in a Large Teaching Hospital in Shiraz, Iran. Shiraz E-Medical Journal 2017;18:e39745 [DOI:10.5812/semj.39745]
10. Mosadeghrad AM, Esfahani P. Patients' Unnecessary Length of Stay in Iran: A Systematic Review and Meta-Analysis. Jundishapur Scientific Medical Journal 2019;17:529-44 [Persian]
11. Mosadeghrad A, Afshari M, Isfahani P. Prevalence of Nosocomial Infection in Iranian Hospitals: A Systematic Review and Meta-Analysis. Iranian Journal of Epidemiology 2021;16:352-62 [Persian]
12. Mosadeghrad AM, Isfahani P, Yousefinezhadi T. Medical Errors in Iranian Hospitals: Systematic Review. Tehran University Medical Journal 2020;78:239-47 [Persian]
13. Mosadeghrad AM, Isfahani P. Unnecessary Hospital Admissions in Iran: A Systematic Review and Meta-Analysis. Tehran University Medical Journal 2019;77:392-400 [Persian]
14. Jaafaripooyan E, Emamgholipour S, Raei B. Efficiency Measurement of Health Care Organizations: What Models Are Used? Medical Journal of the Islamic Republic of Iran 2017;31:86 [DOI:10.14196/mjiri.31.86]
15. Mehrtak M, Yusefzadeh H, Jaafaripooyan E. Pabon Lasso and Data Envelopment Analysis: A Complementary Approach to Hospital Performance Measurement. Global Journal of Health Science 2014;6:107 [DOI:10.5539/gjhs.v6n4p107]
16. Nasab MHI, Mohaghegh B, Khalesi N, Jaafaripooyan E. Parallel Quality Assessment of Emergency Departments by European Foundation for Quality Management Model and Iranian National Program for Hospital Evaluation. Iranian Journal of Public Health 2013;42:610
17. Bahadori M, Izadi AR, Ghardashi F, Ravangard R, Hosseini SM. The Evaluation of Hospital Performance in Iran: A Systematic Review Article. Iranian Journal of Public Health 2016;45:855 [DOI:10.5812/traumamon.31382]
18. Parvin K, Firoozi M. Transparency in Public Affairs as a Means of Gaining Public Trust with Emphasis on Iran's Legal System. Public Law Studies Quarterly 2022;52:597-616 [Persian]
19. These Are the World's Healthiest Nations [Internet] 2019 [Accessed: 2023 Oct]. Available from: https://www.bloomberg.com/news/articles/2019-02-24/spain-tops-italy-as-world-s-healthiest-nation-while-u-s-slips#xj4y7vzkg
20. The Legatum Prosperity Index™ 2023 [Internet] 2023 [Accessed: 2023 Oct]. Available from: https://www.prosperity.com/rankings
21. Academic Ranking of World Universities 2022 [Internet] 2022 [Accessed: 2023 Oct]. Available from: https://www.shanghairanking.com/rankings/arwu/2022
22. World University Rankings 2023 [Internet] 2023 [Accessed: 2023 Oct]. Available from: https://www.timeshighereducation.com/world-university-rankings/2023/world-ranking
23. Olmsted MG, Powell R, Murphy J, Bell D, Silver B, Stanley M, et al. Methodology U.S. News & World Report 2021-22 Best Hospitals: Specialty Rankings [Internet] 2021 [Accessed: 2023 Oct]. Available from: https://www.rti.org/publication/methodology-u-news-amp-world-report-best-hospitals-2021-22-specialty-rankings
24. DeAngelis CD. How Helpful Are Hospital Rankings and Ratings for the Public's Health? The Milbank Quarterly 2016;94:729-33 [DOI:10.1111/1468-0009.12227]
25. Cua S, Moffatt-Bruce S, White S. Reputation and the Best Hospital Rankings: What Does It Really Mean? American Journal of Medical Quality 2017;32:632-7 [DOI:10.1177/1062860617691843]
26. The Real Meaning of US Hospital Rankings. The Lancet 2014;384:282 [DOI:10.1016/S0140-6736(14)61245-9]
27. Shapiro JM. One-Star Rating for a Five-Star Program: Evaluating 'Hospital Compare'. Public Health 2017;151:160-8 [DOI:10.1016/j.puhe.2017.07.005]
28. CMS Releases Hospital Quality Star Ratings 2021 [Internet] [Accessed: 2023 Oct]. Available from: https://www.healthcarefinancenews.com/news/cms-releases-hospital-quality-star-ratings
29. Haley D, Zhao M, Spaulding A, Hamadi H, Xu J, Yeomans K. The Influence of Hospital Market Competition on Patient Mortality and Total Performance Score. The Health Care Manager 2016;35:266-76 [DOI:10.1097/HCM.0000000000000117]
30. Longo F, Siciliani L, Moscelli G, Gravelle H. Does Hospital Competition Improve Efficiency? The Effect of the Patient Choice Reform in England. Health Economics 2019;28:1-15 [DOI:10.1002/hec.3868]
31. Mosadeghrad A, Janababie G, Kalantari B, Abbasi M, Dehnavi H. Evaluation of Efficiency of General Hospitals in Iran. Scientific Journal of Kurdistan University of Medical Sciences 2021;26:151-69 [Persian] [DOI:10.52547/sjku.26.3.151]
32. Bloom N, Propper C, Seiler S, Van Reenen J. The Impact of Competition on Management Quality: Evidence from Public Hospitals. The Review of Economic Studies 2015;82:457-89 [DOI:10.1093/restud/rdu045]
33. Comprehensive Guide to National Accreditation Standards for Iranian Hospitals [Internet] 2020 [Accessed: 2023 Oct]. Available from: http://treatment.sbmu.ac.ir/uploads/etebarbakhshi_standard_book_98.pdf
34. Guidelines for the National Accreditation of Hospitals 2020 [Internet] [Accessed: 2023 Oct]. Available from: https://me.umsu.ac.ir/uploads/guideline-accreditation.pdf
35. Deputy for Management and Resources Development, Shiraz University of Medical Sciences. Evaluation Reports [Internet] 2023 [Accessed: 2023 Oct]. Available from: https://B2n.ir/rb5910
36. Mosadeghrad AM, Dehnavi H. Evaluation of Hospital Performance in Iran: A Systematic Review and Meta-Analysis. Health Monitor Journal of the Iranian Institute for Health Sciences Research 2018;17:603-15 [Persian]
37. DiRoberto C, Lehto C, Baccei SJ. The Decision Analysis Matrix: A Systematic Method to Improve Collaborative Decision Making. Journal of the American College of Radiology 2016;13:1159-60 [DOI:10.1016/j.jacr.2016.02.027]
38. Elmansy R. Decision Matrix Analysis: How to Make the Right Decision [Internet] [Accessed: 2023 Oct]. Available from: https://www.designorate.com/decision-matrix-decision-making
39. Arksey H, O'Malley L. Scoping Studies: Towards a Methodological Framework. International Journal of Social Research Methodology: Theory & Practice 2005;8:19-32 [DOI:10.1080/1364557032000119616]
40. Rink LC, Oyesanya TO, Adair KC, Humphreys JC, Silva SG, Sexton JB. Stressors Among Healthcare Workers: A Summative Content Analysis. Global Qualitative Nursing Research 2023;10:23333936231161127 [DOI:10.1177/23333936231161127]
41. Hsieh HF, Shannon SE. Three Approaches to Qualitative Content Analysis. Qualitative Health Research 2005;15:1277-88 [DOI:10.1177/1049732305276687]
42. Baby S. AHP Modeling for Multicriteria Decision-Making and to Optimise Strategies for Protecting Coastal Landscape Resources. International Journal of Innovation, Management and Technology 2013; 4:218-227 [DOI:10.7763/IJIMT.2013.V4.395]
43. Calculation of Incompatibility Rates of Pairwise Comparisons of AHP and ANP Methods in Excel [Internet] [Accessed: 2023 Oct]. Available from: https://B2n.ir/nz2825
44. McCord A, Holmes R, Harman L. Indicators to Measure Social Protection Performance: Implications for EC Programming [Internet] 2017 [Accessed: 2023 Oct]. Available from: https://op.europa.eu/en/publication-detail/-/publication/7cc15f72-ec38-11e6-ad7c-01aa75ed71a1
45. Heywood A, Boone D. Guidelines for Data Management Standards in Routine Health Information Systems [Internet] Measure Evaluation 2015 [Accessed: 2023 Oct]. Available from: https://www.measureevaluation.org/resources/publications/ms-15-99.html
46. Donabedian A. Evaluating the Quality of Medical Care. The Milbank Memorial Fund Quarterly 1966;44:166-206 [DOI:10.2307/3348969]
47. Alonazi W. Applying Key Performance Indicators to Evaluate Health Care Service Outcomes [dissertation]. Monash University; 2013.
48. Jaafaripooyan E, Daroudi R, Damiri S, Mousavi A, Mohamadi E, Takian A, et al. Key Indicators for Monitoring the Efficiency of Iranian Health System: A Synthesized Design Study. Iranian Journal of Public Health 2024;53:704-713 [DOI:10.18502/ijph.v53i3.15152]
49. Pushadapu N. The Value of Key Performance Indicators (KPIs) in Enhancing Patient Care and Safety Measures: An Analytical Study of Healthcare Systems. Journal of Machine Learning for Healthcare Decision Support 2021;1:1-43
50. Scoring Methodology Used in the Spring 2022 Release of the Leapfrog Hospital Safety Grades 2022 [Internet] 2022 [Accessed: 2023 Oct]. Available from: https://www.hospitalsafetygrade.org/media/file/Safety-Grade-Methodology-Spring-20222.pdf
51. Rasi V, Delgoshaee B, Maleki M. Identification of Common Indicators of Hospital Performance Evaluation Models: A Scoping Review. Journal of Education and Health Promotion 2020;9:63 [DOI:10.4103/jehp.jehp_563_19]
52. Mayelafshar M, Noohi F, Riahi L, Nikravan A. Identification of the Key Performance Indicators for Designing an Emergency Department Dashboard in a Referral Cardiac Hospital. Iranian Red Crescent Medical Journal 2021;23:e714
53. Bou-Llusar JC, Escrig-Tena AB, Roca-Puig V, Beltrán-Martín I. An Empirical Assessment of the EFQM Excellence Model: Evaluation as a TQM Framework Relative to the MBNQA Model. Journal of Operations Management 2009;27:1-22 [DOI:10.1016/j.jom.2008.04.001]
54. Gao H, Chen H, Feng J, Qin X, Wang X, Liang S, et al. Balanced Scorecard-Based Performance Evaluation of Chinese County Hospitals in Underdeveloped Areas. The Journal of International Medical Research 2018;46:1947-62 [DOI:10.1177/0300060518757606]
55. Tsai HY, Chang CW, Lin HL. Fuzzy Hierarchy Sensitive with Delphi Method to Evaluate Hospital Organization Performance. Expert Systems With Applications 2010;37:5533-41 [DOI:10.1016/j.eswa.2010.02.099]
56. Pourmohammadi K, Hatam N, Shojaei P, Bastani P. A Comprehensive Map of the Evidence on the Performance Evaluation Indicators of Public Hospitals: A Scoping Study and Best Fit Framework Synthesis. Cost Effectiveness and Resource Allocation 2018;16:64 [DOI:10.1186/s12962-018-0166-z]
57. Carini E, Gabutti I, Frisicale EM, Di Pilla A, Pezzullo AM, de Waure C, et al. Assessing Hospital Performance Indicators. What Dimensions? Evidence from an Umbrella Review. BMC Health Services Research 2020;20:1038 [DOI:10.1186/s12913-020-05879-y]
58. Kurian N, Maid J, Mitra S, Rhyne L, Korvink M, Gunn LH. Predicting Hospital Overall Quality Star Ratings in the USA. Healthcare 2021;9:486 [DOI:10.3390/healthcare9040486]
59. Khorramnia S, Jafari A, Farahbakhsh F, Aliniaghara E, Amani B, Amani B, et al. Estimation of Mortality in the Intensive Care Units in Iran: A Systematic Review and Meta-Analysis. Nursing and Midwifery Journal 2019;17:634-45
60. Parvizrad P, Sandakzehi S. Correlation Between Employees' Satisfaction Working at Hospitals and Maternal Satisfaction with Service Quality and Recovery Process of Children. Journal of Health Research in Community 2019;5:41-51 [Persian]
61. Edgman-Levitan S, Shaller D, Campione J, Zema C, Abraham J, Yount N. The CAHPS Ambulatory Care Improvement Guide: Practical Strategies for Improving Patient Experience. Agency for Healthcare Research and Quality [Internet] 2017 [Accessed: 2023 Oct]. Available from: https://www.ahrq.gov/cahps
62. CMS. Overall Hospital Quality Star Rating 2022 [Internet] 2022 [Accessed: 2023 Oct]. Available from: https://data.cms.gov/provider-data/topics/hospitals/overall-hospital-quality-star-rating/
63. Piriyathanalai W, Muenjohn N. Is There a Link? Employee Satisfaction and Service Quality. World Journal of Management 2012;4:82-92
64. Amiresmaili M, Moosazadeh M. Determining Job Satisfaction of Nurses Working in Hospitals of Iran: A Systematic Review and Meta-Analysis. Iranian Journal of Nursing and Midwifery Research 2013;18:343-8
65. Mousavi SMH, Dargahi H, Asgari M, Sharifiyan R, Shaham G, Mokhtari Z. Investigation of Staff's Job Satisfaction and Related Factors in TUMS Teaching Hospital. Payavard Salamat 2016;10:133-44 [Persian]
66. Si SL, You XY, Liu HC, Huang J. Identifying Key Performance Indicators for Holistic Hospital Management with a Modified DEMATEL Approach. International Journal of Environmental Research and Public Health 2017;14:934 [DOI:10.3390/ijerph14080934]
67. Erfani Khanghahi M, Ebadi Fard Azar F. Hospital Efficiency Using Pabon Lasso Model: A Systematic Review and Meta-Analysis. Hospital 2018;17:21-32 [Persian] [DOI:10.14196/mjiri.32.45]
68. Janati A, Imani A, H AK. Evaluation and Comparison of Performance Indicators in Hospitals of East Azerbaijan Province with the Same Standards of Ministry of Health. Journal of the Faculty of Medical Information and Management 2017;3:190-200 [Persian]
69. Hwang W, Derk J, LaClair M, Paz H. Finding Order in Chaos: A Review of Hospital Ratings. American Journal of Medical Quality 2016;31:147-55 [DOI:10.1177/1062860614558085]
Send email to the article author
| Rights and Permissions | |
 |
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License. |