Explainable Stacked Ensemble Machine Learning for predicting monthly Gross Death Rate using aggregated clinical and operational hospital indicators in Indonesia

Sri Murdiati* -  Universitas Syiah Kuala, Banda Aceh, Indonesia
Safrizal Rahman -  Universitas Syiah Kuala, Banda Aceh, Indonesia
Yoga Yuniadi -  Universitas Indonesia, Jakarta, Indonesia
Nirwana Lazuardi Sary -  Universitas Syiah Kuala, Banda Aceh, Indonesia
DOI : 10.30867/action.v11i2.3304

Accurate hospital-wide mortality prediction is important for institutional clinical governance, quality improvement and resource planning. However, most machine learning studies have focused on patient-level data, intensive care populations, or disease-specific cohorts, with limited integration of hospital operational indicators. This retrospective single-center predictive modeling study used 36 monthly institutional observations from January 2022 to December 2024 at a regional referral hospital in Indonesia. Aggregated clinical severity indicators were combined with operational performance metrics, including length of stay, bed occupancy rate, and bed turnover rates. Random Forest, XGBoost, and feedforward neural network models were developed and compared with a linear regression baseline. The performance was internally evaluated using time-aware five-fold cross-validation with R², root mean squared error (RMSE), and mean absolute error (MAE). GDR and error metrics were expressed as deaths per 1,000 admissions. The stacked ensemble achieved the highest R² (0.841) and the lowest RMSE (4.49 deaths per 1,000 admissions), while the neural network achieved the lowest MAE (2.74 deaths per 1,000 admissions). In conclusion, operational indicators had modest direct effects but improved the model robustness through interaction effects. These findings support the use of explainable ensemble machine learning for institutional-level mortality prediction and hospital decision support.

Keywords : Gross Death Rate, hospital mortality, hospital operational indicators, machine learning, stacked ensemble, SHAP

  1. Bosque-Mercader, L., & Siciliani, L. (2023). The association between bed occupancy rates and hospital quality in the English National Health Service. The European Journal of Health Economics, 24(2), 209–236. https://doi.org/10.1007/s10198-022-01464-8
  2. Cabanillas Silva, P., Sun, H., Rezk, M., Roccaro-Waldmeyer, D. M., Fliegenschmidt, J., Hulde, N., von Dossow, V., Meesseman, L., Depraetere, K., Stieg, J., Szymanowsky, R., & Dahlweid, F.-M. (2024). Longitudinal model shifts of machine learning–based clinical risk prediction models: Evaluation study of multiple use cases across different hospitals. Journal of Medical Internet Research, 26, e51409. https://doi.org/10.2196/51409
  3. Collins, G. S., Moons, K. G. M., Dhiman, P., Riley, R. D., Beam, A. L., Van Calster, B., Ghassemi, M., Liu, X., Reitsma, J. B., Van Smeden, M., Boulesteix, A.-L., Camaradou, J. C., Celi, L. A., Denaxas, S., Denniston, A. K., Glocker, B., Golub, R. M., Harvey, H., Heinze, G., . . . Logullo, P. (2024). TRIPOD+AI statement: Updated guidance for reporting clinical prediction models that use regression or machine learning methods. BMJ, 385, e078378. https://doi.org/10.1136/bmj-2023-078378
  4. Deng, T., Hamdan, H., Yaakob, R., & Kasmiran, K. A. (2023). Personalized federated learning for in-hospital mortality prediction of multi-center ICU. IEEE Access, 11, 11652–11663. https://doi.org/10.1109/ACCESS.2023.3241488
  5. Deschepper, M., Waegeman, W., Vogelaers, D., & Eeckloo, K. (2020). Using structured pathology data to predict hospital-wide mortality at admission. PLOS ONE, 15(6), e0235117. https://doi.org/10.1371/journal.pone.0235117
  6. Estiri, H., Strasser, Z. H., Klann, J. G., Naseri, P., Wagholikar, K. B., & Murphy, S. N. (2021). Predicting COVID-19 mortality with electronic medical records. npj Digital Medicine, 4(1), Article 15. https://doi.org/10.1038/s41746-021-00383-x
  7. Fang, C., Pan, Y., Zhao, L., Niu, Z., Guo, Q., & Zhao, B. (2022). A machine learning–based approach to predict prognosis and length of hospital stay in adults and children with traumatic brain injury: Retrospective cohort study. Journal of Medical Internet Research, 24(12), e41819. https://doi.org/10.2196/41819
  8. Giwangkancana, G. W., Anina, H. N., & Sukandar, H. (2024). Predicting end-of-life in a hospital setting. Journal of Multidisciplinary Healthcare, 17, 619–627. https://doi.org/10.2147/JMDH.S443425
  9. Halasz, G., Sperti, M., Villani, M., Michelucci, U., Agostoni, P., Biagi, A., Rossi, L., Botti, A., Mari, C., Maccarini, M., Pura, F., Roveda, L., Nardecchia, A., Mottola, E., Nolli, M., Salvioni, E., Mapelli, M., Deriu, M. A., Piga, D., & Piepoli, M. (2021). A machine learning approach for mortality prediction in COVID-19 pneumonia: Development and evaluation of the Piacenza score. Journal of Medical Internet Research, 23(5), e29058. https://doi.org/10.2196/29058
  10. He, B., & Qiu, Z. (2024). Development and validation of an interpretable machine learning for mortality prediction in patients with sepsis. Frontiers in Artificial Intelligence, 7, 1348907. https://doi.org/10.3389/frai.2024.1348907
  11. Hsu, C.-N., Liu, C.-L., Tain, Y.-L., Kuo, C.-Y., & Lin, Y.-C. (2020). Machine learning model for risk prediction of community-acquired acute kidney injury hospitalization from electronic health records: Development and validation study. Journal of Medical Internet Research, 22(8), e16903. https://doi.org/10.2196/16903
  12. Huang, T., Le, D., Yuan, L., Xu, S., & Peng, X. (2023). Machine learning for prediction of in-hospital mortality in lung cancer patients admitted to intensive care unit. PLOS ONE, 18(1), e0280606. https://doi.org/10.1371/journal.pone.0280606
  13. Jawadi, Z., He, R., Srivastava, P. K., Fonarow, G. C., Khalil, S. O., Krishnan, S., Eskin, E., Chiang, J. N., & Nsair, A. (2024). Predicting in-hospital mortality among patients admitted with a diagnosis of heart failure: A machine learning approach. ESC Heart Failure, 11(5), 2490–2498. https://doi.org/10.1002/ehf2.14796
  14. König, S., Pellissier, V., Hohenstein, S., Leiner, J., Meier-Hellmann, A., Kuhlen, R., Hindricks, G., & Bollmann, A. (2022). From population- to patient-based prediction of in-hospital mortality in heart failure using machine learning. European Heart Journal – Digital Health, 3(2), 307–310. https://doi.org/10.1093/ehjdh/ztac012
  15. Kwun, J. S., Ahn, H. B., Kang, S. H., Yoo, S., Kim, S., Song, W., Hyun, J., Oh, J. S., Baek, G., & Suh, J. W. (2025). Developing a machine learning model for predicting 30-day major adverse cardiac and cerebrovascular events in patients undergoing noncardiac surgery: Retrospective study. Journal of Medical Internet Research, 27, e66366. https://doi.org/10.2196/66366
  16. Lee, B., Kim, K., Hwang, H., Kim, Y. S., Chung, E. H., Yoon, J. S., Cho, H. J., & Park, J. D. (2021). Development of a machine learning model for predicting pediatric mortality in the early stages of intensive care unit admission. Scientific Reports, 11(1), Article 1263. https://doi.org/10.1038/s41598-020-80474-z
  17. Lee, S. W., Lee, H. C., Suh, J., Lee, K. H., Lee, H., Seo, S., Kim, T. K., Lee, S. W., & Kim, Y. J. (2022). Multi-center validation of machine learning model for preoperative prediction of postoperative mortality. npj Digital Medicine, 5(1), Article 91. https://doi.org/10.1038/s41746-022-00625-6
  18. Li, C., Zhang, Z., Ren, Y., Nie, H., Lei, Y., Qiu, H., Xu, Z., & Pu, X. (2021). Machine learning based early mortality prediction in the emergency department. International Journal of Medical Informatics, 155, 104570. https://doi.org/10.1016/j.ijmedinf.2021.104570
  19. Li, L., Ding, L., Zhang, Z., Zhou, L., Zhang, Z., Xiong, Y., Hu, Z., & Yao, Y. (2023). Development and validation of machine learning–based models to predict in-hospital mortality in life-threatening ventricular arrhythmias: Retrospective cohort study. Journal of Medical Internet Research, 25, e47664. https://doi.org/10.2196/47664
  20. Li, M., Han, S., Liang, F., Hu, C., Zhang, B., Hou, Q., & Zhao, S. (2024). Machine learning for predicting risk and prognosis of acute kidney disease in critically ill elderly patients during hospitalization: Internet-based and interpretable model study. Journal of Medical Internet Research, 26, e51354. https://doi.org/10.2196/51354
  21. Lv, H., Yang, X., Wang, B., Wang, S., Du, X., Tan, Q., Hao, Z., Liu, Y., Yan, J., & Xia, Y. (2021). Machine learning–driven models to predict prognostic outcomes in patients hospitalized with heart failure using electronic health records: Retrospective study. Journal of Medical Internet Research, 23(4), e24996. https://doi.org/10.2196/24996
  22. Maheswari, B. U., Ashik, F., George, A., & Jose, A. (2023). In-hospital mortality prognosis: Unmasking patterns using data science and explainable AI. In 2023 9th International Conference on Signal Processing and Communication (ICSC) (pp. 356–361). IEEE. https://doi.org/10.1109/ICSC60394.2023.10441356
  23. Moons, K. G. M., Damen, J. A. A., Kaul, T., Hooft, L., Andaur Navarro, C., Dhiman, P., Beam, A. L., Van Calster, B., Celi, L. A., Denaxas, S., Denniston, A. K., Ghassemi, M., Heinze, G., Kengne, A. P., Maier-Hein, L., Liu, X., Logullo, P., McCradden, M. D., Liu, N., . . . Van Smeden, M. (2025). PROBAST+AI: An updated quality, risk of bias, and applicability assessment tool for prediction models using regression or artificial intelligence methods. BMJ, 388, e082505. https://doi.org/10.1136/bmj-2024-082505
  24. Muralitharan, S., Nelson, W., Di, S., McGillion, M., Devereaux, P. J., Barr, N. G., & Petch, J. (2021). Machine learning–based early warning systems for clinical deterioration: Systematic scoping review. Journal of Medical Internet Research, 23(2), e25187. https://doi.org/10.2196/25187
  25. Naemi, A., Schmidt, T., Mansourvar, M., Naghavi-Behzad, M., Ebrahimi, A., & Wiil, U. K. (2021). Machine learning techniques for mortality prediction in emergency departments: A systematic review. BMJ Open, 11(11), e052663. https://doi.org/10.1136/bmjopen-2021-052663
  26. Nie, X., Cai, Y., Liu, J., Liu, X., Zhao, J., Yang, Z., Wen, M., & Liu, L. (2021). Mortality prediction in cerebral hemorrhage patients using machine learning algorithms in intensive care units. Frontiers in Neurology, 11, 610531. https://doi.org/10.3389/fneur.2020.610531
  27. Qiao, E. M., Qian, A. S., Nalawade, V., Voora, R. S., Kotha, N. V., Vitzthum, L. K., & Murphy, J. D. (2022). Evaluating high-dimensional machine learning models to predict hospital mortality among older patients with cancer. JCO Clinical Cancer Informatics, 6, e2100186. https://doi.org/10.1200/CCI.21.00186
  28. Seki, T., Kawazoe, Y., & Ohe, K. (2021). Machine learning–based prediction of in-hospital mortality using admission laboratory data: A retrospective, single-site study using electronic health record data. PLOS ONE, 16(2), e0246640. https://doi.org/10.1371/journal.pone.0246640
  29. Shah, N., Konchak, C., Chertok, D., Au, L., Kozlov, A., Ravichandran, U., McNulty, P., Liao, L., Steele, K., Kharasch, M., Boyle, C., Hensing, T., Lovinger, D., Birnberg, J., Solomonides, A., & Halasyamani, L. (2020). Clinical Analytics Prediction Engine (CAPE): Development, electronic health record integration and prospective validation of hospital mortality, 180-day mortality and 30-day readmission risk prediction models. PLOS ONE, 15(8), e0238065. https://doi.org/10.1371/journal.pone.0238065
  30. Sinha, S., Dong, T., Dimagli, A., Judge, A., & Angelini, G. D. (2024). A machine learning algorithm–based risk prediction score for in-hospital/30-day mortality after adult cardiac surgery. European Journal of Cardio-Thoracic Surgery, 66(4), ezae368. https://doi.org/10.1093/ejcts/ezae368
  31. Talebpour, A., Sadeghi-Bazargani, H., Janati, A., Pashazadeh, F., & Gholizadeh, M. (2025). Crucial key performance indicators for hospital evaluation: A scoping review. Journal of Education and Health Promotion, 14(1), Article 195. https://doi.org/10.4103/jehp.jehp_2102_23
  32. Thorsen-Meyer, H.-C., Nielsen, A. B., Nielsen, A. P., Kaas-Hansen, B. S., Toft, P., Schierbeck, J., Strøm, T., Chmura, P. J., Heimann, M., Dybdahl, L., Spangsege, L., Hulsen, P., Belling, K., Brunak, S., & Perner, A. (2020). Dynamic and explainable machine learning prediction of mortality in patients in the intensive care unit: A retrospective study of high-frequency data in electronic patient records. The Lancet Digital Health, 2(4), e179–e191. https://doi.org/10.1016/S2589-7500(20)30018-2
  33. Trentino, K. M., Schwarzbauer, K., Mitterecker, A., Hofmann, A., Lloyd, A., Leahy, M. F., Tschoellitsch, T., Böck, C., Hochreiter, S., & Meier, J. (2022). Machine learning–based mortality prediction of patients at risk during hospital admission. Journal of Patient Safety, 18(5), 494–498. https://doi.org/10.1097/PTS.0000000000000957
  34. Warman, P. I., Seas, A., Satyadev, N., Adil, S. M., Kolls, B. J., Haglund, M. M., Dunn, T. W., & Fuller, A. T. (2022). Machine learning for predicting in-hospital mortality after traumatic brain injury in both high-income and low- and middle-income countries. Neurosurgery, 90(5), 605–612. https://doi.org/10.1227/neu.0000000000001898
  35. Wu, M., & Gao, H. (2023). A prediction model for in-hospital mortality in intensive care unit patients with metastatic cancer. Frontiers in Surgery, 10, 992936. https://doi.org/10.3389/fsurg.2023.992936
  36. Wu, Z., Li, M., Xu, Z., & Liu, G. (2025). Machine learning model development and validation using SHAP: Predicting 28-day mortality risk in pulmonary fibrosis patients. BMC Medical Informatics and Decision Making, 25(1), Article 382. https://doi.org/10.1186/s12911-025-03172-8
  37. Yun, K., Oh, J., Hong, T. H., & Kim, E. Y. (2021). Prediction of mortality in surgical intensive care unit patients using machine learning algorithms. Frontiers in Medicine, 8, 621861. https://doi.org/10.3389/fmed.2021.621861

Open Access Copyright (c) 2026 Sri Murdiati, Safrizal Rahman, Yoga Yuniadi, Nirwana Lazuardi Sary
Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

AcTion: Aceh Nutrition Journal
Published by: Department of Nutrition at the Health Polytechnic of Aceh, Ministry of Health.
Soekarno-Hatta Street, No. 168. Health Polytechnic of Aceh, Aceh Besar, 23352. Telp/Fax: 0651 46126 / 0651 46121.
Website: https://gizipoltekkesaceh.ac.id/
E-mail: jurnal6121@gmail.com

e-issn: 2548-5741, p-issn: 2527-3310

All content is licensed under a: Creative Commons Attribution ShareAlike 4.0 International License

View My Stats

Get a feed by atom here, RRS2 here and OAI Links here