SHAP-ALE: A Novel Approach to Explainability in Mental Health Prediction using RFR

Nur Alamsyah, Budiman Budiman, Wala Erpurini, Hani Fitria Rahmani

Abstract


The prediction of mental health disorders, such as depression, has become increasingly crucial as global mental health concerns continue to rise. In this study, the predictive task specifically focuses on estimating the prevalence of depressive disorders as the primary target variable, while other mental health conditions such as anxiety and schizophrenia are treated as explanatory features. While machine learning (ML) models, like Random Forest Regressor (RFR), offer high accuracy in predictions, their interpretability remains a challenge. This research introduces SHAP-ALE, an innovative hybrid explainability framework that integrates SHapley Additive exPlanations (SHAP) and Accumulated Local Effects (ALE) to address this gap. SHAP provides both global and local insights into feature contributions, while ALE visualizes feature-target relationships, mitigating bias caused by feature correlations. Using a dataset comprising various mental health disorders and demographic factors, the dataset used in this study was obtained from Kaggle and consists of 6,421 records covering multiple mental health disorder indicators and demographic attributes across different regions and years. RFR model demonstrated robust predictive performance with an R² score of 0.9984 and a Mean Squared Error (MSE) of 0.0016. SHAP analysis revealed that features such as schizophrenia and anxiety disorders significantly influenced predictions, while ALE identified nonlinear relationships between these features and depression prevalence. The combined insights from SHAP and ALE enhance the interpretability of the model, enabling better understanding of the complex factors underlying mental health disorders. This study highlights the contribution of SHAP-ALE as a hybrid explainability framework that integrates local and global interpretability, enabling a more comprehensive understanding of feature interactions and non-linear effects beyond the capabilities of individual methods.

Keywords


Explainability; SHAP; ALE; Mental Health Prediction; Machine Learning

Full Text:

Link Download

References


Abioye, S. O., Babatunde, Y. O., Abikoye, O. A., Shaibu, A. N., & Bankole, B. J. (2025). Optimized machine learning algorithms with SHAP analysis for predicting compressive strength in high-performance concrete. AI in Civil Engineering, 4(1), 16.

Alamsyah, N., Kurniati, A. P., & others. (2023). A Novel Airfare Dataset To Predict Travel Agent Profits Based On Dynamic Pricing. 2023 11th International Conference on Information and Communication Technology (ICoICT), 575–581.

Alamsyah, N., Kurniati, A. P., & others. (2024). Event Detection Optimization Through Stacking Ensemble and BERT Fine-Tuning for Dynamic Pricing of Airline Tickets. IEEE Access. Vol. 12

Alamsyah, N., Yoga, T. P., Budiman, B., & others. (2024). IMPROVING TRAFFIC DENSITY PREDICTION USING LSTM WITH PARAMETRIC ReLU (PReLU) ACTIVATION. JITK (Jurnal Ilmu Pengetahuan Dan Teknologi Komputer), 9(2), 154–160.

Ballester, P. L., Cardoso, T. de A., Moreira, F. P., da Silva, R. A., Mondin, T. C., Araujo, R. M., Kapczinski, F., Frey, B. N., Jansen, K., & de Mattos Souza, L. D. (2021). 5-year incidence of suicide-risk in youth: A gradient tree boosting and SHAP study. Journal of Affective Disorders, 295, 1049–1056.

Biggs, F., Schrab, A., & Gretton, A. (2024). MMD-FUSE: Learning and combining kernels for two-sample testing without data splitting. Advances in Neural Information Processing Systems, 36.

Chatterjee, S., Mishra, J., Sundram, F., & Roop, P. (2023). Towards personalised mood prediction and explanation for depression from biophysical data. Sensors, 24(1), 164.

Chattopadhyay, S., Barman, S., & Lakshmi, D. (2025). The Role of Explainable AI for Healthcare 5.0: Best Practices, Challenges, and Opportunities. Edge AI for Industry 5.0 and Healthcare 5.0 Applications, 45–80.

Chen, Q., Huang, S., Xu, H., Peng, J., Wang, P., Li, S., Zhao, J., Shi, X., Zhang, W., Shi, L., & others. (2024). The burden of mental disorders in Asian countries, 1990–2019: An analysis for the global burden of disease study 2019. Translational Psychiatry, 14(1), 167.

Colizzi, M. (2025). Ten priorities that are shaping the future of mental health prevention. Discover Mental Health, 5(1), 140.

Darko, A. P., Antwi, C. O., Adjei, K., Zhang, B., & Ren, J. (2024). Predicting determinants influencing user satisfaction with mental health app: An explainable machine learning approach based on unstructured data. Expert Systems with Applications, 249, 123647.

Dhanda, S. S., Panwar, D., Lin, C.-C., Sharma, T. K., Rastogi, D., Bindewari, S., Singh, A., Li, Y.-H., Agarwal, N., & Agarwal, S. (2025). Advancement in public health through machine learning: A narrative review of opportunities and ethical considerations. Journal of Big Data, 12(1), 154.

Enkhbayar, D., Ko, J., Oh, S., Ferdushi, R., Kim, J., Key, J., & Urtnasan, E. (2025). Explainable Artificial Intelligence Models for Predicting Depression Based on Polysomnographic Phenotypes. Bioengineering, 12(2), 186.

Fisher, J., Allen, S., Yetman, G., & Pistolesi, L. (2024). Assessing the influence of landscape conservation and protected areas on social wellbeing using random forest machine learning. Scientific Reports, 14(1), 11357.

Hikmawati, E., & Alamsyah, N. (2024). Supervised Learning for Emotional Prediction and Feature Importance Analysis Using SHAP on Social Media User Data. Ingénierie Des Systèmes d’Information, 29(6).

Kirkbride, J. B., Anglin, D. M., Colman, I., Dykxhoorn, J., Jones, P. B., Patalay, P., Pitman, A., Soneson, E., Steare, T., Wright, T., & others. (2024). The social determinants of mental health and disorder: Evidence, prevention and recommendations. World Psychiatry, 23(1), 58.

Li, C., Huang, Z., Hao, H., Shen, Z., Zhao, G., Xu, B., & Liu, H. (2025). Interpretable machine learning model of effective mass in perovskite oxides with cross-scale features. Journal of Materiomics, 11(1), 100848.

Momeni, M. (2024). Mental Health [Dataset]. https://www.kaggle.com/datasets/imtkaggleteam/mental-health/data

Parisineni, S. R. A., & Pal, M. (2024). Enhancing trust and interpretability of complex machine learning models using local interpretable model agnostic shap explanations. International Journal of Data Science and Analytics, 18(4), 457–466.

Rotejanaprasert, C., Thanutchapat, P., Phoncharoenwirot, C., Mekchaiporn, O., Chienwichai, P., & Maude, R. J. (2024). Investigating the spatiotemporal patterns and clustering of attendances for mental health services to inform policy and resource allocation in Thailand. International Journal of Mental Health Systems, 18(1), 19.

Shen, A., Sun, J., Chen, X., & Gao, X. (2025). A data-centric and interpretable EEG framework for depression severity grading using SHAP-based insights. Journal of NeuroEngineering and Rehabilitation, 22(1), 116.

Timilsina, M. S., Sen, S., Uprety, B., Patel, V. B., Sharma, P., & Sheth, P. N. (2024). Prediction of HHV of fuel by Machine learning Algorithm: Interpretability analysis using Shapley Additive Explanations (SHAP). Fuel, 357, 129573.

Tran, T., Tan, Y. Z., Lin, S., Zhao, F., Ng, Y. S., Ma, D., Ko, J., & Balan, R. (2025). Exploring key factors influencing depressive symptoms among middle-aged and elderly adult population: A machine learning-based method. Archives of Gerontology and Geriatrics, 129, 105647.

Vu, T., Yamamoto, M., Tay, J. T., Watanabe, N., Kuriya, Y., Oya, A., Tran, P. N. H., Araki, M., & others. (2025). Prediction of depressive disorder using machine learning approaches: Findings from the NHANES. BMC Medical Informatics and Decision Making, 25(1), 1–12.

Zhai, Y., Zhang, Y., Chu, Z., Geng, B., Almaawali, M., Fulmer, R., Lin, Y.-W. D., Xu, Z., Daniels, A. D., Liu, Y., & others. (2025). Machine learning predictive models to guide prevention and intervention allocation for anxiety and depressive disorders among college students. Journal of Counseling & Development, 103(1), 110–125.




DOI: http://dx.doi.org/10.35671/telematika.v19i2.3087

Refbacks

  • There are currently no refbacks.


 


Indexed by:

   

Telematika
ISSN: 2442-4528 (online) | ISSN: 1979-925X (print)
Published by : Universitas Amikom Purwokerto
Jl. Let. Jend. POL SUMARTO Watumas, Purwonegoro - Purwokerto, Indonesia


Creative Commons License This work is licensed under a Creative Commons Attribution 4.0 International License .