SHAP-ALE: A Novel Approach to Explainability in Mental Health Prediction using RFR

Nur Alamsyah, Budiman Budiman, Wala Erpurini, Hani Fitria Rahmani

Abstract


The prediction of mental health disorders, such as depression, has become increasingly crucial as global mental health concerns continue to rise. In this study, the predictive task specifically focuses on estimating the prevalence of depressive disorders as the primary target variable, while other mental health conditions such as anxiety and schizophrenia are treated as explanatory features. While machine learning (ML) models, like Random Forest Regressor (RFR), offer high accuracy in predictions, their interpretability remains a challenge. This research introduces SHAP-ALE, an innovative hybrid explainability framework that integrates SHapley Additive exPlanations (SHAP) and Accumulated Local Effects (ALE) to address this gap. SHAP provides both global and local insights into feature contributions, while ALE visualizes feature-target relationships, mitigating bias caused by feature correlations. Using a dataset comprising various mental health disorders and demographic factors, the dataset used in this study was obtained from Kaggle and consists of 6,421 records covering multiple mental health disorder indicators and demographic attributes across different regions and years. RFR model demonstrated robust predictive performance with an R² score of 0.9984 and a Mean Squared Error (MSE) of 0.0016. SHAP analysis revealed that features such as schizophrenia and anxiety disorders significantly influenced predictions, while ALE identified nonlinear relationships between these features and depression prevalence. The combined insights from SHAP and ALE enhance the interpretability of the model, enabling better understanding of the complex factors underlying mental health disorders. This study highlights the contribution of SHAP-ALE as a hybrid explainability framework that integrates local and global interpretability, enabling a more comprehensive understanding of feature interactions and non-linear effects beyond the capabilities of individual methods.

Keywords


Explainability; SHAP; ALE; Mental Health Prediction; Machine Learning

Full Text:

Link Download

References


Alamsyah, N., Kurniati, A. P., & others. (2023). A Novel Airfare Dataset To Predict Travel Agent Profits Based On Dynamic Pricing. 2023 11th International Conference on Information and Communication Technology (ICoICT), 575–581.

Alamsyah, N., Yoga, T. P., Budiman, B., & others. (2024). IMPROVING TRAFFIC DENSITY PREDICTION USING LSTM WITH PARAMETRIC ReLU (PReLU) ACTIVATION. JITK (Jurnal Ilmu Pengetahuan Dan Teknologi Komputer), 9(2), 154–160.

Biggs, F., Schrab, A., & Gretton, A. (2024). MMD-FUSE: Learning and combining kernels for two-sample testing without data splitting. Advances in Neural Information Processing Systems, 36.

Chen, Q., Huang, S., Xu, H., Peng, J., Wang, P., Li, S., Zhao, J., Shi, X., Zhang, W., Shi, L., & others. (2024). The burden of mental disorders in Asian countries, 1990–2019: An analysis for the global burden of disease study 2019. Translational Psychiatry, 14(1), 167.

Darko, A. P., Antwi, C. O., Adjei, K., Zhang, B., & Ren, J. (2024). Predicting determinants influencing user satisfaction with mental health app: An explainable machine learning approach based on unstructured data. Expert Systems with Applications, 249, 123647.

Fisher, J., Allen, S., Yetman, G., & Pistolesi, L. (2024). Assessing the influence of landscape conservation and protected areas on social wellbeing using random forest machine learning. Scientific Reports, 14(1), 11357.

Hassija, V., Chamola, V., Mahapatra, A., Singal, A., Goel, D., Huang, K., Scardapane, S., Spinelli, I., Mahmud, M., & Hussain, A. (2024). Interpreting black-box models: A review on explainable artificial intelligence. Cognitive Computation, 16(1), 45–74.

Hikmawati, E., & Alamsyah, N. (2024). Supervised Learning for Emotional Prediction and Feature Importance Analysis Using SHAP on Social Media User Data. Ingénierie Des Systèmes d’Information, 29(6).

Islam, M. M., Hassan, S., Akter, S., Jibon, F. A., & Sahidullah, M. (2024). A comprehensive review of predictive analytics models for mental illness using machine learning algorithms. Healthcare Analytics, 100350.

Kirkbride, J. B., Anglin, D. M., Colman, I., Dykxhoorn, J., Jones, P. B., Patalay, P., Pitman, A., Soneson, E., Steare, T., Wright, T., & others. (2024). The social determinants of mental health and disorder: Evidence, prevention and recommendations. World Psychiatry, 23(1), 58.

Li, C., Huang, Z., Hao, H., Shen, Z., Zhao, G., Xu, B., & Liu, H. (2025). Interpretable machine learning model of effective mass in perovskite oxides with cross-scale features. Journal of Materiomics, 11(1), 100848.

Momeni, M. (2024). Mental Health [Dataset]. https://www.kaggle.com/datasets/imtkaggleteam/mental-health/data

Parisineni, S. R. A., & Pal, M. (2024). Enhancing trust and interpretability of complex machine learning models using local interpretable model agnostic shap explanations. International Journal of Data Science and Analytics, 18(4), 457–466.

Rotejanaprasert, C., Thanutchapat, P., Phoncharoenwirot, C., Mekchaiporn, O., Chienwichai, P., & Maude, R. J. (2024). Investigating the spatiotemporal patterns and clustering of attendances for mental health services to inform policy and resource allocation in Thailand. International Journal of Mental Health Systems, 18(1), 19.

Timilsina, M. S., Sen, S., Uprety, B., Patel, V. B., Sharma, P., & Sheth, P. N. (2024). Prediction of HHV of fuel by Machine learning Algorithm: Interpretability analysis using Shapley Additive Explanations (SHAP). Fuel, 357, 129573.

Tran, T., Tan, Y. Z., Lin, S., Zhao, F., Ng, Y. S., Ma, D., Ko, J., & Balan, R. (2025). Exploring key factors influencing depressive symptoms among middle-aged and elderly adult population: A machine learning-based method. Archives of Gerontology and Geriatrics, 129, 105647.

Zhai, Y., Zhang, Y., Chu, Z., Geng, B., Almaawali, M., Fulmer, R., Lin, Y.-W. D., Xu, Z., Daniels, A. D., Liu, Y., & others. (2025). Machine learning predictive models to guide prevention and intervention allocation for anxiety and depressive disorders among college students. Journal of Counseling & Development, 103(1), 110–125.




DOI: http://dx.doi.org/10.35671/telematika.v19i2.3087

Refbacks

  • There are currently no refbacks.


 


Indexed by:

   

Telematika
ISSN: 2442-4528 (online) | ISSN: 1979-925X (print)
Published by : Universitas Amikom Purwokerto
Jl. Let. Jend. POL SUMARTO Watumas, Purwonegoro - Purwokerto, Indonesia


Creative Commons License This work is licensed under a Creative Commons Attribution 4.0 International License .