Improving Heart Disease Classification using Multimodal Fusion in Deep Learning

Shms Aldeen S. Al-Duri
International Journal of Computational and Electronic Aspects in Engineering
Volume 6: Issue 3, September 2025, pp 218-227

Author's Information
Shms Aldeen S. Al-Duri 1 
Corresponding Author
1Department of Basic Science, College of Dentistry, Tikrit University, Tikrit, Iraq
shms.aldeen@tu.edu.iq
Research Paper -- Peer Review
First online on – 20 September 2025

Open Access article under Creative Commons License

Cite this article –Shms Aldeen S. Al-Duri, “Improving Heart Disease Classification using Multimodal Fusion in Deep Learning ”, International Journal of Computational and Electronic Aspects in Engineering, RAME Publishers, Volume 6, Issue 3, pp. 218-227, 2025.
https://doi.org/10.26706/ijceae.6.3.20250812

Abstract:-

Heart disease is one of the causes of suffering for those affected and is also one of the leading causes of death. There are many studies that examine the diagnosis of diseases, and deep learning has emerged as a prominent tool in their diagnosis and differentiation. Previous studies relied on classifying heart diseases using deep learning techniques, either using clinical data or relying on electrocardiogram signals. This study focused on using the Multimodal Fusion in Deep Learning Neural Network MFDNN model to diagnose lung cancer through various types of data sets (imaging, genomic, clinical). In this research, a three-steps model was created. The first step extracts feature from images using the ResNet18 network, the second step extract features from clinical data by uses a neural network containing linear layers , and the final step combines the features extracted from the first and second steps and classifies them. The MFDNN model achieved a training accuracy of 99.69% and a testing accuracy of 99.93%. The proposed model also excelled in classifying each category of heart disease perfectly, with F1-score, Recall, and Precision values reaching 100% for each category. The proposed model was compared with previous studies and found to be superior in terms of reliance on clinical data as well as electrocardiography ECG tracings.

Index Terms:-

Multimodal Fusion; Deep Learning; ResNet18; ECG; Image Classification

REFERENCES
  1. M. Wu, Y. Lu, W. Yang, and S. Y. Wong, “A study on arrhythmia via ECG signal classification using the convolutional neural network,” Frontiers in Computational Neuroscience, vol. 14, p. 564015, 2021.
  2. W. S. Admass and G. A. Bogale, “Arrhythmia classification using ECG signal: a meta-heuristic improvement of optimal weighted feature integration and attention-based hybrid deep learning model,” Biomedical Signal Processing and Control, vol. 87, p. 105565, 2024.
  3. S. Abbas, S. Ojo, A. Al Hejaili, G. A. Sampedro, A. Almadhor, M. M. Zaidi, and N. Kryvinska, “Artificial intelligence framework for heart disease classification from audio signals,” Scientific Reports, vol. 14, no. 1, p. 3123, 2024.
  4. H. Narotamo, M. Dias, R. Santos, A. V. Carreiro, H. Gamboa, and M. Silveira, “Deep learning for ECG classification: A comparative study of 1D and 2D representations and multimodal fusion approaches,” Biomedical Signal Processing and Control, vol. 93, p. 106141, 2024.
  5. A. S. Abdullah and K. I. Alsaif, “Computer vision systems and deep learning for the recognition of athlete's movement: A review article,” Tikrit Journal of Pure Science, vol. 28, no. 6, 2023.
  6. S. K. B. Sangeetha, S. K. Mathivanan, P. Karthikeyan, H. Rajadurai, B. D. Shivahare, S. Mallik, and H. Qin, “An enhanced multimodal fusion deep learning neural network for lung cancer classification,” Systems and Soft Computing, vol. 6, p. 200068, 2024.
  7. A. Eleyan and E. Alboghbaish, “Electrocardiogram signals classification using deep-learning-based incorporated convolutional neural network and long short-term memory framework,” Computers, vol. 13, no. 2, p. 55, 2024.
  8. A. A. Khan, M. Arslan, A. Tanzil, R. A. Bhatty, M. A. U. Khalid, and A. H. Khan, “Classification of colon cancer using deep learning techniques on histopathological images,” Migration Letters, vol. 21, no. S11, pp. 449–463, 2024.
  9. S. Aljaloud, “Performance refinement of convolutional neural network architectures for solving big data problems,” Tikrit Journal of Pure Science, vol. 28, no. 1, pp. 89–95, 2023.
  10. K. Yan, T. Li, J. A. L. Marques, J. Gao, and S. J. Fong, “A review on multimodal machine learning in medical diagnostics,” Mathematical Biosciences and Engineering, vol. 20, no. 5, pp. 8708–8726, 2023.
  11. N. Waisi, “Deep feature fusion method for images classification,” International Journal of Computational & Electronic Aspects in Engineering (IJCEAE), vol. 5, no. 4, 2024.
  12. Z. R. S. Zubair, “A deep learning based optimization model for based computer interface of wheelchair directional control,” Tikrit Journal of Pure Science, vol. 26, no. 1, pp. 108–112, 2021.
  13. L. Aversano, M. L. Bernardi, M. Cimitile, D. Montano, and R. Pecori, “Early diagnosis of cardiac diseases using ECG images and CNN-2D,” Procedia Computer Science, vol. 225, pp. 2866–2875, 2023.
  14. I. Sayin, R. Gursoy, B. Cicek, Y. E. Mert, F. Ozturk, T. E. Pamukcu, and H. Uvet, “CNN based detection of cardiovascular diseases from ECG images,” arXiv preprint arXiv:2408.16800, 2024.
  15. M. Ahmad, A. Ahmed, H. Hashim, M. Farsi, and N. Mahmoud, “Enhancing heart disease diagnosis using ECG signal reconstruction and deep transfer learning classification with optional SVM integration,” Diagnostics, vol. 15, no. 12, p. 1501, 2025.
  16. Z. Ahmad, A. Tabassum, L. Guan, and N. M. Khan, “ECG heartbeat classification using multimodal fusion,” IEEE Access, vol. 9, pp. 100615–100626, 2021.
  17. P. Wagner, N. Strodthoff, R. Bousseljot, W. Samek, and T. Schaeffter, “PTB-XL, a large publicly available electrocardiography dataset (version 1.0.3),” PhysioNet, 2022. [Online]. Available: https://doi.org/10.13026/kfzx-aw45
  18. Q. A. Hameedl, “Leveraging traditional machine learning and TF-IDF for robust fake news detection,” International Journal of Computational & Electronic Aspects in Engineering (IJCEAE), vol. 6, no. 3, pp. 143–152, 2025.
  19. M. Borchiellini, L. Mano, F. Barão, and M. Vecchi, “Feature selection techniques for CR isotope identification with the AMS-02 experiment in space,” Particles, vol. 7, no. 2, pp. 417–434, 2024.
  20. S. A. S. Al-Duri, H. N. Ali, and S. S. Mohsen, “Colour eyes classification using CNN,” in Proc. Int. Conf. Data Analytics & Management, Singapore: Springer Nature Singapore, pp. 59–76, Jun. 2024.
  21. M. B. Omarl, “Detecting road depressions based on deep learning techniques,” International Journal of Computational & Electronic Aspects in Engineering (IJCEAE), vol. 6, no. 3, pp. 153–167, 2025.
  22. M. D. Salman, “Performance of fast learning approach to predicting black fungus diseases,” International Journal of Computational & Electronic Aspects in Engineering (IJCEAE), vol. 3, no. 4, 2022.
  23. S. A. Hicks, I. Strümke, V. Thambawita, M. Hammou, M. A. Riegler, P. Halvorsen, and S. Parasa, “On evaluation metrics for medical applications of artificial intelligence,” Scientific Reports, vol. 12, no. 1, p. 5979, 2022.
  24. J. Jyotsna, P. Ramteke, and P. Baxla, “Plant disease prediction using deep learning,” International Journal of Computational & Electronic Aspects in Engineering (IJCEAE), vol. 3, no. 2, 2022.

    25. To view full paper, Download here

For authors

Author's guidelines Publication Ethics Publication Policies Artical Processing Charges Call for paper Frequently Asked Questions(FAQS) View All Volumes and Issues

Publishing with