TY - JOUR
T1 - Comprehensive Review of Multimodal Medical Data Analysis
T2 - Open Issues and Future Research Directions
AU - Shetty, Shashank
AU - Ananthanarayana, V. S.
AU - Mahale, Ajit
N1 - Funding Information:
We would like to thank the Department of Information Technology, National Institute of Technology Karnataka, Surathkal, for providing us with the resources for carrying out this research. We would like to thank KMC, Mangalore, for technical assistance. We also thank the special issue editors and reviewers for their time and consideration.
Publisher Copyright:
© 2022 by the author(s).
PY - 2022
Y1 - 2022
N2 - Over the past few decades, the enormous expansion of medical data has led to searching for ways of data analysis in smart healthcare systems. Acquisition of data from pictures, archives, communication systems, electronic health records, online documents, radiology reports and clinical records of different styles with specific numerical information has given rise to the concept of multimodality and the need for machine learning and deep learning techniques in the analysis of the healthcare system. Medical data play a vital role in medical education and diagnosis; determining dependency between distinct modalities is essential. This paper gives a gist of current radiology medical data analysis techniques and their various approaches and frameworks for representation and classification. A brief outline of the existing medical multimodal data processing work is presented. The main objective of this study is to spot gaps in the surveyed area and list future tasks and challenges in radiology. The Preferred Reporting Items for Systematic Reviews and Meta-Analysis (or PRISMA) guidelines were incorporated in this study for effective article search and to investigate several relevant scientific publications. The systematic review was carried out on multimodal medical data analysis and highlighted advantages, limitations and strategies. The inherent benefit of multimodality in the medical domain powered with artificial intelligence has a significant impact on the performance of the disease diagnosis frameworks.
AB - Over the past few decades, the enormous expansion of medical data has led to searching for ways of data analysis in smart healthcare systems. Acquisition of data from pictures, archives, communication systems, electronic health records, online documents, radiology reports and clinical records of different styles with specific numerical information has given rise to the concept of multimodality and the need for machine learning and deep learning techniques in the analysis of the healthcare system. Medical data play a vital role in medical education and diagnosis; determining dependency between distinct modalities is essential. This paper gives a gist of current radiology medical data analysis techniques and their various approaches and frameworks for representation and classification. A brief outline of the existing medical multimodal data processing work is presented. The main objective of this study is to spot gaps in the surveyed area and list future tasks and challenges in radiology. The Preferred Reporting Items for Systematic Reviews and Meta-Analysis (or PRISMA) guidelines were incorporated in this study for effective article search and to investigate several relevant scientific publications. The systematic review was carried out on multimodal medical data analysis and highlighted advantages, limitations and strategies. The inherent benefit of multimodality in the medical domain powered with artificial intelligence has a significant impact on the performance of the disease diagnosis frameworks.
UR - http://www.scopus.com/inward/record.url?scp=85146527274&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85146527274&partnerID=8YFLogxK
U2 - 10.18267/j.aip.202
DO - 10.18267/j.aip.202
M3 - Review article
AN - SCOPUS:85146527274
SN - 1805-4951
VL - 11
SP - 423
EP - 457
JO - Acta Informatica Pragensia
JF - Acta Informatica Pragensia
IS - 3
ER -