Skip to main content
 

 

 

Optimal Deep Neural Network-Based Model for Answering Visual Medical Question

Author name : MAHMOOD ABDELMONEIM MAHMOOD MOHAMED
Publication Date : 2021-12-28
Journal Name : Cybernetics and Systems An International Journal

Abstract

Over the last few years, the amount of available information has increased exponentially in all professional fields, including the medical field. Modern-day patients have access to a wealth of medical information, whether it be from brochures, newspapers, television campaigns, or internet documents. To facilitate and accelerate the search for medical information, more precise systems have been implemented, such as visual question-and-answer systems. A visual question-and-answer system is designed to provide direct and precise answers to questions asked in natural language. In this context, we propose an optimal deep neural network model based on an adaptive optimization algorithm, which takes medical images and natural language questions as input, then provides precise answers as output. Our model starts by classifying medical questions following an embedding phase. We then use a deep learning model for visual and textual feature extraction and emergence. In this paper, we aim to maximize the accuracy rate and minimize the number of epochs in order to accelerate the process. This is a multi-objective optimization problem. The selection of deep learning model parameters, such as epoch number and batch size, is an essential step in improving the model, thus, we use an adaptive genetic algorithm to determine the optimal deep learning parameters. Finally, we propose a dense layer for answer retrieval. To evaluate our model, we used the ImageCLEF 2019 VQA data set. Our model outperforms existing visual question-and-answer systems and offers a significantly higher retrieval accuracy rate.

Keywords

Bi-LSTM,deep learning,EfficientNet,genetic algorithm,medical visual question answering,optimization

Publication Link

https://doi.org/10.1080/01969722.2021.2018543

Block_researches_list_suggestions

Suggestions to read

“Synthesis and Characterization study of SnO2/α-Fe2O3, In2O3/α-Fe2O3 and ZnO/α-Fe2O3 thin films and its application as transparent conducting electrode in silicon heterojunction solar cell”
Asma Arfaoui
Influence of zinc acetate on HPMC/CMC polymer blend: Investigation of their composites’ structural, optical, and dielectric properties for dielectric capacitor applications
ghallab ahmed ahmed nassar sobhy
Study of the structural, optical and electrical properties of PVA/SA performance by incorporating Al2O3 nanoparticles
ghallab ahmed ahmed nassar sobhy
Characterization and Cytotoxic Assessment of Bis(2-hydroxy-3-carboxyphenyl)methane and Its Nickel(II) Complex
ghallab ahmed ahmed nassar sobhy
Contact