Decibel Imaging for Generating Medical Report using Ultrasonic
Sathya. N1, Sanjai. D2, Swathi. R3
1Sathya.N*, Department of Information Technology, Sri Shakthi Institute of Engineering and Technology, Coimbatore, India.
2Sanjai. D, Department of Information Technology,Sri Shakthi Institute of Engineering and Technology, Coimbatore, India.
3Swathi. R, Department of Information Technology,Sri Shakthi Institute of Engineering and Technology, Coimbatore, India.
Manuscript received on April 22, 2020. | Revised Manuscript received on April 26, 2020. | Manuscript published on April 30, 2020. | PP: 2444-2448 | Volume-9 Issue-4, April 2020. | Retrieval Number: D8309049420/2020©BEIESP | DOI: 10.35940/ijeat.D8309.049420
Open Access | Ethics and Policies | Cite | Mendeley
© The Authors. Blue Eyes Intelligence Engineering and Sciences Publication (BEIESP). This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/)
Abstract: Medical imaging is commonly used for diagnosis and care in clinical practice. Report-writing would be prone to mistakes for inexperienced physicians, and experienced physicians would be time consuming and boring. To handle these issues, we study the automated generation of medical imaging reports. This task presents several challenges. First, a complete report contains multiple heterogeneous types of information including findings and tags. Second, abnormal regions in medical images are difficult to spot. Third, usually, the reports are lengthy and contain multiple sentences. To deal with these challenges, we (1) build a multi-task learning framework which jointly performs the prediction of tags and therefore the generation of paragraphs, (2) propose a co-attention mechanism to localize regions containing abnormalities and generate narrations for them, (3) develop a hierarchical LSTM model to get long paragraphs. We show the efficacy of the proposed methods on two datasets which are publicly accessible.
Keywords: Medical Imaging, Long Short Term Memory (LSTM), Ultrasound Imaging.