570-06-210 ISMRM Abstract

Multimodal LLMs Can Name It but Struggle to Place It: Spatial Reasoning Gaps for Radiology Workflows

Primary: Analysis Methods - Generative Models

Secondary: Analysis Methods - Multi-Modal Learning with LLMs/VLMs

570-06-210 · Vision and Language Models in MRI · Wednesday, 13 May, 2:35 PM–3:30 PM · Traditional Posters | Exhibition Hall

Keywords: Structured Reporting AI-assisted radiology Multimodal Large Language Models (MMLLMs) Spatial Reasoning Medical Image Reasoning

Accepted

Nithya Ramesh¹, Ashish Saxena ¹, Sanand Sasidharan¹, Anuradha Kanamarlapudi¹

¹GE HealthCare, Bengaluru, India

Presenting Author: Ashish Saxena

Synopsis

Motivation:

Goals:

Approach:

Results:

Full abstract & presentation

The full text, figures, and any recorded presentation for this abstract are not shown here. Log in if you are a member or registered attendee with access.

Full abstracts, figures, and presentations for Cape Town - 2026 ISMRM-ISMRT Annual Meeting and Exhibition are available to registered attendees. This content becomes freely available to the public roughly two years after the meeting.

To request or purchase access, contact the ISMRM Central Office at info@ismrm.org.

References

1. Bradshaw TJ, Tie X, Warner J, Hu J, Li Q, Li X. Large Language Models and Large Multimodal Models in Medical Imaging: A Primer for Physicians. Journal of Nuclear Medicine. 2025 Feb 1;66(2):173-82.

2. Salbas A, Buyuktoka RE. Performance of Large Language Models in Recognizing Brain MRI Sequences: A Comparative Analysis of ChatGPT-4o, Claude 4 Opus, and Gemini 2.5 Pro. Diagnostics. 2025 Jul 30;15(15):1919.

3. Gosai A, Kavishwar A, McNamara SL, Samineni S, Umeton R, Chowdhury A, Lotter W. Beyond Diagnosis: Evaluating Multimodal LLMs for Pathology Localization in Chest Radiographs. arXiv preprint arXiv:2509.18015. 2025 Sep 22.

4. Chae J, Wang Z, Zhang L, Yu D, Qin P. Grid-augmented vision: A simple yet effective approach for enhanced spatial understanding in multi-modal agents. arXiv preprint arXiv:2411.18270. 2024 Nov 27.

5. Litjens, G., Debats, O., Barentsz, J., Karssemeijer, N., & Huisman, H. (2017). SPIE-AAPM PROSTATEx Challenge Data (Version 2) [dataset]. The Cancer Imaging Archive. https://doi.org/10.7937/K9TCIA.2017.MURS5CL [doi]

6. Msoud Nickparvar. (2021). Brain Tumor MRI Dataset [Data set]. Kaggle. https://doi.org/10.34740/KAGGLE/DSV/2645886 [doi]

7. Xu H, Nie Y, Wang H, Chen Y, Li W, Ning J, Liu L, Wang H, Zhu L, Liu J, Li X. Medground-r1: Advancing medical image grounding via spatial-semantic rewarded group relative policy optimization. InInternational Conference on Medical Image Computing and Computer-Assisted Intervention 2025 Sep 20 (pp. 391-401). Cham: Springer Nature Switzerland.

Cite this abstract

http://echo.ismrm.org/p/ISMRM2026/570-06-210