570-06-207 ISMRM Abstract

NeuroRAP: A Retrieval-Assisted Vision-Language Model for Prognosis Prediction in Neurodegenerative Disorders

Primary: Analysis Methods - Multi-Modal Learning with LLMs/VLMs

Secondary: Neuro - Dementia

570-06-207 · Vision and Language Models in MRI · Wednesday, 13 May, 2:35 PM–3:30 PM · Traditional Posters | Exhibition Hall

Keywords: Multiple Sclerosis Mild cognitive impairment Prognosis Vision-language model Quantitative MRI metrics

Accepted

Dongang Wang^1,2, Geng Zhan¹, Yang Ma³, Zihao Tang^1,3, Heidi Beadnall¹, Yuanzhao Chen², Linda Ly², Qianyu Wang², Chun-Chien Shieh², Chenyu Wang ^1,2, Michael Barnett^1,2

¹Brain and Mind Centre, The University of Sydney, Sydney, Australia

²Sydney Neuroimaging Analysis Centre, Camperdown, Australia

³School of Computer Science, Faculty of Engineering, The University of Sydney, Sydney, Australia

Presenting Author: Chenyu Wang

Synopsis

Motivation:

Goals:

Approach:

Results:

Full abstract & presentation

The full text, figures, and any recorded presentation for this abstract are not shown here. Log in if you are a member or registered attendee with access.

Full abstracts, figures, and presentations for Cape Town - 2026 ISMRM-ISMRT Annual Meeting and Exhibition are available to registered attendees. This content becomes freely available to the public roughly two years after the meeting.

To request or purchase access, contact the ISMRM Central Office at info@ismrm.org.

References

1. Shu Wang, Yin Jiang, Anchao Yang, Fangang Meng, and Jianguo Zhang. The expanding burden of neurorodegenerative diseases: an unmet medical and social need. Aging and disease, 16(5):2937, 2024. URL https://doi.org/10.14336/AD.2024.1071 [doi]

2. Clifford R Jack Jr, Matt A Bernstein, Nick C Fox, Paul Thompson, Gene Alexander, Danielle Harvey, Bret Borowski,Paula J Britson, Jennifer L. Whitwell, Chadwick Ward, et al. The alzheimer’s disease neuroimaging initiative (adni): Mri methods. Journal of Magnetic Resonance Imaging: An Official Journal of the International Society for Magnetic Resonance in Medicine, 27(4):685–691, 2008. URL https://doi.org/10.1002/jmri.21049 [doi]

3. Michael Barnett, Dongang Wang, Heidi Beadnall, Antje Bischof, David Brunacci, Helmut Butzkueven, J William L Brown, Mariano Cabezas, Tilak Das, Tej Dugal, et al. A real-world clinical validation for ai-based mri monitoring in multiple sclerosis. NPJ digital medicine, 6(1):196, 2023. URL https://doi.org/10.1038/s41746-023-00940-6 [doi]

4. Junnan Li, Dongxu Li, Silvio Savarese, and Steven Hoi. Blip-2: Bootstrapping language-image pre-training with frozen image encoders and large language models. In International conference on machine learning, pages 19730–19742. PMLR, 2023. URL https://proceedings.mlr.press/v202/li23q.html

5. Shaohao Rui, Lingzhi Chen, Zhenyu Tang, Lilong Wang, Mianxin Liu, Shaoting Zhang, and Xiaosong Wang. Multi-modal vision pre-training for medical image analysis. In Proceedings of the Computer Vision and Pattern Recognition Conference, pages 5164–5174, 2025. URL https://doi.org/10.1109/CVPR52734.2025.00487 [doi]

6. Wei-Lin Chiang, Zhuohan Li, Zi Lin, Ying Sheng, Zhanghao Wu, Hao Zhang, Lianmin Zheng, Siyuan Zhuang, Yonghao Zhuang, Joseph E. Gonzalez, Ion Stoica, and Eric P. Xing. Vicuna: An open-source chatbot impressing gpt-4 with 90%* chatgpt quality, March 2023. URL https://lmsys.org/blog/2023-03-30-vicuna/

7. Tomas Kalincik, Gary Cutter, Tim Spelman, Vilija Jokubaitis, Eva Havrdova, Dana Horakova, Maria Trojano, Guillermo Izquierdo, Marc Girard, Pierre Duquette, et al. Defining reliable disability outcomes in multiple sclerosis. Brain, 138(11):3287–3298, 2015. URL https://doi.org/10.1093/brain/awv258 [doi]

8. Günther Grabner, Andrew L Janke, Marc M Budge, David Smith, Jens Pruessner, and D Louis Collins. Symmetric atlasing and model based segmentation: an application to the hippocampus in older adults. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pages 58–66. Springer, 2006. URL https://doi.org/10.1007/11866763_8 [doi]

Cite this abstract

http://echo.ismrm.org/p/ISMRM2026/570-06-207