Cape Town - 2026 ISMRM-ISMRT Annual Meeting and Exhibition
9 May 2026 – 14 May 2026 · Cape Town, South Africa
608-02-008 ISMRM Abstract

On the Utility of Vision-language Foundation Models for MRI Reconstruction

Primary: Analysis Methods - Foundation Models
Secondary: Acquisition & Reconstruction - Image Reconstruction: AI
608-02-008 · Towards Multimodal Intelligence in MRI: Vision-Language Integration · Thursday, 14 May, 1:40 PM–3:30 PM · Meeting Room 1.60
Keywords: Fast MRI Vision-Language Foundation Model Contrastive Learning Semantic prior
Accepted
Ruimin Feng1,2, Xingxin He1,2, Fang Liu 1,2
1Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Charlestown, United States of America
2Harvard Medical School, Boston, United States of America
Presenting Author: Fang Liu

Synopsis

Motivation:
Goals:
Approach:
Results:
Full abstract & presentation

The full text, figures, and any recorded presentation for this abstract are not shown here. Log in if you are a member or registered attendee with access.

Full abstracts, figures, and presentations for Cape Town - 2026 ISMRM-ISMRT Annual Meeting and Exhibition are available to registered attendees. This content becomes freely available to the public roughly two years after the meeting.

To request or purchase access, contact the ISMRM Central Office at info@ismrm.org.

Log in

References

1. Li C, Gan Z, Yang Z, et al. Multimodal Foundation Models: From Specialists to General-Purpose Assistants. Found Trends® Comput Graph Vis. 2024;16(1-2):1-214. doi:10.1561/0600000110 [doi]
2. Pruessmann KP, Weiger M, Scheidegger MB, Boesiger P. SENSE: Sensitivity encoding for fast MRI. Magn Reson Med. 1999;42(5):952-962. PMID: 10542355 [pmid]
3. Griswold MA, Jakob PM, Heidemann RM, et al. Generalized autocalibrating partially parallel acquisitions (GRAPPA). Magn Reson Med. 2002;47(6):1202-1210. doi:10.1002/MRM.10171 [doi]
4. Lustig M, Donoho D, Pauly JM. Sparse MRI: The application of compressed sensing for rapid MR imaging. Magn Reson Med. 2007;58(6):1182-1195. doi:10.1002/MRM.21391 [doi]
5. Block KT, Uecker M, Frahm J. Undersampled radial MRI with multiple coils. Iterative image reconstruction using a total variation constraint. Magn Reson Med. 2007;57(6):1086-1098. doi:10.1002/MRM.21236 [doi]
6. Majumdar A, Ward RK. Accelerating multi-echo T2 weighted MR imaging: Analysis prior group-sparse optimization. J Magn Reson. 2011;210(1):90-97. doi:10.1016/J.JMR.2011.02.015 [doi]
7. Hammernik K, Klatzer T, Kobler E, et al. Learning a variational network for reconstruction of accelerated MRI data. Magn Reson Med. 2018;79(6):3055-3071. doi:10.1002/mrm.26977 [doi]
8. Zhu B, Liu JZ, Cauley SF, Rosen BR, Rosen MS. Image reconstruction by domain-transform manifold learning. Nature. 2018;555(7697):487-492. doi:10.1038/NATURE25988 [doi]
9. Aggarwal HK, Mani MP, Jacob M. MoDL: Model Based Deep Learning Architecture for Inverse Problems. IEEE Trans Med Imaging. 2018;38(2):394. doi:10.1109/TMI.2018.2865356 [doi]
10. Huang J, Fang Y, Wu Y, et al. Swin transformer for fast MRI. Neurocomputing. 2022;493:281-304. doi:10.1016/J.NEUCOM.2022.04.051 [doi]
11. Yaman B, Hosseini SAH, Moeller S, Ellermann J, Uğurbil K, Akçakaya M. Self-Supervised Learning of Physics-Guided Reconstruction Neural Networks without Fully-Sampled Reference Data. Magn Reson Med. 2020;84(6):3172. doi:10.1002/MRM.28378 [doi]
12. Zou J, Pei T, Li C, Wu R, Wang S. Self-Supervised Federated Learning for Fast MR Imaging. IEEE Trans Instrum Meas. 2024;73:1-11. doi:10.1109/TIM.2023.3331413 [doi]
13. Chung H, Ye JC. Score-based diffusion models for accelerated MRI. Med Image Anal. 2022;80:102479. doi:10.1016/J.MEDIA.2022.102479 [doi]
14. Wu C, Chen X, Wu Z, et al. Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generation. https://github.com/deepseek-ai/Janus. Accessed October 22, 2025.
15. Wang S, Su Z, Ying L, et al. Accelerating magnetic resonance imaging via deep learning. Proc - Int Symp Biomed Imaging. 2016;2016-June:514-517. doi:10.1109/ISBI.2016.7493320 [doi]
16. Feng R, Wu Q, Feng J, et al. IMJENSE: Scan-Specific Implicit Representation for Joint Coil Sensitivity and Image Estimation in Parallel MRI. IEEE Trans Med Imaging. 2024;43(4):1539-1553. doi:10.1109/TMI.2023.3342156 [doi]
17. Zbontar J, Knoll F, Sriram A, et al. fastMRI: An Open Dataset and Benchmarks for Accelerated MRI. November 2018. https://arxiv.org/pdf/1811.08839. Accessed October 22, 2025.
18. Knoll F, Zbontar J, Sriram A, et al. fastMRI: A Publicly Available Raw k-Space and DICOM Dataset of Knee Images for Accelerated MR Image Reconstruction Using Machine Learning. https://doi.org/101148/ryai2020190007. 2020;2(1). doi:10.1148/RYAI.2020190007 [doi]
19. McInnes L, Healy J, Melville J. UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction. February 2018. https://arxiv.org/pdf/1802.03426. Accessed October 23, 2025.

Cite this abstract

http://echo.ismrm.org/p/ISMRM2026/608-02-008