Cape Town - 2026 ISMRM-ISMRT Annual Meeting and Exhibition
9 May 2026 – 14 May 2026 · Cape Town, South Africa
561-01-004 ISMRM Abstract

3D Conditional VAE with ViT-UNETR for Multi-Sequence Brain MRI Generation

Primary: Analysis Methods - Generative Models
Secondary: Analysis Methods - Image Synthesis and Translation
561-01-004 · Generative Models for Image Synthesis · Wednesday, 13 May, 8:20 AM–9:15 AM · Digital Posters Row B
Keywords: Multi-sequence MRI 3D Generative ViT-UNETR Conditional ViT-UNETR ViT-UNETR for MRI synthesis Slice-wise positional encoding
Accepted
Tayyaba Arshad 1, Endre Grovik2,3
1Helse Møre and Romsdal Hospital Trust, Alesund, Norway
2Department of Research and Innovations, Helse Møre and Romsdal Hospital Trust, Alesund, Norway
3Department of Physics, Norwegian University of Science and Technology, Trondheim, Norway
Presenting Author: Tayyaba Arshad

Synopsis

Motivation:
Goals:
Approach:
Results:
Full abstract & presentation

The full text, figures, and any recorded presentation for this abstract are not shown here. Log in if you are a member or registered attendee with access.

Full abstracts, figures, and presentations for Cape Town - 2026 ISMRM-ISMRT Annual Meeting and Exhibition are available to registered attendees. This content becomes freely available to the public roughly two years after the meeting.

To request or purchase access, contact the ISMRM Central Office at info@ismrm.org.

Log in

References

1. Walsh, Ricky, and Mickael Tardy. "A comparison of techniques for class imbalance in deep learning classification of breast cancer." Diagnostics 13, no. 1 (2022): 67. https://doi.org/10.3390/diagnostics13010067 [doi]
2. Goodfellow, Ian, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. "Generative adversarial networks." Communications of the ACM 63, no. 11 (2020): 139-144.https://doi.org/10.1145/3422622 [doi]
3. Wang, Guoshuai, Zhou Liu, Zhengyong Huang, Na Zhang, Honghong Luo, Lijian Liu, Hao Shen et al. "Improved GAN: Using a transformer module generator approach for material decomposition." Computers in biology and medicine 149 (2022): 105952.https://doi.org/10.1016/j.compbiomed.2022.105952 [doi]
4. Harvey, William, Saeid Naderiparizi, and Frank Wood. "Conditional image generation by conditioning variational auto-encoders." arXiv preprint arXiv:2102.12037 (2021).https://doi.org/10.48550/arXiv.2102.12037 [doi]
5. Hatamizadeh, Ali, Yucheng Tang, Vishwesh Nath, Dong Yang, Andriy Myronenko, Bennett Landman, Holger R. Roth, and Daguang Xu. "Unetr: Transformers for 3d medical image segmentation." In Proceedings of the IEEE/CVF winter conference on applications of computer vision, pp. 574-584. 2022.https://doi.org/10.48550/arXiv.2103.10504 [doi]
6. Mendes, José, Tania Pereira, Francisco Silva, Julieta Frade, Joana Morgado, Cláudia Freitas, Eduardo Negrão et al. "Lung CT image synthesis using GANs." Expert Systems with Applications 215 (2023): 119350.https://doi.org/10.1016/j.eswa.2022.119350 [doi]
7. Kazerouni, Amirhossein, Ehsan Khodapanah Aghdam, Moein Heidari, Reza Azad, Mohsen Fayyaz, Ilker Hacihaliloglu, and Dorit Merhof. "Diffusion models for medical image analysis: A comprehensive survey." arXiv preprint arXiv:2211.07804 (2022).https://doi.org/10.48550/arXiv.2211.07804 [doi]
8. Cho, Jihoon, Seunghyuck Park, and Jinah Park. "Two-stage approach for brain mr image synthesis: 2d image synthesis and 3d refinement." arXiv preprint arXiv:2410.10269 (2024).https://doi.org/10.48550/arXiv.2410.10269 [doi]
9. Fu, Jie, Yingli Yang, Kamal Singhrao, Dan Ruan, Fang‐I. Chu, Daniel A. Low, and John H. Lewis. "Deep learning approaches using 2D and 3D convolutional neural networks for generating male pelvic synthetic computed tomography from magnetic resonance imaging." Medical physics 46, no. 9 (2019): 3788-3798.https://doi.org/10.1002/mp.13672 [doi]
10. Hall, Peter. "On Kullback-Leibler loss and density estimation." The Annals of Statistics (1987): 1491-1519.http://www.jstor.org/stable/2241687.
11. Hore, Alain, and Djemel Ziou. "Image quality metrics: PSNR vs. SSIM." In 2010 20th international conference on pattern recognition, pp. 2366-2369. IEEE, 2010.https://doi.org/10.1109/ICPR.2010.579 [doi]

Cite this abstract

http://echo.ismrm.org/p/ISMRM2026/561-01-004