Awesome

This repository complements our survey paper Transformers in Medical Imaging: A Survey, published in Medical Image Analysis.

📢📢🏆🏆🏆 Spotlight: Our article is now among the Top-3 Most Downloaded Articles of the Medical Image Analysis Journal! 🏆🏆🏆

Authors: Fahad Shamshad, Salman Khan, Syed Waqas Zamir, Muhammad Haris Khan, Munawar Hayat, Fahad Shahbaz Khan, and Huazhu Fu

<hr />

`Awesome Transformers in Medical Imaging`

A curated list of awesome Transformers resources in medical imaging (in chronological order), inspired by the other awesome-initiatives. We intend to regularly update the relevant latest papers and their open-source implementations on this page.

We strongly encourage the researchers that want to promote their fantastic work to the community to make pull request to update their paper's information!

Survey

Transformers in Medical Imaging: A survey. [25th Jan., 2022] . Fahad Shamshad, Salman Khan, Syed Waqas Zamir, Muhammad Haris Khan, Munawar Hayat, Fahad Shahbaz Khan, and Huazhu Fu. [PDF]

Advances in Medical Image Analysis with Vision Transformers: A Comprehensive Review. [9th Jan., 2023]. Reza Azad, Amirhossein Kazerouni, Moein Heidari, Ehsan Khodapanah Aghdam, Amirali Molaei, Yiwei Jia, Abin Jose, Rijo Roy, Dorit Merhof [Paper]

Medical image analysis based on transformer: A Review. [13th Aug., 2022]. Zhaoshan Liu, Lei Shen. [PDF]

Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectives. [3rd June, 2022]. Jun Li, Junyu Chen, Yucheng Tang, Ce Wang, Bennett A. Landman, S. Kevin Zhou. [PDF]

Vision Transformers in Medical Computer Vision -- A Contemplative Retrospection. [29th March, 2022]. Arshi Parvaiz, Muhammad Anwaar Khalid, Rukhsana Zafar, Huma Ameer, Muhammad Ali, Muhammad Moazam Fraz. [PDF]

Transformers in Medical Image Analysis: A Review. [24th Feb., 2022]. Kelei He, Chen Gan, Zhuoyuan Li, Islem Rekik, Zihao Yin, Wen Ji, Yang Gao, Qian Wang, Junfeng Zhang, Dinggang Shen. [PDF]

Application of Transformer in Medical Image Segmentation. [25th Oct., 2021]. Wenyin Zhang, Weijie Hao, Yuan Qi and Yong Wu. [PDF]

Segmentation

Attention-Based Transformers for Instance Segmentation of Cells in Microstructures. [20th Nov., 2020] [BIBM, 2020]. Tim Prangemeier, Christoph Reich, Heinz Koeppl. [PDF] [Github]

TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation. [8th Feb., 2021]. Jieneng Chen, Yongyi Lu, Qihang Yu, Xiangde Luo, Ehsan Adeli, Yan Wang, Le Lu, Alan L. Yuille, Yuyin Zhou. [PDF] [Github]

TransFuse: Fusing Transformers and CNNs for Medical Image Segmentation. [16th Feb., 2021] [⚡MICCAI, 2021]. Yundong Zhang, Huiye Liu, Qiang Hu. [PDF] [Github]

Unsupervised Brain Anomaly Detection and Segmentation with Transformers. [23rd Feb., 2021] [MIDL, 2021]. Walter Hugo Lopez Pinaya, Petru-Daniel Tudosiu, Robert Gray, Geraint Rees, Parashkev Nachev, Sebastien Ourselin, M. Jorge Cardoso. [PDF]

Convolution-Free Medical Image Segmentation using Transformers. [26th Feb., 2021] [⚡MICCAI, 2021]. Davood Karimi, Serge Vasylechko, Ali Gholipour. [PDF]

CoTr: Efficiently Bridging CNN and Transformer for 3D Medical Image Segmentation. [4th March, 2021] [⚡MICCAI, 2021]. Yutong Xie, Jianpeng Zhang, Chunhua Shen, Yong Xia. [PDF] [Github]

SpecTr: Spectral Transformer for Hyperspectral Pathology Image Segmentation. [5th March, 2021]. Boxiang Yun, Yan Wang, Jieneng Chen, Huiyu Wang, Wei Shen, Qingli Li. [PDF] [Github]

TransBTS: Multimodal Brain Tumor Segmentation Using Transformer. [7th March, 2021] [⚡MICCAI, 2021]. Wenxuan Wang, Chen Chen, Meng Ding, Jiangyun Li, Hong Yu, Sen Zha. [PDF] [Github]

U-Net Transformer: Self and Cross Attention for Medical Image Segmentation. [10th March, 2021]. Olivier Petit, Nicolas Thome, Clément Rambour, Luc Soler. [PDF] [Github]

UNETR: Transformers for 3D Medical Image Segmentation . [18th March, 2021]. Ali Hatamizadeh, Yucheng Tang, Vishwesh Nath, Dong Yang, Andriy Myronenko, Bennett Landman, Holger Roth, Daguang Xu. [PDF] [Github]

Medical Transformer: Universal Brain Encoder for 3D MRI Analysis. [28th April, 2021]. Eunji Jun, Seungwoo Jeong, Da-Woon Heo, Heung-Il Suk. [PDF]

Pyramid Medical Transformer for Medical Image Segmentation . [29th April, 2021]. Zhuangzhuang Zhang, Baozhou Sun, Weixiong Zhang. [PDF]

GasHis-Transformer: A Multi-scale Visual Transformer Approach for Gastric Histopathology Image Classification. [29th April, 2021]. Haoyuan Chen, Chen Li, Xiaoyan Li, Ge Wang, Weiming Hu, Yixin Li, Wanli Liu, Changhao Sun, Yudong Yao, Yueyang Teng, Marcin Grzegorzek. [PDF]

Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationr. [12th May, 2021]. Hu Cao, Yueyue Wang, Joy Chen, Dongsheng Jiang, Xiaopeng Zhang, Qi Tian, Manning Wang. [PDF]

Medical Image Segmentation Using Squeeze-and-Expansion Transformers. [20th May, 2021] [⚡IJCAI, 2021]. Shaohua Li, Xiuchao Sui, Xiangde Luo, Xinxing Xu, Yong Liu, Rick Goh. [PDF] [Github]

A Multi-Branch Hybrid Transformer Network for Corneal Endothelial Cell Segmentation. [21st May, 2021] [⚡MICCAI, 2021]. Yinglin Zhang, Risa Higashita, Huazhu Fu, Yanwu Xu, Yang Zhang, Haofeng Liu, Jian Zhang, Jiang Liu. [PDF]

DS-TransUNet:Dual Swin Transformer U-Net for Medical Image Segmentation. [12 June, 2021]. Ailiang Lin, Bingzhi Chen, Jiayu Xu, Zheng Zhang, Guangming Lu. [PDF]

More than Encoder: Introducing Transformer Decoder to Upsample. [20th June, 2021]. Yijiang Li, Wentian Cai, Ying Gao, Xiping Hu. [PDF]

Multi-Compound Transformer for Accurate Biomedical Image Segmentation. [28th June, 2021] [⚡MICCAI, 2021]. Yuanfeng Ji, Ruimao Zhang, Huijie Wang, Zhen Li, Lingyun Wu, Shaoting Zhang, Ping Luo. [PDF] [Github]

UTNet: A Hybrid Transformer Architecture for Medical Image Segmentation. [2nd July, 2021] [⚡MICCAI, 2021]. Yunhe Gao, Mu Zhou, Dimitris Metaxas. [PDF] [Github]

Few-Shot Domain Adaptation with Polymorphic Transformers. [10th July, 2021] [⚡MICCAI, 2021]. Shaohua Li, Xiuchao Sui, Jie Fu, Huazhu Fu, Xiangde Luo, Yangqin Feng, Xinxing Xu, Yong Liu, Daniel Ting, Rick Siow Mong Goh. [PDF] [Github]

TransClaw U-Net: Claw U-Net with Transformers for Medical Image Segmentation. [12th July, 2021]. Yao Chang, Hu Menghan, Zhai Guangtao, Zhang Xiao-Ping. [PDF]

TransAttUnet: Multi-level Attention-guided U-Net with Transformer for Medical Image Segmentation. [12th July, 2021]. Bingzhi Chen, Yishu Liu, Zheng Zhang, Guangming Lu, David Zhang. [PDF]

LeViT-UNet: Make Faster Encoders with Transformer for Medical Image Segmentation. [19th July, 2021]. Guoping Xu, Xingrong Wu, Xuan Zhang, Xinwei He. [PDF] [Github]

Polyp-PVT: Polyp Segmentation with Pyramid Vision Transformers. [16th August, 2021]. Bo Dong, Wenhai Wang, Deng-Ping Fan, Jinpeng Li, Huazhu Fu, Ling Shao. [PDF] [Github]

Evaluating Transformer-based Semantic Segmentation Networks for Pathological Image Segmentation. [26th August, 2021]. Cam Nguyen, Zuhayr Asad, Yuankai Huo. [PDF]

Automated Kidney Tumor Segmentation with Convolution and Transformer Network. [30th August, 2021] [👍 MICCAI KiTS Challenge, 2021]. Zhiqiang Shen, Zhiqiang_Shen, Hua Yang, Zhen Zhang, Shaohua Zheng. [PDF]

nnFormer: Interleaved Transformer for Volumetric Segmentation. [7th Sep., 2021]. Hong-Yu Zhou, Jiansen Guo, Yinghao Zhang, Lequan Yu, Liansheng Wang, Yizhou Yu. [PDF] [Github]

UCTransNet: Rethinking the Skip Connections in U-Net from a Channel-wise Perspective with Transformer. [9th, Sep.,]. Haonan Wang, Peng Cao, Jiaqi Wang, Osmar R.Zaiane. [PDF] [Github]

MISSFormer: An Effective Medical Image Segmentation Transformer. [15th, Sep. 2021]. Xiaohong Huang, Zhifang Deng, Dandan Li, Xueguang Yuan. [PDF]

TransBridge: A Lightweight Transformer for Left Ventricle Segmentation in Echocardiography. [21st Sep., 2021] [👍 MICCAI Simplifying Medical Ultrasound Workshop, 2021]. Kaizhong DengYanda MengDongxu GaoJoshua BridgeYaochun ShenGregory LipYitian ZhaoYalin Zheng. [PDF]

BiTr-Unet: a CNN-Transformer Combined Network for MRI Brain Tumor Segmentation. [25th Sep., 2021] [👍 MICCAI BraTS DREAM Challenge ShuLab, 2021]. Qiran Jia, Hai Shu. [PDF]

GT U-Net: A U-Net Like Group Transformer Network for Tooth Root Segmentation . [30th Sep., 2021] [👍 MICCAI MLMI Workshop, 2021]. Yunxiang Li, Shuai Wang, Jun Wang, Guodong Zeng, Wenjun Liu, Qianni Zhang, Qun Jin, Yaqi Wang. [PDF] [Github]

Transformer Assisted Convolutional Network for Cell Instance Segmentation. [5th Oct., 2021] [👍 ISBI Workshop, 2021]. Deepanshu Pandey, Pradyumna Gupta, Sumit Bhattacharya, Aman Sinha, Rohit Agarwal. [PDF] [Github]

Boundary-aware Transformers for Skin Lesion Segmentation. [8th Oct., 2021] [⚡MICCAI, 2021]. Jiacheng Wang, Lan Wei, Liansheng Wang, Qichao Zhou, Lei Zhu, Jing Qin. [PDF] [Github]

Spine-transformers: Vertebra labeling and segmentation in arbitrary field-of-view spine CTs via 3D transformers. [10th Oct., 2021] [⚡MIA, 2021]. Rong Taoa, Wenyong Liub, Guoyan Zheng. [PDF]

AFTer-UNet: Axial Fusion Transformer UNet for Medical Image Segmentation. [20th Oct., 2021]. Xiangyi Yan, Hao Tang, Shanlin Sun, Haoyu Ma, Deying Kong, Xiaohui Xie. [PDF]

Hepatic vessel segmentation based on 3D swin-transformer with inductive biased multi-head self-attention. [5th Nov., 2021]. Mian Wu, Yinling Qian, Xiangyun Liao, Qiong Wang, Pheng-Ann Heng. [PDF]

Mixed Transformer U-Net For Medical Image Segmentation. [8th, Nov. 2021]. Hongyi Wang, Shiao Xie, Lanfen Lin, Yutaro Iwamoto, Xian-Hua Han, Yen-Wei Chen, Ruofeng Tong. [PDF] [Github]

T-AutoML: Automated Machine Learning for Lesion Segmentation using Transformers in 3D Medical Imaging. [15th Nov., 2021] [⚡ICCV, 2021]. Dong Yang, Andriy Myronenko, Xiaosong Wang, Ziyue Xu, Holger R. Roth, Daguang Xu. [PDF]

A Volumetric Transformer for Accurate 3D Tumor Segmentation. [26th Nov., 2021]. Himashi Peiris, Munawar Hayat, Zhaolin Chen, Gary Egan, Mehrtash Harandi. [PDF] [Github]

Exploiting full Resolution Feature Context for Liver Tumor and Vessel Segmentation via Fusion Encoder: Application to Liver Tumor and Vessel 3D reconstruction. [26th Nov., 2021]. Xiangyu Meng, Xudong Zhang, Gan Wang, Ying Zhang, Xin Shi, Huanhuan Dai, Zixuan Wang, Xun Wang. [PDF]

Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysis. [29th Nov., 2021]. Yucheng Tang, Dong Yang, Wenqi Li, Holger Roth, Bennett Landman, Daguang Xu, Vishwesh Nath, Ali Hatamizadeh. [PDF] [Github]

MT-TransUNet: Mediating Multi-Task Tokens in Transformers for Skin Lesion Segmentation and Classification. [3rd Dec., 2021]. Jingye Chen, Jieneng Chen, Zongwei Zhou, Bin Li, Alan Yuille, Yongyi Lu. [PDF] [Github]

FAT-Net: Feature Adaptive Transformers for Automated Skin Lesion Segmentation. [4th Dec., 2021] [⚡MIA, 2021]. Huisi Wu, Shihuai Chen, Guilian Chen, Wei Wang, Baiying Lei, Zhenkun Wen. [PDF] [Github]

Semi-Supervised Medical Image Segmentation via Cross Teaching between CNN and Transformer. [9th Dec., 2021]. Xiangde Luo, Minhao Hu, Tao Song, Guotai Wang, Shaoting Zhang. [PDF] [Github]

D-Former: A U-shaped Dilated Transformer for 3D Medical Image Segmentation. [3rd Jan., 2022]. Yixuan Wu, Kuanlun Liao, Jintai Chen, Jinhong Wang, Danny Z. Chen, Honghao Gao, Jian Wu. [PDF]

Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Images. [4th Jan., 2022]. Ali Hatamizadeh, Vishwesh Nath, Yucheng Tang, Dong Yang, Holger Roth, Daguang Xu. [PDF] [Github]

HT-Net: hierarchical context-attention transformer network for medical ct image segmentation. [15th Jan., 2022]. Mingjun Ma, Haiying Xia, Yumei Tan, Haisheng Li, Shuxiang Song . [PDF]

SegTransVAE: Hybrid CNN - Transformer with Regularization for medical image segmentation. [21st Jan., 2022]. Quan-Dung Pham, Hai Nguyen-Truong, Nam Nguyen Phuong, Khoa N. A. Nguyen. [PDF] [Github]

Class-Aware Generative Adversarial Transformers for Medical Image Segmentation. [26th Jan., 2022]. Chenyu You, Ruihan Zhao, Fenglin Liu, Sandeep Chinchali, Ufuk Topcu, Lawrence Staib, James S. Duncan. [PDF]

RTNet: Relation Transformer Network for Diabetic Retinopathy Multi-lesion Segmentation. [26th Jan., 2022] [⚡IEEE TMI, 2022].. Shiqi Huang, Jianan Li, Yuze Xiao, Ning Shen, Tingfa Xu. [PDF]

Joint Liver and Hepatic Lesion Segmentation using a Hybrid CNN with Transformer Layers. [26th Jan., 2022]. Georg Hille, Shubham Agrawal, Christian Wybranski, Maciej Pech, Alexey Surov, Sylvia Saalfeld. [PDF]

Multi-scale boundary neural network for gastric tumor segmentation. [28th Jan., 2022]. Pengfei Wang, Yunqi Li, Yaru Sun, Dongzhi He & Zhiqiang Wang. [PDF]

TransBTSV2: Wider Instead of Deeper Transformer for Medical Image Segmentation. [30th Jan., 2022]. Jiangyun Li, Wenxuan Wang, Chen Chen, Tianxiang Zhang, Sen Zha, Hong Yu, Jing Wang. [PDF] [Github]

TraSeTR: Track-to-Segment Transformer with Contrastive Query for Instance-level Instrument Segmentation in Robotic Surgery. [30th Jan., 2022]. Zixu Zhao, Yueming Jin, Pheng-Ann Heng. [PDF]

A Multi-scale Transformer for Medical Image Segmentation: Architectures, Model Efficiency, and Benchmarks. [28th Feb., 2022]. Yunhe Gao, Mu Zhou, Di Liu, Dimitris Metaxas. [PDF] [Github]

Tempera: Spatial Transformer Feature Pyramid Network for Cardiac MRI Segmentation. [1st March, 2022]. Christoforos Galazis, Huiyi Wu, Zhuoyu Li, Camille Petri, Anil A. Bharath, Marta Varela. [PDF]

Contextual Attention Network: Transformer Meets U-Net. [2nd March, 2022]. Azad Reza, Heidari Moein, Wu Yuli, Merhof Dorit. [PDF] [Github]

Simulation-Driven Training of Vision Transformers Enabling Metal Segmentation in X-Ray Images. [17th March, 2022]. Fuxin Fan, Ludwig Ritschl, Marcel Beister, Ramyar Biniazan, Björn Kreher, Tristan M. Gottschalk, Steffen Kappler, Andreas Maier. [PDF]

TransFusion: Multi-view Divergent Fusion for Medical Image Segmentation with Transformers. [21st March, 2022]. Di Liu, Yunhe Gao, Qilong Zhangli, Zhennan Yan, Mu Zhou, Dimitris Metaxas. [PDF]

CAT-Net: A Cross-Slice Attention Transformer Model for Prostate Zonal Segmentation in MRI. [29th March, 2022]. Alex Ling Yu Hung, Haoxin Zheng, Qi Miao, Steven S. Raman, Demetri Terzopoulos, Kyunghyun Sung. [PDF]

UNetFormer: A Unified Vision Transformer Model and Pre-Training Framework for 3D Medical Image Segmentation. [1st April, 2022]. Ali Hatamizadeh, Ziyue Xu, Dong Yang, Wenqi Li, Holger Roth, Daguang Xu. [PDF] [Github]

CCAT-NET: A Novel Transformer Based Semi-supervised Framework for Covid-19 Lung Lesion Segmentation. [6th April, 2022]. Mingyang Liu, Li Xiao, Huiqin Jiang, Qing He. [PDF]

Continual Hippocampus Segmentation with Transformers. [17th April, 2022]. Amin Ranem, Camila González, Anirban Mukhopadhyay. [PDF]

TranSiam: Fusing Multimodal Visual Features Using Transformer for Medical Image Segmentation. [26th April, 2022]. Xuejian Li, Shiqiang Ma, Jijun Tang, Fei Guo. [PDF]

ColonFormer: An Efficient Transformer based Method for Colon Polyp Segmentation. [17th May, 2022]. Nguyen Thanh Duc, Nguyen Thi Oanh, Nguyen Thi Thuy, Tran Minh Triet, Dinh Viet Sang. [PDF]

Transformer based multiple instance learning for weakly supervised histopathology image segmentation. [18th May, 2022]. Ziniu Qian, Kailu Li, Maode Lai, Eric I-Chao Chang, Bingzheng Wei, Yubo Fan, Yan Xu. [PDF]

Transformer based Generative Adversarial Network for Liver Segmentation. [21st May, 2022]. Ugur Demir, Zheyuan Zhang, Bin Wang, Matthew Antalek, Elif Keles, Debesh Jha, Amir Borhani, Daniela Ladner, Ulas Bagci. [PDF][Github]

An uncertainty-aware transformer for MRI cardiac semantic segmentation via mean teachers. [25th Jul, 2022] [MIUA, 2022]. Ziyang Wang, Jian-Qing Zheng, Irina Voiculescu. [PDF][Github]

Computationally-Efficient Vision Transformer for Medical Image Semantic Segmentation via Dual Pseudo-Label Supervision. [16th Oct, 2022] [ICIP, 2022]. Ziyang Wang, Nanqing Dong, Irina Voiculescu. [PDF][Github]

Adversarial Vision Transformer for Medical Image Semantic Segmentation with Limited Annotations. [21st Nov, 2022] [BMVC, 2022]. Ziyang Wang, Chengkuan Zhao, Zixuan Ni. [PDF][Github]

DuAT: Dual-Aggregation Transformer Network for Medical Image Segmentation. [21st Dec., 2022]. Feilong Tang, Qiming Huang, Jinfeng Wang, Xianxu Hou, Jionglong Su, Jingxin Liu. [PDF]

When cnn meet with vit: Towards semi-supervised learning for multi-class medical image semantic segmentation. [12th Feb., 2023] [ECCV Workshop, 2022]. Ziyang Wang, Tianze Li, Jian-Qing Zheng, Baoru Huang. [PDF][Github]

DAE-Former: Dual Attention-guided Efficient Transformer for Medical Image Segmentation. [27th Jan., 2023]. Reza Azad, René Arimond, Ehsan Khodapanah Aghdam, Amirhossein Kazerouni, Dorit Merhof. [PDF][Github]

Classification

TransMed: Transformers Advance Multi-modal Medical Image Classification. [10th March, 2021]. Yin Dai, Yifan Gao. [PDF]

Medical Transformer: Universal Brain Encoder for 3D MRI Analysis. [28th April, 2021]. Eunji Jun, Seungwoo Jeong, Da-Woon Heo, Heung-Il Suk. [PDF]

TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classification. [2nd June, 2021] [⚡NeurIPS, 2021]. Zhuchen Shao, Hao Bian, Yang Chen, Yifeng Wang, Jian Zhang, Xiangyang Ji, Yongbing Zhang. [PDF] [Github]

Vision Transformer-based recognition of diabetic retinopathy grade. [15 July, 2021] [⚡CVPR, 2021]. Rui Sun, Yihao Li, Tianzhu Zhang, Zhendong Mao, Feng Wu, Yongdong Zhang. [PDF]

Is it Time to Replace CNNs with Transformers for Medical Images? [20th Aug., 2021] [👍ICCV Workshop of Automated Medical Diagnosis, 2021]. Christos Matsoukas, Johan Fredin Haslum, Magnus Söderberg, Kevin Smith. [PDF] [Github]

Gene Transformer: Transformers for the Gene Expression-based Classification of Lung Cancer Subtypes [26th Aug., 2021]. Anwar Khan, Boreom Lee. [PDF]

A transformer-based deep learning approach for classifying brain metastases into primary organ sites using clinical whole brain MRI. [7th Oct., 2021]. Qing Lyu, Sanjeev V. Namjoshi, Emory McTyre, Umit Topaloglu, Richard Barcus, Michael D. Chan, Christina K. Cramer, Waldemar Debinski, Metin N. Gurcan, Glenn J. Lesser, Hui-Kuan Lin, Reginald F. Munden, Boris C. Pasche, Kiran Kumar Solingapuram Sai, Roy E. Strowd, Stephen B. Tatter, Kounosuke Watabe, Wei Zhang, Ge Wang, Christopher T. Whitlow. [PDF]

CAE-Transformer: Transformer-based Model to Predict Invasiveness of Lung Adenocarcinoma Subsolid Nodules from Non-thin Section 3D CT Scans. [17th Oct., 2021]. Shahin Heidarian, Parnian Afshar, Anastasia Oikonomou, Konstantinos N. Plataniotis, Arash Mohammadi. [PDF]

Vision Transformer-based recognition of diabetic retinopathy grade. [25th Oct., 2021]. Jianfang Wu, Ruo Hu, Zhenghong Xiao, Jiaxu Chen, Jingwei Liu. [PDF]

VISION TRANSFORMERS FOR CLASSIFICATION OF BREAST ULTRASOUND IMAGES. [27th Oct., 2021]. Behnaz Gheflati, Hassan Rivaz. [PDF]

Indication as Prior Knowledge for Multimodal Disease Classification in Chest Radiographs with Transformers [12th Feb., 2022] [👍ISBI, 2022]. Grzegorz Jacenków, Alison Q. O'Neil, Sotirios A. Tsaftaris. [PDF] [Github]

AI can evolve without labels: self-evolving vision transformer for chest X-ray diagnosis through knowledge distillation. [13th Feb., 2022]. Sangjoon Park, Gwanghyun Kim, Yujin Oh, Joon Beom Seo, Sang Min Lee, Jin Hwan Kim, Sungjun Moon, Jae-Kwang Lim, Chang Min Park, Jong Chul Ye. [PDF]

ScoreNet: Learning Non-Uniform Attention and Augmentation for Transformer-Based Histopathological Image Classification. [15th Feb., 2022]. Thomas Stegmüller, Antoine Spahr, Behzad Bozorgtabar, Jean-Philippe Thiran. [PDF]

A hybrid 2-stage vision transformer for AI-assisted 5 class pathologic diagnosis of gastric endoscopic biopsies. [17th Feb., 2022]. Yujin Oh, Go Eun Bae, Kyung-Hee Kim, Min-Kyung Yeo, Jong Chul Ye. [PDF]

RadioTransformer: A Cascaded Global-Focal Transformer for Visual Attention-guided Disease Classification. [23rd Feb., 2022]. Moinak Bhattacharya, Shubham Jain, Prateek Prasanna. [PDF]

Uni4Eye: Unified 2D and 3D Self-supervised Pre-training via Masked Image Modeling Transformer for Ophthalmic Image Classification. [9th March, 2022]. Zhiyuan Cai, Li Lin, Huaqing He, Xiaoying Tang. [PDF]

Noise-reducing attention cross fusion learning transformer for histological image classification of osteosarcoma. [29th April, 2022]. Liangrui Pan, Hetian Wang, Lian Wang, Boya Ji, Mingting Liu, Mitchai Chongcheawchamnan, Jin Yuan, Shaoliang Peng. [PDF]

HoVer-Trans: Anatomy-aware HoVer-Transformer for ROI-free Breast Cancer Diagnosis in Ultrasound Images. [17th May, 2022]. Yuhao Mo, Chu Han, Yu Liu, Min Liu, Zhenwei Shi, Jiatai Lin, Bingchao Zhao, Chunwang Huang, Bingjiang Qiu, Yanfen Cui, Lei Wu, Xipeng Pan, Zeyan Xu, Xiaomei Huang, Zaiyi Liu, Ying Wang, Changhong Liang. [PDF]

A graph-transformer for whole slide image classification [19th May, 2022]. Yi Zheng, Rushin H. Gindra, Emily J. Green, Eric J. Burks, Margrit Betke, Jennifer E. Beane, Vijaya B. Kolachalama. [PDF] [Github]

A Comparative Study of Gastric Histopathology Sub-size Image Classification: from Linear Regression to Visual Transformer [19th May, 2022]. Weiming Hu, Haoyuan Chen, Wanli Liu, Xiaoyan Li, Hongzan Sun, Xinyu Huang, Marcin Grzegorzek, Chen Li. [PDF]

Zero-Shot and Few-Shot Learning for Lung Cancer Multi-Label Classification using Vision Transformer [30th May, 2022]. Fu-Ming Guo, Yingfang Fan. [PDF]

Detecting Severity of Diabetic Retinopathy from Fundus Images using Ensembled Transformers [3rd Jan, 2023]. Chandranath Adak, Tejas Karkera, Soumi Chattopadhyay, Muhammad Saqib. [PDF]

Classification COVID19 (Separate section due to its current significance)

Vision Transformer for COVID-19 CXR Diagnosis using Chest X-ray Feature Corpus. [12th March, 2021]. Sangjoon Park, Gwanghyun Kim, Yujin Oh, Joon Beom Seo, Sang Min Lee, Jin Hwan Kim, Sungjun Moon, Jae-Kwang Lim, Jong Chul Ye. [PDF]

Vision Transformer using Low-level Chest X-ray Feature Corpus for COVID-19 Diagnosis and Severity Quantification. [15th April, 2021]. Sangjoon Park, Gwanghyun Kim, Yujin Oh, Joon Beom Seo, Sang Min Lee, Jin Hwan Kim, Sungjun Moon, Jae-Kwang Lim, Jong Chul Ye. [PDF]

POCFormer: A Lightweight Transformer Architecture for Detection of COVID-19 Using Point of Care Ultrasound. [15th May, 2021]. Shehan Perera, Srikar Adhikari, Alper Yilmaz. [PDF]

Automatic Diagnosis of COVID-19 Using a tailored Transformer-Like Network. [20th May, 2021]. Chengeng Liu1, Qingshan Yin. [PDF]

COVID-VIT: Classification of COVID-19 from CT chest images based on vision transformer models. [4th July, 2021]. Xiaohong Gao, Yu Qian, Alice Gao. [PDF] [Github]

xViTCOS: Explainable Vision Transformer Based COVID-19 Screening Using Radiography . [6th July, 2021]. Arnab Kumar MondalArnab Kumar Mondal, Arnab Bhattacharjee, Parag Singla, Prathosh AP. [PDF]

Visual Transformer with Statistical Test for COVID-19 Classification. [12th July, 2021] [👍ICCV MIA Workshop, 2021]. Chih-Chung Hsu, Guan-Lin Chen, Mei-Hsuan Wu. [PDF]

MIA-COV19D: A transformer-based framework for COVID19 classification in chest CTs. [15th July, 2021] [👍ICCV MIA Workshop, 2021]. Lei Zhang, Yan Wen. [PDF]

COViT-GAN: Vision Transformer forCOVID-19 Detection in CT images. [10th August, 2021]. Ara Abigail E. Ambita, Eujene Nikka V. Boquio, Prospero C. Naval Jr. [PDF]

COVID-Transformer: Interpretable COVID-19 Detection Using Vision Transformer for Healthcare. [23rd Sep., 2021]. Debaditya Shome, T Kar, Sachi Nandan Mohanty, Prayag Tiwari, Khan Muhammad, Abdullah AlTameem, Yazhou Zhang, Abdul Khader Jilani Saudagar. [PDF]

Vision Transformer based COVID-19 Detection using Chest X-rays. [9th Oct., 2021]. Koushik Sivarama Krishnan, Karthik Sivarama Krishnan. [PDF]

COVID-19 Detection in Chest X-ray Images Using Swin-Transformer and Transformer in Transformer. [16th Oct., 2021]. Juntao Jiang, Shuyi Lin. [PDF]

Federated Split Vision Transformer for COVID-19 CXR Diagnosis using Task-Agnostic Training. [2nd Nov., 2021] [⚡NeurIPS, 2021]. Sangjoon Park, Gwanghyun Kim, Jeongsol Kim, Boah Kim, Jong Chul Ye. [PDF]

Multi-task vision transformer using low-level chest X-ray feature corpus for COVID-19 diagnosis and severity quantification. [4th Nov., 2021] [⚡MIA, 2021]. Sangjoon Parka, Gwanghyun Kima,Yujin Oha, Joon Beom Seo, Sang Min Lee, Jin Hwan Kimc,Sungjun Moond, Jae-Kwang Lime, Jong Chul Ye. [PDF]

COVID-19 CT Image Recognition Algorithm Based on Transformer and CNN. [24th Jan., 2022]. Xiaole Fan, Xiufang Feng, Yunyun Dong, Huichao Hou. [PDF]

Reconstruction

TransCT: Dual-path Transformer for Low Dose Computed Tomography. [28th Feb., 2021] [⚡MICCAI, 2021]. Zhicheng Zhang, Lequan Yu, Xiaokun Liang, Wei Zhao, Lei Xing. [PDF] [Github]

Unsupervised MRI Reconstruction via Zero-Shot Learned Adversarial Transformers. [15th May, 2021]. Yilmaz Korkmaz, Salman UH Dar, Mahmut Yurt, Muzaffer Özbey, Tolga Çukur. [PDF] [Github]

TED-net: Convolution-free T2T Vision Transformer-based Encoder-decoder Dilation network for Low-dose CT Denoising. [8th June, 2021]. Dayang Wang, Zhan Wu, Hengyong Yu. [PDF]

Task Transformer Network for Joint MRI Reconstruction and Super-Resolution. [12th June, 2021] [⚡MICCAI, 2021]. Chun-Mei Feng, Yunlu Yan, Huazhu Fu, Li Chen, Yong Xu. [PDF] [Github]

Accelerated Multi-Modal MR Imaging with Transformers. [27th June, 2021]. Chun-Mei Feng, Yunlu Yan, Geng Chen, Huazhu Fu, Yong Xu, Ling Shao. [PDF] [Github]

E-DSSR: Efficient Dynamic Surgical Scene Reconstruction with Transformer-based Stereoscopic Depth Perception. [1st July, 2021] [⚡MICCAI, 2021]. Yonghao Long, Zhaoshuo Li, Chi Hang Yee, Chi Fai Ng, Russell H. Taylor, Mathias Unberath, Qi Dou. [PDF]

Eformer: Edge Enhancement based Transformer for Medical Image Denoising. [16th Sep., 2021] [👍ICCV Workshop, 2021]. Achleshwar Luthra, Harsh Sulakhe, Tanish Mittal, Abhishek Iyer, Santosh Yadav. [PDF]

Transformer-Unet: Raw Image Processing with Unet. [17th Sep., 2021]. Youyang Sha, Yonghong Zhang, Xuquan Ji, Lei Hu. [PDF]

Deep MRI Reconstruction with Generative Vision Transformers . [25th Sep., 2021]. Yilmaz KorkmazMahmut Yurt, Salman Ul Hassan Dar, Muzaffer Özbey, Tolga Cukur. [PDF] [Github]

3D Transformer-GAN for High-quality PET Reconstruction. [29th Sep., 2021] [⚡MICCAI, 2021]. Yanmei Luo, Yan Wang, Chen Zu, Bo Zhan, Xi Wu, Jiliu Zhou, Dinggang Shen, Luping Zhou. [PDF]

TranSMS: Transformers for Super-Resolution Calibration in Magnetic Particle Imaging. [3rd Nov., 2021] . Alper Güngör, Baris Askin, Damla Alptekin Soydan, Emine Ulku Saritas, Can Barış Top, Tolga Çukur. [PDF]

DuDoTrans: Dual-Domain Transformer Provides More Attention for Sinogram Restoration in Sparse-View CT Reconstruction. [21st Nov., 2021] . Ce Wang, Kun Shang, Haimiao Zhang, Qian Li, Yuan Hui, S. Kevin Zhou. [PDF]

Self-supervised CT super-resolution with hybrid model. [23rd Nov., 2021] . Zhicheng Zhang, Shaode Yu, Wenjian Qin, Xiaokun Liang, Yaoqin Xie, Guohua Cao. [PDF]

MIST-net: Multi-domain Integrative Swin Transformer network for Sparse-View CT Reconstruction. [29th Nov., 2021] . Jiayi Pan, Weiwen Wu, Zhifan Gao, Heye Zhang. [PDF]

ReconFormer: Accelerated MRI Reconstruction Using Recurrent Transformer. [23rd Jan., 2022] . Pengfei Guo, Yiqun Mei, Jinyuan Zhou, Shanshan Jiang, Vishal M. Patel. [PDF][Github]

DSFormer: A Dual-domain Self-supervised Transformer for Accelerated Multi-contrast MRI Reconstruction. [26th Jan., 2022] . Bo Zhou, Jo Schlemper, Neel Dey, Seyed Sadegh Mohseni Salehi, Chi Liu, James S. Duncan, Michal Sofka. [PDF]

CTformer: Convolution-free Token2Token Dilated Vision Transformer for Low-dose CT Denoising. [28th Feb., 2022] . Dayang Wang, Fenglei Fan, Zhan Wu, Rui Liu, Fei Wang, Hengyong Yu. [PDF][Github]

Adaptively Re-weighting Multi-Loss Untrained Transformer for Sparse-View Cone-Beam CT Reconstruction. [23rd March, 2022] . Minghui Wu, Yangdi Xu, Yingying Xu, Guangwei Wu, Qingqing Chen, Hongxiang Lin. [PDF]

Transformer-empowered Multi-scale Contextual Matching and Aggregation for Multi-contrast MRI Super-resolution. [26th March, 2022] . Guangyuan Li, Jun Lv, Yapeng Tian, Qi Dou, Chengyan Wang, Chenliang Xu, Jing Qin. [PDF]

Cross-Modality High-Frequency Transformer for MR Image Super-Resolution. [29th March, 2022] . Chaowei Fang, Dingwen Zhang, Liang Wang, Yulun Zhang, Lechao Cheng, Junwei Han. [PDF]

Data and Physics Driven Learning Models for Fast MRI -- Fundamentals and Methodologies from CNN, GAN to Attention and Transformers. [1st April, 2022] . Jiahao Huang, Yingying Fang, Yang Nan, Huanjun Wu, Yinzhe Wu, Zhifan Gao, Yang Li, Zidong Wang, Pietro Lio, Daniel Rueckert, Yonina C. Eldar, Guang Yang. [PDF]

Low-Dose CT Denoising via Sinogram Inner-Structure Transformer. [7th April, 2022] . Liutao Yang, Zhongnian Li, Rongjun Ge, Junyong Zhao, Haipeng Si, Daoqiang Zhang. [PDF]

Masked Co-attentional Transformer reconstructs 100x ultra-fast/low-dose whole-body PET from longitudinal images and anatomically guided MRI. [9th May, 2022] . Yan-Ran Wang, Liangqiong Qu, Natasha Diba Sheybani, Xiaolong Luo, Jiangshan Wang, Kristina Elizabeth Hawk, Ashok Joseph Theruvath, Sergios Gatidis, Xuerong Xiao, Allison Pribnow, Daniel Rubin, Heike E. Daldrup-Link. [PDF]

**Transformer and GAN Based Super-Resolution Reconstruction Network for Medical Images.** [26th Dec., 2022] .<br>

Weizhi Du, Harvery Tian. [PDF]

Registration

ViT-V-Net: Vision Transformer for Unsupervised Volumetric Medical Image Registration. [13th April, 2021] [👍MIDL Short Paper, 2021]. Junyu Chen, Yufan He, Eric C. Frey, Ye Li, Yong Du. [PDF] [Github]

Attention for Image Registration (AiR): an unsupervised Transformer approach. [5th May, 2021]. Zihao Wang, Hervé Delingette. [PDF]

Learning Dual Transformer Network for Diffeomorphic Registration. [21st Sep., 2021] [⚡MICCAI, 2021]. Yungeng Zhang, Yuru Pei, Hongbin Zha. [PDF]

TransMorph: Transformer for unsupervised medical image registration. [19th Nov., 2021]. Junyu Chen, Yong Du, Yufan He, William P. Segars, Ye Li, Eric C. Frey. [PDF] [Github]

A Transformer-based Network for Deformable Medical Image Registration. [24th Feb., 2022]. Yibo Wang, Wen Qian, Xuming Zhang. [PDF]

Affine Medical Image Registration with Coarse-to-Fine Vision Transformer. [29th March, 2022]. Tony C. W. Mok, Albert C. S. Chung. [PDF] [Github]

Synthesis

VTGAN: Semi-supervised Retinal Image Synthesis and Disease Prediction using Vision Transformers. [14th April, 2021] [👍ICCV Workshop on Computer Vision for Automated Medical Diagnosi, 2021]. Sharif Amit Kamran, Khondker Fariha Hossain, Alireza Tavakkoli, Stewart Lee Zuckerbrod, Salah A. Baker. [PDF] [Github]

PTNet: A High-Resolution Infant MRI Synthesizer Based on Transformer. [28th May, 2021]. Xuzhe Zhang, Xinzi He, Jia Guo, Nabil Ettehadi, Natalie Aw, David Semanek, Jonathan Posner, Andrew Laine, Yun Wang. [PDF] [Github]

ResViT: Residual vision transformers for multi-modal medical image synthesis. [30th June, 2021]. Onat Dalmaz, Mahmut Yurt, Tolga Çukur. [PDF] [Github]

CyTran: Cycle-Consistent Transformers for Non-Contrast to Contrast CT Translation. [12th Oct., 2021]. Nicolae-Catalin Ristea, Andreea-Iuliana Miron, Olivian Savencu, Mariana-Iuliana Georgescu, Nicolae Verga, Fahad Shahbaz Khan, Radu Tudor Ionescu. [PDF] [Github]

One Model to Synthesize Them All: Multi-contrast Multi-scale Transformer for Missing Data Imputation. [28th April, 2022]. Jiang Liu, Srivathsa Pasumarthi, Ben Duffy, Enhao Gong, Greg Zaharchuk, Keshav Datta. [PDF]

Detection

COTR: Convolution in Transformer Network for End to End Polyp Detection. [23rd May, 2021]. Zhiqiang Shen, Chaonan Lin, Shaohua Zheng. [PDF]

Transformer for Polyp Detection. [14th Oct., 2021]. Shijie Liu, Hongyu Zhou, Xiaozhou Shi, Junwen Pan. [PDF]

Lymph Node Detection in T2 MRI with Transformers. [9th Nov., 2021]. Tejas Sudharshan Mathai, Sungwon Lee, Daniel C. Elton, Thomas C. Shen, Yifan Peng, Zhiyong Lu, Ronald M. Summers. [PDF]

SATr: Slice Attention with Transformer for Universal Lesion Detection. [13th March, 2022]. Han Li, Long Chen, Hu Han, S. Kevin Zhou. [PDF]

Contrastive Transformer-based Multiple Instance Learning for Weakly Supervised Polyp Frame Detection. [13th March, 2022]. Yu Tian, Guansong Pang, Fengbei Liu, Yuyuan Liu, Chong Wang, Yuanhong Chen, Johan W Verjans, Gustavo Carneiro. [PDF]

Unsupervised Contrastive Learning based Transformer for Lung Nodule Detection. [30th April, 2022]. Chuang Niu, Ge Wang. [PDF]

SwinFPN: Leveraging Vision Transformers for 3D Organs-At-Risk Detection. [9th May, 2022] [MIDL Short Paper, 2022]. Bastian Wittmann, Suprosanna Shit, Fernando Navarro, Jan C. Peeken, Stephanie E. Combs, Bjoern Menze. [PDF] [Github]

An Effective Transformer-based Solution for RSNA Intracranial Hemorrhage Detection Competition. [16th May, 2022]. Fangxin Shang, Siqi Wang, Xiaorong Wang, Yehui Yang. [PDF] [Github]

Focused Decoding Enables 3D Anatomical Detection by Transformers. [27th February, 2023] [MELBA, 2023]. Bastian Wittmann, Fernando Navarro, Suprosanna Shit, Bjoern Menze. [PDF] [Github]

Clinical-Report-Generation

Reinforced Transformer for Medical Image Captioning. [10th Oct., 2019].[MLMI, 2019] Yuxuan Xiong, Bo Du, Pingkun Yan. [PDF]

Improving Factual Completeness and Consistency of Image-to-Text Radiology Report Generation. [20th Oct., 2020].[NAACL, 2020] Yasuhide Miura, Yuhao Zhang, Emily Bao Tsai, Curtis P. Langlotz, Dan Jurafsky. [PDF] [Github]

Generating Radiology Reports via Memory-driven Transformer. [30th Oct., 2020].[EMNLP, 2020] Zhihong Chen, Yan Song, Tsung-Hui Chang, Xiang Wan. [PDF] [Github]

Hierarchical X-Ray Report Generation via Pathology tags and Multi Head Attention. [30th Nov., 2020].[EMNLP, 2020] Preethi Srinivasan, Daksh Thapar, Arnav Bhavsar, Aditya Nigam. [PDF]

Learning Domain Adaptation with Model Calibration for Surgical Report Generation in Robotic Surgery. [31st March, 2021].[⚡ICRA, 2021] Mengya Xu, Mobarakol Islam, Chwee Ming Lim, Hongliang Ren. [PDF] [Github]

Confidence-Guided Radiology Report Generation. [21st June, 2021].[⚡MICCAI, 2021] Yixin Wang, Zihao Lin, Jiang Tian, Zhongchao Shi, Yang Zhang, Jianping Fan, Zhiqiang He. [PDF]

Exploring and Distilling Posterior and Prior Knowledge for Radiology Report Generation. [13th June, 2021].[⚡CVPR, 2021] Fenglin Liu, Xian Wu, Shen Ge, Wei Fan, Yuexian Zou. [PDF]

RATCHET: Medical Transformer for Chest X-ray Diagnosis and Reporting. [5th July, 2021].[⚡MICCAI, 2021] Benjamin Hou, Georgios Kaissis, Ronald Summers, Bernhard Kainz. [PDF] [Github]

Surgical Instruction Generation with Transformers. [14th July, 2021].[⚡MICCAI, 2021] Jinglu Zhang, Yinyu Nie, Jian Chang, Jian Jun Zhang. [PDF]

Class-Incremental Domain Adaptation with Smoothing and Calibration for Surgical Report Generation. [23rd July, 2021].[⚡MICCAI, 2021] Mengya Xu, Mobarakol Islam, Chwee Ming Lim, Hongliang Ren. [PDF] [Github]

Automated Generation of Accurate and Fluent Medical X-ray Reports. [27th Aug., 2021].[EMNLP, 2021] Hoang T.N. Nguyen, Dong Nie, Taivanbat Badamdorj, Yujie Liu, Yingying Zhu, Jason Truong, Li Cheng. [PDF] [Github]

AlignTransformer: Hierarchical Alignment of Visual Regions and Disease Tags for Medical Report Generation. [1st Sep., 2021].[⚡MICCAI, 2021] Di You, Fenglin Liu, Shen Ge, Xiaoxia Xie, Jing Zhang, Xian Wu. [PDF]

Automatic Generation of Chest X-ray Reports Using a Transformer-based Deep Learning Model. [20th Oct., 2021].[ICDS, 2021] Ayoub Benali Amjoud; Mustapha Amrouch. [PDF]

FFA-IR: Towards an Explainable and Reliable Medical Report Generation Benchmark. [31st Oct., 2021].[⚡NeurIPS, 2021] Mingjie Li, Wenjia Cai, Rui Liu, Yuetian Weng, Xiaoyun Zhao, Cong Wang, Xin Chen, Zhong Liu, Caineng Pan, Mengke Li, yingfeng zheng, Yizhi Liu, Flora D. Salim, Karin Verspoor, Xiaodan Liang, Xiaojun Chang. [PDF] [Github]

Generalized Radiograph Representation Learning via Cross-supervision between Images and Free-text Radiology Reports. [4th Nov., 2021].[Nature Machine Intelligence, 2022] Hong-Yu Zhou, Xiaoyu Chen, Yinghao Zhang, Ruibang Luo, Liansheng Wang, Yizhou Yu. [PDF][Github]

Auto-Encoding Knowledge Graph for Unsupervised Medical Report Generation. [8th Nov., 2021].[⚡NeurIPS, 2021] Fenglin Liu, Chenyu You, Xian Wu, Shen Ge, Sheng Wang, Xu Sun. [PDF]

Understanding Transfer Learning for Chest Radiograph Clinical Report Generation with Modified Transformer Architectures. [5th May, 2022]. Edward Vendrow, Ethan Schonfeld. [PDF]

Others

Multimodal Co-Attention Transformer for Survival Prediction in Gigapixel Whole Slide Images. [22nd Sep., 2021]. [⚡ICCV, 2021] Chen, Richard J and Lu, Ming Y and Weng, Wei-Hung and Chen, Tiffany Y and Williamson, Drew FK and Manz, Trevor and Shady, Maha and Mahmood, Faisal. [PDF][Github]

Limitations of Transformers on Clinical Text Classification. [25th Sep., 2021]. Shang Gao, Mohammed Alawad, M Todd Young, John Gounley, Noah Schaefferkoetter, Hong Jun Yoon, Xiao-Cheng Wu, Eric B Durbin, Jennifer Doherty, Antoinette Stroup, Linda Coyle, Georgia Tourassi. [PDF]

Explainable Transformer-Based Neural Network for the Prediction of Survival Outcomes in Non-Small Cell Lung Cancer (NSCLC). [14th Oct., 2021]. Elly Kipkogei, Gustavo Alonso Arango Argoty, Ioannis Kagiampakis, Arijit Patra, Etai Jacob. [PDF]

3D Medical Point Transformer: Introducing Convolution to Attention Networks for Medical Point Cloud Analysis. [9th Dec., 2021]. Jianhui Yu, Chaoyi Zhang, Heng Wang, Dingxin Zhang, Yang Song, Tiange Xiang, Dongnan Liu, Weidong Cai. [PDF]

Pre-training and Fine-tuning Transformers for fMRI Prediction Tasks. [10th Dec., 2021]. Itzik Malkiel, Gony Rosenman, Lior Wolf, Talma Hendler. [PDF]

Does CLIP Benefit Visual Question Answering in the Medical Domain as Much as it Does in the General Domain?. [27th Dec., 2021]. Sedigheh Eslami, Gerard de Melo, Christoph Meinel. [PDF]

TransPPG: Two-stream Transformer for Remote Heart Rate Estimate. [26th Jan., 2022]. Jiaqi Kang, Su Yang, Weishan Zhang. [PDF]

Brain Cancer Survival Prediction on Treatment-na ive MRI using Deep Anchor Attention Learning with Vision Transformer. [3rd Feb., 2022]. Xuan Xu, Prateek Prasanna. [PDF]

Using Multi-scale SwinTransformer-HTC with Data augmentation in CoNIC Challenge. [28th Feb., 2022]. Chia-Yen Lee, Hsiang-Chin Chien, Ching-Ping Wang, Hong Yen, Kai-Wen Zhen, Hong-Kun Lin. [PDF]

Self-Supervised Vision Transformers Learn Visual Concepts in Histopathology. [1st March, 2022]. Richard J. Chen, Rahul G. Krishnan. [PDF][Github]

Characterizing Renal Structures with 3D Block Aggregate Transformers. [4th March, 2022]. Xin Yu, Yucheng Tang, Yinchi Zhou, Riqiang Gao, Qi Yang, Ho Hin Lee, Thomas Li, Shunxing Bao, Yuankai Huo, Zhoubing Xu, Thomas A. Lasko, Richard G. Abramson, Bennett A. Landman. [PDF]

Joint rotational invariance and adversarial training of a dual-stream Transformer yields state of the art Brain-Score for Area V4. [8th March, 2022]. William Berrios, Arturo Deza. [PDF]

Active Phase-Encode Selection for Slice-Specific Fast MR Scanning Using a Transformer-Based Deep Reinforcement Learning Framework. [11th March, 2022]. Yiming Liu, Yanwei Pang, Ruiqi Jin, Zhenchang Wang. [PDF]

Surface Vision Transformers: Attention-Based Modelling applied to Cortical Analysis. [29th March, 2022]. [MIDL, 2022] Simon Dahan, Abdulah Fawaz, Logan Z. J. Williams, Chunhui Yang, Timothy S. Coalson, Matthew F. Glasser, A. David Edwards, Daniel Rueckert, Emma C. Robinson. [PDF][Github]

Surface Vision Transformers: Flexible Attention-Based Modelling of Biomedical Surfaces. [7th April, 2022]. [MIDL, 2022] Simon Dahan, Hao Xu, Logan Z. J. Williams, Abdulah Fawaz, Chunhui Yang, Timothy S. Coalson, Michelle C. Williams, David E. Newby, A. David Edwards, Matthew F. Glasser, Alistair A. Young, Daniel Rueckert, Emma C. Robinson. [PDF][Github]

3D Shuffle-Mixer: An Efficient Context-Aware Vision Learner of Transformer-MLP Paradigm for Dense Prediction in Medical Volume. [14th April, 2022]. [MIDL, 2022] Jianye Pang, Cheng Jiang, Yihao Chen, Jianbo Chang, Ming Feng, Renzhi Wang, Jianhua Yao. [PDF]

Local Attention Graph-based Transformer for Multi-target Genetic Alteration Prediction. [13th May, 2022]. Daniel Reisenbüchler, Sophia J. Wagner, Melanie Boxberg, Tingying Peng. [PDF]

A microstructure estimation Transformer inspired by sparse representation for diffusion MRI. [13th May, 2022]. Tianshu Zheng, Cong Sun, Weihao Zheng, Wen Shi, Haotian Li, Yi Sun, Yi Zhang, Guangbin Wang, Chuyang Ye, Dan Wu. [PDF]

BabyNet: Residual Transformer Module for Birth Weight Prediction on Fetal Ultrasound Video. [19th May, 2022]. Szymon Płotka, Michal K. Grzeszczyk, Robert Brawura-Biskupski-Samaha, Paweł Gutaj, Michał Lipa, Tomasz Trzciński, Arkadiusz Sitek. [PDF][Github]

Transformer-based out-of-distribution detection for clinically safe segmentation. [21st May, 2022]. [MIDL, 2022 (Oral)] Mark S Graham, Petru-Daniel Tudosiu, Paul Wright, Walter Hugo Lopez Pinaya, U Jean-Marie, Yee Mah, James Teo, Rolf H Jäger, David Werring, Parashkev Nachev, Sebastien Ourselin, M Jorge Cardoso. [PDF]

MS-DINO: Efficient Distributed Training of Vision Transformer Foundation Model in Medical Domain through Masked Sampling. [5th Jan.,, 2023]. Sangjoon Park, Ik-Jae Lee, Jun Won Kim, Jong Chul Ye. [PDF]

Cooperation Learning Enhanced Colonic Polyp Segmentation Based on Transformer-CNN Fusion. [17th Jan.,, 2023]. CYuanyuan Wang, Zhaohong Deng, Qiongdan Lou, Shudong Hu, Kup-sze Choi, Shitong Wang. [PDF]

ViT-AE++: Improving Vision Transformer Autoencoder for Self-supervised Medical Image Representations. [18th Jan.,, 2023]. Chinmay Prabhakar, Hongwei Bran Li, Jiancheng Yang, Suprosana Shit, Benedikt Wiestler, Bjoern Menze. [PDF]

Citation

If you find the listing and survey useful for your work, please cite the paper:

@misc{shamshad2022transformers,
      title={Transformers in Medical Imaging: A Survey}, 
      author={Shamshad, Fahad and  Khan, Salman and Zamir, Syed Waqas and Khan, Muhammad Haris and  Hayat, Munawar and Khan, Fahad Shahbaz and Fu, Huazhu}
      year={2022},
      eprint={2201.09873},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}

Awesome

<p align=center> This repository complements our survey paper Transformers in Medical Imaging: A Survey, published in Medical Image Analysis.

📢📢🏆🏆🏆 Spotlight: Our article is now among the Top-3 Most Downloaded Articles of the Medical Image Analysis Journal! 🏆🏆🏆

<p align=center>`Awesome Transformers in Medical Imaging`</p>

Overview

Survey

Segmentation

Classification

Classification COVID19 (Separate section due to its current significance)

Reconstruction

Registration

Synthesis

Detection

Clinical-Report-Generation

Others

Citation

Awesome

<p align=center> This repository complements our survey paper Transformers in Medical Imaging: A Survey, published in Medical Image Analysis.

📢📢🏆🏆🏆 Spotlight: Our article is now among the Top-3 Most Downloaded Articles of the Medical Image Analysis Journal! 🏆🏆🏆

<p align=center>Awesome Transformers in Medical Imaging</p>

Overview

Survey

Segmentation

Classification

Classification COVID19 (Separate section due to its current significance)

Reconstruction

Registration

Synthesis

Detection

Clinical-Report-Generation

Others

Citation

<p align=center>`Awesome Transformers in Medical Imaging`</p>