Awesome
Awesome-Medical-Dataset 
Last updated: 2024/11/21
🔥🔥🔥 Medical datasets have transformed the landscape of healthcare research and development across the globe. This comprehensive list features prominent publications and resources related to medical datasets, particularly those used in imaging and electronic health records. It also includes tools for dataset curation and management, educational courses, tutorials on dataset analysis, and access to all publicly available medical dataset checkpoints and APIs. This curated compilation aims to equip researchers, clinicians, and data scientists with essential resources to advance the field of medical research and improve patient care outcomes.
Table of Content
:book: Contents
Public Medical Dataset
:book: Medical Datasets
Imaging
Whole Body
<details> <summary> </summary>| Dataset | Description | Official Website | Release Date | Challenge |
|---|---|---|---|---|
| CT-ORG | 3D CT, 140 Cases, 6 Categories of Organ Segmentation | Github | 2020 | - |
| AutoPET | 3D PET-CT, 1214 Cases, 1 Category of Whole Body Tumor Segmentation | Grand Challenge, Grand Challenge | 2022-04 | MICCAI'2022 & 2023 |
| TotalSegmentator | 3D CT, 1204 Cases, 104 Categories of Whole Body Organ Segmentation | Github | 2022-07 | - |
| NAFLD | 2D Pathological Imaging, 119828 Cases, 16 Categories of Pathological Imaging Classification | Project Homepage | 2022-10 | - |
| TotalSegmentator V2 | 3D CT, 1228 Cases, 117 Categories of Whole Body Organ Segmentation | Github | 2023 | - |
| ULS | 3D CT, 38842 Cases, 1 Category of Whole Body Tumor Segmentation | Grand Challenge | 2023-10 | - |
| TotalSegmentator MRI | 3D MR, 298 Cases, 56 Categories of Whole Body Organ Segmentation | Github | 2024-05 | - |
| MedFMC | 2D, 22349 Cases, 5 Tasks of Disease Classification | Github | 2023-09 | - |
| MICCAI2024-AutoPETIII | 3D PET-CT, 1614 Cases, Optimizing Multi-Center, Multi-Tracer Automatic Tumor Lesion Segmentation | Grand Challenge | 2024-07 | MICCAI'2024 |
Head and Neck
<details> <summary> </summary>| Dataset | Description | Official Website | Release Date | Challenge |
|---|---|---|---|---|
| L2R-OASIS | 3D MRI, 416 Cases, 35 Categories of Brain Segmentation and Registration | Grand Challenge | 2007 | - |
| MSseg08 | 3D MRI, 51 Cases, 1 Category of Multiple Sclerosis Lesion Segmentation | Project Homepage | 2008 | MICCAI'2008 |
| MRBrains13 | 3D MR: T1, T1IR, FLAIR 320 Cases, 3 Categories of Brain Region Segmentation | Project Homepage | 2013 | - |
| DDTI | 2D Ultrasound, 637 Cases, 1 Category of Thyroid Nodule Segmentation | Project Homepage | 2015-01 | - |
| Ultrasound Nerve Segmentation | 2D Ultrasound, 11143 Cases, 1 Category of Cervical Nerve Segmentation | Kaggle | 2016-05 | Kaggle |
| BraTS-TCGA-LGG | 3D MRI, 65 Cases, 3 Categories of Low Grade Glioma (LGG) Segmentation | TCIA | 2017 | BRATS2015 |
| BraTS-TCGA-GBM | 3D MRI, 102 Cases, 3 Categories of Glioblastoma Multiforme (GBM) Segmentation | TCIA | 2017 | BRATS2015 |
| PDDCA | 3D CT, 48 Cases, 9 Categories of Head and Neck Organs Segmentation | Project Homepage | 2017-03 | - |
| BraTS18 | 3D MRI, 285 Cases, 3 Categories of Brain Tumor Segmentation | Project Homepage | 2018 | MICCAI'2018 |
| ZuCo | 2D NLP, 146909 Cases, 3 Categories of EEG (electroencephalography) Sampling in Reading | Project Homepage | 2018-07 | - |
| iSeg | 3D MRI, 13 Cases, 3 Categories of Brain Tissue Segmentation | Project Homepage | 2019 | MICCAI'2017 & 2019 |
| StructSeg2019 Task1 | 3D CT, 50 Cases, 22 Categories of Head and Neck Organs Segmentation | Grand Challenge | 2019 | MICCAI'2019 |
| StructSeg2019 Task2 | 3D CT, 50 Cases, 1 Category of Nasopharyngeal Carcinoma Segmentation | Grand Challenge | 2019 | MICCAI'2019 |
| MSD Brain | 3D mpMR, 484 Cases, 3 Categories of Glioma Segmentation | MSD | 2019-02 | Medical Segmentation Decathlon |
| MSD Hippocampus | 3D MRI, 394 Cases, 2 Categories of Hippocampus Segmentation | MSD | 2019-02 | Medical Segmentation Decathlon |
| Head CT-hemorrhage | 2D CT, 200 Cases, 2 Categories of Cerebral Hemorrhage Classification | Kaggle | 2019-09 | - |
| WMH | 3D MRI, 170 Cases, 1 Category of White Matter Hyperintensity Segmentation | Project Homepage | 2019-11 | - |
| TN-SCUI2020 | 2D Ultrasound, 4554 Cases, 1 Category of Thyroid Nodule Segmentation | Grand Challenge | 2020-05 | MICCAI'2020 |
| AAPM-RT-MAC | 3D MRI, 55 Cases, 8 Categories of Parotid Gland, Submandibular Gland, and Level 2 and 3 Lymph Nodes Contour Segmentation | TCIA | 2020-07 | - |
| CrossMoDA2021 | 3D T1-CE, T2-HR, 349 Cases, 2 Categories of Tumor and Cochlear Structure Segmentation | Grand Challenge | 2021-03 | MICCAI'2021 |
| BraTS21 | 3D MRI, 2040 Cases, 3 Categories of Glioma Segmentation | Synapse | 2021-07 | RSNA-ASNR-MICCAI'2021 |
| ATLAS v2.0 (ISLES 2022) | 3D MRI, 1271 Cases, 1 Category of Lesions After Stroke Segmentation | Grand Challenge | 2021-12 | MICCAI'2022 |
| FeTA 2022 | 3D MRI, 280 Cases, 7 Categories of Infant Brain Tissue Segmentation | Grand Challenge | 2021 | MICCAI'2021 & 2022 |
| BrainPTM | 3D MR-T1, MR-DWI, 75 Cases, 1 Category of White Matter Tract Mapping and Segmentation | Grand Challenge | 2021 | |
| cSeg 2022 | 3D MRI, 13 Cases, 3 Categories of Brain Tissue Segmentation | Project Homepage | 2022-04 | MICCAI'2022 |
| HECKTOR | 3D PET-CT, 882 Cases, 2 Categories of Tumor and Lymph Node | Grand Challenge | 2022-06 | MICCAI'2022 |
| INSTANCE 2022 | 3D CT, 200 Cases, 1 Category of Intracranial Hemorrhage Segmentation | Grand Challenge | 2022-04 | MICCAI'2022 |
| ISLES22 | 3D MRI, 400 Cases, 1 Category of Ischemic Stroke Lesion Segmentation | Grand Challenge | 2022-05 | MICCAI'2022 |
| CuRIOUS2022 | 3D Ultrasound, 23 Cases, 1 Category of Brain Tumor (Resection) Segmentation | Grand Challenge | 2022-07 | MICCAI'2022 |
| Teeth3DS | 3D IOS, 1800 Cases, 32 Categories of Teeth Segmentation | Github | 2022-10 | MICCAI'2022 |
| TN3K | 2D Ultrasound, 3494 Cases, 1 Category of Thyroid Nodule Segmentation | Github | 2021-05 | ISBI'2021 |
| TG3K | 2D Ultrasound, 3585 Cases, 1 Category of Thyroid Nodule Segmentation | Github | 2022-12 | ISBI'2021 |
| HaN-Seg | 3D CT & MRI, 42 Cases, 30 Categories of Head and Neck Organs-at-Risk Segmentation | Grand Challenge | 2023-01 | - |
| SMILE-UHURA 2023 | 3D 7T High Resoulution MRI, 14 Cases, 1 Category of Cerebral Artery Segmentation | Synapse | 2023-03 | ISBI'2023 |
| ToothFairy | 3D CBCT, 443 Cases, 1 Category of Inferior Alveolar Nerve Segmentation | Grand Challenge | 2023-03 | MICCAI'2023 |
| SegRap 2023 | 3D CT, 200 Cases, 47 Categories of Head and Neck Organs-at-Risk Segmentation | Grand Challenge | 2023-04 | MICCAI'2023 |
| CAS2023 | 3D MRI, 100 Cases, 1 Category of Cerebral Artery Segmentation | CodaLab | 2023-04 | MICCAI'2023 |
| CrossMoDA 2023 | 3D MRI, 983 Cases, 3 Categories of Vestibular Schwannoma (VS) and Cochlea Segmentation | Project Homepage | 2023-04 | MICCAI'2023 |
| UCSF-PDGM | 3D MR, 501 Cases, 4 Categories of Diffuse Glioma Segmentation | TCIA | 2023-04 | - |
| IvyGAP-Radiomics | 3D MRI, 31 Cases, 3 Categories of Glioblastoma Segmentation | TCIA | 2023-04 | - |
| BraTS2023-SSA | 3D MRI, 105 Cases, 3 Categories of Glioma Segmentation in Africa | Synapse | 2023-05 | ASNR-MICCAI'BRATS2023 |
| BraTS2023-MEN | 3D MRI, 1650 Cases, 3 Categories of Meningioma Segmentation | Synapse | 2023-05 | ASNR-MICCAI'BRATS2023 |
| BraTS2023-PED | 3D MRI, 228 Cases, 3 Categories of Pediatrics Glioma Segmentation | Synapse | 2023-05 | ASNR-MICCAI'BRATS2023 |
| BraTS2023-MET | 3D MRI, 328 Cases, 3 Categories of Brain Metastasis Segmentation | Synapse | 2023-06 | ASNR-MICCAI'BRATS2023 |
| BONBID-HIE | 3D MRI, 133 Cases, 1 Category of Hypoxic-Ischemic Encephalopathy (HIE) Lesion Segmentation | Grand Challenge | 2023-06 | MICCAI'2023 |
| RHUH-GBM | 3D MR, 120 Cases, 3 Categories of Glioblastoma Segmentation | Project Homepage | 2023-06 | - |
| MICCAI'2024 INSTED | 3D MR, 191 Cases, 3 Categories of Stroke Segmentation | Codabench | 2024-01 | MICCAI'2024 |
| MICCAI'2024 EPVS | 2D/3D MRI, 220 Cases, 1 Category of Enlarged Perivascular Spaces Segmentation | Synapse | 2024-05 | MICCAI'2024 |
| MICCAI'2024 LISA 2024 Task2 | 3D MRI, 63 Cases, 2 Categories of Hippocampus Segmentation | Synapse | 2024-05 | MICCAI'2024 |
| MICCAI'2024 HNTS-MRG Task1 | 3D MRI T2w, 150 Cases, 2 Categories of Primary Tumor and Metastatic Lymph Nodes Segmentation | Grand Challenge | 2024-06 | MICCAI'2024 |
| MICCAI'2024 HNTS-MRG Task2 | 3D MRI T2w, 150 Cases, 2 Categories of Primary Tumor and Metastatic Lymph Nodes Segmentation | Grand Challenge | 2024-06 | MICCAI'2024 |
| MMIS-2024@ACM MM 2024 | 4D MRI, 310 Cases, 2 Categories of Diversified and Personalized Gross Tumor Volume Segmentation | Project Homepage | 2024-07 | MM'2024 |
Chest
<details> <summary> </summary>| Dataset | Description | Official Website | Release Date | Challenge |
|---|---|---|---|---|
| jsrt-directions | 2D X-Ray, 988 Cases, 4 Categories of X-ray Direction Classification | Project Homepage | 2000-01 | - |
| CRASS12 | 2D X-Ray, 284 Cases, 1 Category of Clavicle Segmentation | Grand Challenge | 2012-12 | - |
| QIBA-VolCT-1B | 3D CT, 323 Cases, 1 Categories of Lung Tumor Segmentation and Lesion Size Measurement | TCIA | 2015 | - |
| MIAS | 2D X-ray, 322 Cases, 7 Categories of Breast Lesions Classification | Kaggle | 2015 | - |
| LUNA16 | 3D CT, 888 Cases, 1 Category of Lung Nodule Detection | Grand Challenge | 2016-03 | LUNA16 |
| Breast Ultrasound Dataset B | 2D Ultrasound, 163 Cases, 1 Category of Breast Lesions Detection | Project Homepage | 2018-06 | - |
| FUMPE | 3D CT, 35 Cases, 1 Category of Pulmonary Embolism (PE) Segmentation | Figshare | 2018-09 | - |
| StructSeg2019 Task3 | 3D CT, 50 Cases, 6 Categories of Lung Cancer Radiotherapy Organs-at-Risk Segmentation | Grand Challenge | 2019 | MICCAI'2019 |
| Pneumothorax Masks X-Ray | 2D CXR, 12047 Cases, Chest X-ray and Corresponding Pneumothorax Segmentation | Kaggle | 2019-01 | - |
| StructSeg2019 Task4 | 3D CT, 50 Cases, 1 Category of Organ-at-risk Fractionation for Radiotherapy for Lung Cancer Segmentation | Grand Challenge | 2019 | MICCAI'2019 |
| SegTHOR | 3D CT, 60 Cases, 4 Categories of Thoracic Organs at Risk Segmentation | CodaLab | 2019-01 | ISBI'2019 |
| MSD Lung Tumours | 3D CT, 96 Cases, 1 Category of Lung Tumor Segmentation | MSD | 2019-02 | Medical Segmentation Decathlon |
| LNDb | 3D CT, 294 Cases, 1 Category of Lung Nodule Segmentation | Grand Challenge | 2019-11 | ICIAR'2020 |
| BUSI | 3D Ultrasound, 780 Cases, 3 Categories of Breast Tumor Segmentation | Project Homepage | 2019-11 | - |
| RIDER-LungCT-Seg | 3D CT, 59 Cases, 1 Category of Lung Cancer Segmentation | TCIA | 2020-02 | - |
| PleThora | 3D CT, 402 Cases, 2 Categories of Pleural Effusion and Thoracic Segmentation | TCIA | 2020-04 | - |
| SARS-COV-2 Ct-Scan | 2D CT, 2482 Cases, 2 Categories of Pneumonia Classification | Kaggle | 2020-05 | - |
| COVID_CT_COVID-CT | 2D CT, 746 Cases, 2 Categories of Pneumonia Classification | Tianchi | 2020-06 | - |
| CoronaHack | 2D CXR, 5910 Cases, 2 (7) Categories of Pneumonia Segmentation and Classification | Kaggle | 2020-06 | - |
| COVIDGR | 2D X-Ray, 852 Cases, 2 Categories Pneumonia Classification | Github | 2020-12 | - |
| CMMD | 2D X-ray, 5334 Cases, 2 Categories of Breast Cancer Classification | TCIA | 2021 | - |
| SIIM-FISABIO-RSNA COVID-19 | 2D X Ray, 7597 Cases, 4 Categories of Pneumonia Classification | Kaggle | 2021 | - |
| COVID-19 CHEST X-RAY DATABASE | 2D X-ray, 3886 Cases, 3 Categories of Pneumonia Classification | Project Homepage | 2021-01 | - |
| Chest CT-Scan images | 2D CT, 1000 Cases, 4 Categories of Lung Tumor Classification | Tianchi | 2021-03 | - |
| COVID-19-CT SCAN IMAGES | 2D CT, 1400 Cases, 2 Categories of Pneumonia Classification | Tianchi | 2021-03 | - |
| Chest X-ray PD Dataset | 2D X-Ray, 4575 Cases, 3 Categories of Pneumonia Classification | Project Homepage | 2021-04 | - |
| Shenzhen chest X-ray set | 2D X-Ray, 662 cases, 2 Categories of Tuberculosis Classification | NIH | 2021-06 | - |
| ISPY1-Tumor-SEG-Radiomics | 3D MRI, 483 Cases, 1 Category of Breast Tumors Segmentation | TCIA | 2022-06 | - |
| Chest X-Ray Imaging_(Pneumonia) | 2D X-ray, 5856 Cases, 2 Categories of Pneumonia Classification | Project Homepage | 2022-07 | - |
| Parse 2022 | 3D CT, 200 Cases, 1 Category of Pulmonary Artery Segmentation | Grand Challenge | 2022-04 | MICCAI'2022 |
| ATM22 | 3D CT, 500 Cases, 1 Category of Lung Airway Segmentation | Grand Challenge | 2022-05 | MICCAI'2022 |
| MVSeg-3DTEE 2023 | 3D Ultrasound, 175 Cases, 2 Categories of Mitral Valve Segmentation | Synapse | 2023 | MICCAI'2023 |
| TDSC-ABUS2023 | 3D Ultrasound, 200 Cases, 1 Category of Breast Tumor Detection, Segmentation and Classification | Grand Challenge | 2023-03 | MICCAI'2023 |
| AIIB23 | 3D CT, 312 Cases, 1 Category of Lung Airway Segmentation | CodaLab | 2023-05 | MICCAI'2023 |
| SEG.A. | 3D CTA, 56 Cases, 1 Category of Aorta Segmentation | Grand Challenge | 2023-05 | MICCAI'2023 |
| LNQ 2023 | 3D CT, 513 Cases, 1 Category of Lymph Node Quantification | Grand Challenge | 2023-05 | MICCAI'2023 |
| MICCAI2024 TriALS 2024 Task1 | 3D CT, 60 Cases, 1 Category of Liver Diesase Segmentation | Synapse | 2024-06 | MICCAI'2024 |
Abdomen
<details> <summary> </summary>| Dataset | Description | Official Website | Release Date | Challenge |
|---|---|---|---|---|
| SLIVER07 | 3D CT, 30 Cases, 1 Category of Liver Segmentation | Grand Challenge | 2007 | - |
| NCT-CRC-HE-100K | 2D Pathology, 100,000 Cases, 9 Categories of Colorectal Classification | Zenodo | 2008-04 | - |
| Promise09 | 3D MRI, 15 Cases, 1 Category of Prostate Segmentation | Project Homepage | 2009 | MICCAI'2009 |
| 3D-IRCADB | 3D CT, 22 Cases, 40 Categories of Abdominal Organ and Tumor Segmentation | Project Homepage | 2010 | - |
| VESSEL12 | 3D CT, 20 Cases, 1 Category of Vessel Segmentation | Grand Challenge | 2012-05 | ISBI'2012 |
| BTCV | 3D CT, 50 Cases, 13 Categories of Abdominal Organ Segmentation | Synapse | 2015-04 | MICCAI'2015 |
| BTCV Cervix | 3D CT, 50 Cases, 4 Categories of Abdominal Organ Segmentation | Synapse | 2015-04 | MICCAI'2015 |
| LiTS | 3D CT, 201 Cases, 2 Categories of Liver and Tumor Segmentation | CodaLab | 2017-06 | ISBI'2017, MICCAI'2017 & 2018 |
| MSD Pancreas Tumour | 3D CT, 420 Cases, 2 Categories of Pancreas and Tumour Segmentation | MSD | 2019-02 | Medical Segmentation Decathlon |
| MSD Hepatic Vessel | 3D CT, 443 Cases, 2 Categories Liver Blood vessels and Tumor Segmentation | MSD | 2019-02 | Medical Segmentation Decathlon |
| MSD Spleen | 3D CT, 61 Cases, 1 Category of Spleen Segmentation | MSD | 2019-02 | Medical Segmentation Decathlon |
| MSD Colon Cancer | 3D CT, 190 Cases, 1 Category of Colon Tumor Segmentation | MSD | 2019-02 | Medical Segmentation Decathlon |
| MSD Prostate | 3D MR, 48 Cases, 2 Categories of Prostate Segmentation | MSD | 2019-02 | Medical Segmentation Decathlon |
| Gleason 2019 | 2D Pathology, 331 Cases, 6 Categories of Prostate Cancer Classification | Grand Challenge | 2019 | MICCAI'2019 |
| KiTS19 | 3D CT, 300 Cases, 2 Categories of Kidney and Tumor Segmentation | Grand Challenge | 2019-03 | MICCAI'2019 |
| CHAOS | 3D CT&MRI, 40 Cases, 4 Categories of Abdominal Organ Segmentation | Grand Challenge | 2019-04 | ISBI'2019 |
| Pancreas-CT | 3D Contrast-enhanced CT, 80 Cases, 1 Category of Healthy Pancreas Segmentation | TCIA | 2020 | - |
| QIN-PROSTATE-Repeatability | 3D MR, 30 Cases, 3 Categories of Prostate Segmentation | TCIA | 2020-11 | - |
| KiTS21 | 3D CT, 400 Cases, 3 Categories of Kidney and Tumor Segmentation | Project Homepage | 2021-03 | MICCAI'2021 |
| FLARE 2021 | 3D CT, 511 Cases, 4 Categories of Abdominal Organ Segmentation | Grand Challenge | 2021-05 | MICCAI'2021 |
| AbdomenCT-1K | 3D CT, 1112 Cases, 4 Categories of Abdominal Organ Segmentation | Github | 2021-07 | - |
| QUBIQ2021 | 3D CT, 90 Cases, 2 Categories of Pancreas and Lesions Segmentation | Grand Challenge | 2021-08 | MICCAI'2021 |
| WORD | 3D CT, 150 Cases, 16 Categories of Abdominal Organ Segmentation | Github | 2021-11 | - |
| NuCLS | 2D Pathology, 119828 Cases, Gastric Cancer Pathology Image Classification | Project Homepage | 2022-03 | - |
| FLARE 2023 | 3D CT, 2300 Cases, 13 Categories of Abdominal Organ Segmentation | Grand Challenge | 2022-03 | MICCAI'2022 |
| UW-Madison GI Tract Image Segmentation | 2D MRI, 38496 Cases, 3 Categories of Gastrointestinal Tract Segmentation | Kaggle | 2022-04 | - |
| KiPA22 | 3D CTA, 130 Cases, 4 Categories of Vessel and Tumor Segmentation | Grand Challenge | 2022-04 | MICCAI'2022 |
| AMOS 2022 | 3D CT&MRI, 600 Cases, 15 Categories of Abdominal Organ Segmentation | Grand Challenge | 2022-05 | MICCAI'2022 |
| PI-CAI | 3D MR, 1500 Cases, 1 Category of Prostate Tumor Segmentation | Grand Challenge | 2022-05 | - |
| HCC-TACE-Seg | 3D CT, 628 Cases, 4 Categories of Liver and Liver Tumor Segmentation | TCIA | 2022-08 | - |
| EBHI-Seg | 2D Pathology, 4456 Cases, 6 Categories of Colon Segmentation | Project Homepage | 2023-01 | - |
| LLD-MMRI2023 | 3D MRI, 394 Cases, Liver Lesion Detection | Github | 2023-02 | MICCAI'2023 |
| SPPIN | 3D MRI, 111 Cases, 1 Category of Pediatric Neuroblastoma Segmentation | Grand Challenge | 2023-04 | MICCAI'2023 |
| FLARE 2023 | 3D CT, 4500 Cases, 14 Categories of Abdominal Organ and Tumor Segmentation | CodaLab | 2023-04 | MICCAI'2023 |
| KiTS23 | 3D CT, 599 Cases, 3 Categories of Kidney and Tumor Segmentation | Project Homepage | 2023-04 | MICCAI'2023 |
| ATLAS (MICCAI2023) | 3D CE-MRI, 90 Cases, 2 Categories of Liver and Tumor Segmentation | Grand Challenge | 2023-04 | MICCAI'2023 |
| MOOD2023 | 3D CT&MR, 1300 Cases, Out-of-Distribution Detection | Project Homepage | 2023-04 | MICCAI'2023 |
| MICCAI 2023 PSFHS | 2D Ultrasound, 5101 (4000) Cases, 2 Categories of Fetal Head and Pubic Symphysis (FH-PS) Segmentation | Grand Challenge | 2023-04 | MICCAI'2023 |
| Adrenal-ACC-Ki67-Seg | 3D CT, 57 Cases, 1 Category of Pathologically Confirmed Adrenocortical Carcinoma Segmentation | TCIA | 2023-05 | - |
| AbdomenAtlas 1.0 Mini | 3D CT, 5195 Cases, 9 Categories of Abdominal Organ Segmentation | Github | 2024-02 | - |
| FLARE 2024 Task 1 | 3D CT, 10000 Cases, 1 Category of Whole Body Tumor Segmentation | Codabench | 2024-04 | MICCAI'2024 |
| FLARE 2024 Task 3 | 3D MRI, 4817 Cases, 13 Categories of Abdomen Organs Segmentation | Codabench | 2024-04 | MICCAI'2024 |
| MICCAI 2024 CARE-LiQA | 3D MRI, 250 Cases, 2 Categories of Liver Segmentation and Fibrosis Staging | Project Homepage | 2024-05 | MICCAI'2024 |
| FedSurg | 2D Laparoscopy, 30 Cases, 6 Categories of Laparoscopic Appendectomy | Synapse | 2024-05 | MICCAI'2024 |
| MICCAI-24 ACOUSLIC | 3D Ultrasound, 600 Cases, 3 Categories of Fetal Abdomen Waist Measurement | Grand Challenge | 2024-05 | MICCAI'2024 |
| MICCAI 2024 PENGWIN Task1 | 3D CT, 100 Cases, 3 Categories of Pelvis Segmentation | Grand Challenge | 2024-07 | MICCAI'2024 |
Heart
<details> <summary> </summary>| Dataset | Description | Official Website | Release Date | Challenge |
|---|---|---|---|---|
| HVSMR | 3D MR, 19 Cases, 4 Categories of Cardiac Anatomical Structure Segmentation | Project Homepage | 2016-03 | - |
| ACDC | 3D MRI, 150 Cases, 3 Categories of Left and Right Ventricles and Myocardial Segmentation | Project Homepage | 2017 | MICCAI'2017 |
| MM-WHS | 3D CT/MRI, 120 Cases, 7 Categories of Heart Substructure Segmentation | Github | 2017 | MICCAI'2017 |
| MSD Cardiac | 3D MRI, 30 Cases, 1 Category of Left Atrium Segmentation | MSD | 2019-02 | Medical Segmentation Decathlon |
| M&Ms Cardiac CMR Segmentation | 3D MR, 375 Cases, 3 Categories of Left and right ventricles and myocardial segmentation | Project Homepage | 2020 | MICCAI'2020 |
| EMIDEC | 3D DE-MRI, 150 Cases, 3 Categories of Assessment of Myocardial Infarction Segmentation | Project Homepage | 2020-04 | MICCAI'2020 |
| MyoPS 2020 | 3D MRI, 45 Cases, 5 Categories of Myocardial Pathology Segmentation | Github | 2020-04 | MICCAI'2020 |
| LAScarQS 2022 | 3D MRI, 194 Cases, 2 Categories of Left Atrium and Scar Segmentation | Github | 2022-04 | MICCAI'2022 |
| CMRxMotion | 3D MRI, 360 Cases, 3 Categories of Heart Structure Segmentation | Synapse | 2022-05 | MICCAI'2022 |
| ImageCAS | 3D CTA, 1000 Cases, 1 Category of Coronary Artery Segmentation | Github | 2023 | - |
| CardiacUDA | 2D Ultrasound, 992 Cases, 5 Categories of Heart Structure Segmentation | Github | 2023-09 | - |
| MICCAI 2024 CARE MyoPS++ | 3D CMR, 2741 Cases, 5 Categories of Myocardial Lesion Segmentation | Project Homepage | 2024-05 | MICCAI'2024 |
| MICCAI 2024 CARE WHS++ | 3D CT/CTA, 206 Cases, 1 Category of Whole heart segmentation | Project Homepage | 2024-05 | MICCAI'2024 |
| MICCAI 2024 CARE LAScarQS++ | 3D LGE MRI, 194 Cases, 3 Categories of Left Atrial Cavity Segmentation and Scar Quantification | Project Homepage | 2024-05 | MICCAI'2024 |
Bones
<details> <summary> </summary>| Dataset | Description | Official Website | Release Date | Challenge |
|---|---|---|---|---|
| TCB Challeng | 2D Bone Radiograph, 174Cases, 2 Categories of Osteoporosis Classification | Project Homepage | 2016-08 | - |
| MURA | 2D X-ray, 40561 Cases, 2 Categories of Musculoskeletal Classification | Project Homepage | 2018 | - |
| IVDM3Seg | 3D MRI, 16 Cases, 1 Category of Intervertebral Disc Segmentation | Project Homepage | 2018-09 | MICCAI'2018 |
| Osteosarcoma Tumor Assessment | 2D Pathological Imaging, 1144 Cases, 3 Categories of Tumor after Surgical Resection Classification | TCIA | 2019 | - |
| VerSe | 3D CT, 374 Cases, 26 Categories of Spine Segmentation | Github | 2020-05 | MICCAI'2019 & 2020 |
| RibFrac 2020 | 3D CT, 660 Cases, 4 Categories of Rib Fracture Detection and Classification | Grand Challenge | 2020-06 | MICCAI'2020 |
| Digital Knee X-ray Images | 2D X-Ray, 1650 Cases, 5 Categories of Knee Joint Diseases Classification | Project Homepage | 2020-06 | - |
| Knee Osteoarthritis Dataset with Severity Grading | 2D X-Ray, 9786 Cases, 5 Categories of Knee Osteoarthritis Classification | Project Homepage | 2020-06 | - |
| CTPelvic1K | 3D CT, 1184 Cases, 4 Categories of Lumbar Spine, Sacrum, Left and Right Hip Segmentation | Github | 2020-12 | - |
| CTSpine1K | 3D CT, 1005 Cases, 25 Categories of Spine Segmentation | Github | 2021-05 | - |
| SPIDER | 3D MR, 544 Cases, 19 Categories of Spine, Intervertebral Disc, Spinal Canal Segmentation | Grand Challenge | 2023-06 | - |
| Fractured Bone Detection | 3D CT, 24 Cases, 2 Categories of 2 Fractures Classification | Kaggle | 2023-06 | - |
Endoscopy
<details> <summary> </summary>| Dataset | Description | Official Website | Release Date | Challenge |
|---|---|---|---|---|
| CVC-ClinicDB | 2D, Endoscopy, 612 Cases, 1 Category of Colon Polyp Segmentation | Grand Challenge | 2015-02 | MICCAI'2015 |
| AIDA-E2 | 2D Endoscopy, 262 Cases, 3 Categories of Digestive Tract Disease Classification | Grand Challenge | 2015-11 | ISBI'2016 |
| Cholec80 Cholecystectomy Surgery Video Dataset | 2D Endoscopy, 370,168 Cases, 14 Categories of Surgical Action Types and Instrument Classification | Github | 2016-02 | - |
| Colonoscopic | 2D Endoscopy, 152 Cases, 3 Categories of Gastrointestinal Lesions Classification | Project Homepage | 2016-09 | - |
| Intel & MobileODT Cervical Cancer Screening | 2D Hysteroscopy, 6733 Cases, 3 Categories of Cervix Image Classification | Kaggle | 2017-03 | - |
| The Nerthus Dataset | 2D Endoscopy, 5525 Cases, 4 Categories of Intestinal Cleansing Levels Classification | Project Homepage | 2017-06 | - |
| Robotic Instrument Segmentation | 2D Endoscopy, 3000 Cases, 4 Categories of Surgical Instruments Segmentation | Grand Challenge | 2017-08 | MICCAI'2017 |
| EAD 2019 | 2D Endoscopy, 2991 Cases, 7 Categories of Esophageal, Colon, Stomach, Bladder, Liver Segmentation | Grand Challenge | 2019-08 | - |
| Kvasir-SEG | 2D Endoscopy, 1160 Cases, 1 Category of Colon Polyp Segmentation | Github | 2019-11 | - |
| SARAS-ESAD | 2D Endoscopy, 33398 Cases, 21 Categories of Surgical Action Recognition | Grand Challenge | 2020-01 | - |
| SUN Colonoscopy Video | 2D Endoscopy, 158,690 Cases, 1 Category of Polyp Segmentation | Project Homepage | 2020-07 | - |
| Sinus Surgery Endoscopic Image Datasets | 2D Rhinoscopy, 9003 Cases, 1 Category of Surgical Instrument Segmentation | Github | 2020-08 | - |
| EndoVisSub2018-RoboticSceneSegmentation | 2D Endoscopy, 7274 Cases, Robotic Surgery Scene Segmentation | Grand Challenge | 2020-08 | MICCAI'2018 |
| EndoSLAM | 2D Endoscopy, 64577 Cases, 3D Reconstruction | Github | 2020-10 | - |
| m2caiseg | 2D Endoscopy, 307 Cases, 19 Categories of Abdominal Organs and Surgical Equipment Segmentation | Kaggle | 2020-12 | MICCAI'2016 |
| CholecSeg8k | 2D Endoscopy, 8080 Cases, 13 Categories of Cholecystectomy Surgery Semantic Segmentation | Kaggle | 2020-12 | - |
| Kvasir-Capsule | 2D Endoscopy, 4741504 Cases, 14 Categories of Digestive Tract Lesion Segmentation | Project Homepage | 2021-05 | - |
| FetReg 2021 Task1 | 2D Fetoscope, 2718 Cases, 3 Categories of Blood vessels, Fetus, Surgical Tools Segmentation | Synapse | 2021-07 | MICCAI'2021 |
| LDPolypVideo | 2D Endoscopy, 861400 Slices, 1 Category of Polyp Detection | Github | 2021-09 | - |
| EndoMapper | 2D Endoscopy Video, 59 Cases, 3D Reconstruction and VSLAM | Synapse | 2022-04 | - |
| CholecT45 Dataset | 2D Endoscopy, 90489 Cases, 128 Categories of Cholecystectomy Surgery Action Recognition | Github | 2022-04 | - |
| Surgical scene segmentation | 2D Endoscopy, 9156 Cases, 32 Categories of Surgery Scene Segmentation | Project Homepage | 2022-09 | - |
| LIMUC | 2D Endoscopy, 11276 Cases, 4 Categories of Mayo Score Classification | Github | 2022-11 | - |
| SUN-SEG | 2D Endoscopy, 158,690 Cases, 7 Categories of Video Polyp Segmentation | Github | 2022-11 | - |
| PitVis | 2D Endoscopy, 120024 Cases, 15 Categories of Workflow Identification in Endoscopic Pituitary Surgery | Project Homepage | 2023 | MICCAI'2023 |
| Endoscopic Bladder Tissue Classification Dataset | 2D Endoscopy, 1754 Cases, 4 Categories of Cystoscopy Tissue Classification | Project Homepage | 2023-03 | - |
| C3VD | 2D Endoscopy, 10015 Cases, 3D Reconstruction | Project Homepage | 2023-08 | - |
| SurgVU24 | 2D Endoscopy, 280 Cases, 12 Categories of Surgical Instruments and 8 Categories of Surgical Tasks Video Timing Positioning | Grand Challenge | 2024-05 | MICCAI'2024 |
Retina
<details> <summary> </summary>| Dataset | Description | Official Website | Release Date | Challenge |
|---|---|---|---|---|
| STARE | 2D Retinal Images, 20 Cases, 1 Category of Fundus Blood Vessels Segmentation | Project Homepage | 2000-03 | - |
| DRIVE | 2D Retinal Images, 40 Cases, 1 Category of Fundus Blood Vessels Segmentation | Grand Challenge | 2004-04 | - |
| CHASE | 2D Retinal Images, 28 Cases, 1 Category of Fundus Blood Vessels Segmentation | Project Homepage | 2011-06 | - |
| HRF | 2D Retinal Images, 45 Cases, 1 Category of Fundus Blood Vessels Segmentation | Project Homepage | 2013-12 | - |
| HRF Image Quality Assessment Dataset | 2D Retinal Images, 36 Cases, 2 Categories of Eye Disease Classification | Project Homepage | 2013 | - |
| DRiDB | 2D Retinal Images, 648 Cases, 3 Categories of Diabetic Retinopathy Classification | Project Homepage | 2013 | - |
| RITE | 2D Retinal Images, 40 Cases, 1 Category of Fundus Blood Vessels Segmentation | Project Homepage | 2013 | - |
| Messidor-2 | 2D Retinal Images, 1748 Cases, 2 Categories of Diabetic Retinopathy Classification | Project Homepage | 2013 | - |
| DRISHTI-GS | 2D Retinal Images, 101 Cases, 2 Categories of Optic Cup and Optic Disc Segmentation | Project Homepage | 2014 | - |
| Retinal image quality assessment dataset | 2D Retinal Images, 216 Cases, 3 Categories of Image Quality Evaluation | Project Homepage | 2014-04 | - |
| Retina | 2D Retinal Images, 601 Cases, 4 Categories of Cataracts, Glaucoma Retinopathy | - | 2016 | - |
| Eyepacs | 2D Retinal Images, 35126 Cases, 5 Categories of Diabetic Retinopathy Grading | Project Homepage | 2016 | - |
| RETOUCH | 3D OCT, 112 Cases, 3 Categories of Retinal Fluid Segmentation | Grand Challenge | 2017-04 | MICCAI'2017 |
| LES-AV | 2D Retinal Images, 22 Cases, 1 Category of Fundus Blood Vessels Segmentation | Project Homepage | 2018 | - |
| OCT 2017 | 2D OCT, 35126 Cases, 4 Categories of Eye Disease Classification | Github | 2018 | - |
| Papilledema | 2D Fundus, 1369 Cases, 3 Categories of Papilledema Classification | Project Homepage | 2018 | - |
| REFUGE | 2D Fundus, 1200 Cases, 2 Categories of Glaucoma Classification, 2 Categories of Optic Disc/Cup Segmentation | Grand Challenge | 2018-03 | MICCAI'2018 |
| IDRID | 2D Retinal Images, 81 Cases, 5 Categories of Diabetic Retinopathy Segmentation | Grand Challenge | 2018-07 | ISBI'2018 |
| PALM19 | 2D Retinal Images, 1200 Cases, 1 Category of Fundus Blood Vessels Segmentation | Project Homepage | 2019 | ISBI'2019 |
| LAG | 2D Fundus Photography, 11760 Cases, Glaucoma Early Detection and Research Classification | Github | 2019-03 | - |
| ACRIMA | 2D Retinal Images, 705 Cases, 2 Categories of Glaucoma Classification | Project Homepage | 2019-03 | - |
| ROSE | 2D OCT, 229 Cases, 1 Category Fundus Blood Vessels Segmentation | Project Homepage | 2020 | - |
| OCTA-500 | 2D OCT , 500 Cases, 1 Category of Fundus Blood Vessel Segmentation | Project Homepage | 2020-06 | - |
| RIM-ONE DL | 2D Retinal Images, 485 Cases, 2 Categories of Glaucoma Classification and Optic Disc and Optic Cup Segmentation | Github | 2020-06 | - |
| ORVS | 2D Retinal Images, 49 Cases, 1 Category of Fundus Blood Vessels Segmentation | Github | 2020-12 | - |
| JSIEC | 2D Retinal Images, 1000 Cases, 39 Categories of Eye Diseases Classification | Kaggle | 2021 | - |
| Diabetic Retinopathy Arranged | 2D Retinal Images, 35127 Cases, 5 Categories of Diabetic Retinopathy Classification | Project Homepage | 2021-03 | - |
| Augemnted ocular diseases(AOD) | 2D Retinal Images, 14.8k Cases, 7 Categories of Major Eye Diseases Classification | Kaggle | 2021-04 | - |
| BEH (Bangladesh Eye Hospital) | 2D Fundus photograph, 634 Casesm, 2 Categories of Glaucoma Classification | Github | 2021-12 | - |
| iChallenge-ADAM-Task1 | 2D Retinal Images, 800 Cases, 2 Categories of Age-related Macular Degeneration (AMD) Classification | Grand Challenge | 2022 | ISBI'2020 |
| Retinal OCT-C8 | 2D OCT, 24000 Cases, 8 Categories of Retinal Disease Classification | Kaggle | 2022-01 | - |
| RAVIR | 2D Infrared Reflectance Imaging, 46 Cases, 2 Categories of Retinal Arteries and Veins Segmentation | Grand Challenge | 2022-03 | - |
| Multi-Label Retinal Diseases | 2D Retinal Images, 2451 Cases, 20 Categories of Eye Diseases Classification | Mendeley | 2022-07 | - |
| FIVES | 2D Retinal Images, 800 Cases, 1 Category of Fundus Blood Vessels Segmentation | Project Homepage | 2022-08 | - |
| OLIVES | 2D Fundus Color Photography, 412 Cases, 2 Categories of Diabetic Retinopathy Classification | Github | 2022 | NeurIPS'2022 |
| ODIR-5K | 2D Retinal Images, 5000 Cases, 8 Categories of Common Ophthalmic Diseases Classification | Grand Challenge | 2023 | - |
| AIROGS | 2D Fundus, 101442 Cases, 2 Categories of Glaucoma Classification | Grand Challenge | 2023 | - |
| RFMiD 2.0 | 2D Retinal Images, 3200 Cases, 45 Categories of Eye Disease Classification | Grand Challenge | 2023-01 | ISBI'2021 |
| ToxoFundus | 2D Fundus Color Photos, 412 Cases, 2 Categories of Toxoplasmic Chorioretinitis Classification | Kaggle | 2023-06 | - |
| Harvard Glaucoma Detection and Progression | 2D Fundus photograph, 1544 Cases, 3 Categories of Predicting Glaucoma and Severity Classification | Project Homepage | 2023-08 | - |
| BiDR | 2D Fundus Photography, 2838 Cases, 2 Categories of Diabetic Retinopathy Classification | Kaggle | 2023-11 | - |
| MICCAI 2024 DIAMOND | 2D Fundus Photograph, 2 Categories of center-involved DME Prediction and Retina Diseases Classification | Codabench | 2024-03 | MICCAI'2024 |
| Cataract-1K | 2D Ophthalmic Microscope, 1000 Cases, 13 Categories of Surgical Stages, 2 Categories of Anomaly Detection, 12 Categories of Segmentations | Github | 2024-04 | - |
| OphNet | 2D Ophthalmic Microscope, 2278 Cases, 66 Categories of Surgeries, 103 Categories of Stages, 150 Categories of Operations Ophthalmic Surgery Video Classification and Localization | Project Homepage | 2024-07 | - |
| MAPLES-DR | 2D Fundus Photograph, 198 Cases, 12 Categories of Diabetic Retinopathy Segmentation | Project Homepage | 2024-08 | - |
| AMD-SD | 2D OCT, 3049 Cases, 5 Categories of Wet Age-Related Macular Degeneration Segmentation | Project Homepage | 2024-09 | - |
Skin
<details> <summary> </summary>| Dataset | Description | Official Website | Release Date | Challenge |
|---|---|---|---|---|
| PH² | 2D Dermoscopic Images, 200 Cases, 2 Categories of Melanoma Segmentation | Project Homepage | 2015 | - |
| MED-NODE | 2D Dermoscopic Images, 170 Cases, 2 Categories of Benign and Malignant Melanoma Classification | Project Homepage | 2015-07 | - |
| ISIC 2017 | 2D Dermoscopic Images, 2750 Cases, 1 Category of Melanoma Segmentation | Project Homepage | 2017 | - |
| Derm7pt | 2D Dermoscopic Images, 2000 Cases, 19 Categories of Skin Lesion Malignancy Examination Classification | Project Homepage | 2019 | - |
| ISIC 2020 | 2D Dermoscopic Images, 33126 Cases, 2 Categories of Benign and Malignant Melanoma Classification | Project Homepage | 2020 | - |
| PED-UFES-20 | 2D Dermoscopic Images, 2298 Cases, 6 Categories of Dermatology classification | Mendeley | 2020-07 | - |
| Fitzpatrick 17k | 2D Dermoscopic Images, 16577 Cases, 6 Categories of Fitzpatrick Skin Type, 114 Categories of Skin Condition | Github | 2021 | - |
| Web-scraped Skin Image | 2D Dermoscopic Images, 804 Cases, 6 Categories of Dermatology Classification | Kaggle | 2022-08 | - |
| SCIN | 2D Dermoscopic Images, 10408 Cases, Skin Pathological Conditions (Appearance and Severity) Classification | Project Homepage | 2023-02 | - |
| ISIC 2024 Challenge: SLICE-3D | 2D Dermoscopic Images, 401059 Cases, 2 Categories of Skin Cancer Classification | Project Homepage | 2024-08 | ISBI'2024 |
Microscopic imaging
<details> <summary> </summary>| Dataset | Description | Official Website | Release Date | Challenge |
|---|---|---|---|---|
| Herlev-Cervical Smear | 2D Histopathology, 917 Cases, 7 Categories of Cervical Smear Classification | Project Homepage | 2003 | - |
| Corneal Nerve | 2D Microscopic Imaging, 90 Cases, 2 Categories of Corneal Abnormality Classification | Project Homepage | 2008-11 | - |
| Malignant Lymphoma Classification | 2D Pathological Sections, 374 Cases, 3 Categories of Malignant Lymphoma Classification | Kaggle | 2010-07 | - |
| Corneal Nerve Tortuosity | 2D Microscopic Imaging, 30 Cases, 3 Categories of Corneal Nerve Distortion Grade | Project Homepage | 2011-08 | - |
| OCCISC | 2D Microscopic Imaging, 945 Cases, Extracting the Boundaries of Individual Cytoplasm and Nuclei from Overlapping Cervical Cytology Images | Project Homepage | 2014-01 | - |
| BioMediTech | 2D Cell Imaging, 1862 Cases, 4 Categories of Retinal Cell Classification | Project Homepage | 2016-02 | - |
| GlaS | 2D Pathological Imaging, 165 Cases, 1 Category of Colorectal Gland Tissue Segmentation | Project Homepage | 2017 | MICCAI'2015 |
| HuSHeM | 2D Microscopic Imaging, 216 Cases, 4 Categories of Sperm Classification | Mendeley | 2017-06 | - |
| MoNuSeg | 2D Microscopic Imaging, 53 Cases, 1 Category of Nucleus Segmentation | Grand Challenge | 2017 | MICCAI'2018 |
| PatchCamelyon | 2D Pathological Imaging, 327,680 Cases, 2 Categories of Breast Cancer Metastasis Classification | Project Homepage | 2018-06 | CAMELYON16 |
| ICIAR 2018 BACH Task1 | 2D Histology Imaging, 400 Cases, 4 Categories of Breast Cancer Classification | Grand Challenge | 2018-08 | ICIAR'2018 |
| ICIAR 2018 BACH Task2 | 2D Histology Imaging, 30 Cases, 3 Categories of Breast Cancer Segmentation | Grand Challenge | 2018-08 | ICIAR'2018 |
| CORN | 2D Microscopic Imaging, 1698 Cases, 1 Category of Corneal Nerve Segmentation | Project Homepage | 2019 | - |
| DigestPath2019 | 2D Pathological Imaging, 250 Cases, 1 Category of Digestive System Pathology Segmentation and Detection | Grand Challenge | 2019 | MICCAI'2019 |
| Leukemia | 2D Microscopic Imaging, 1867 Cases, 2 Categories of Leukemia Cell Classification | Kaggle | 2019 | - |
| ICPR-HEp-2 | 2D Cell Fluorescence Microscopy Imaging, 14K, 6 Categories of Cell Classification | Project Homepage | 2019-02 | - |
| Complete Blood Count | 2D Blood Smear, 360 Cases, 3 Categories of Blood Cell Count | Github | 2019-07 | - |
| LC25000 | 2D Pathological Imaging, 25000 Cases, 5 Categories of Pathological Image Classification | Github | 2020-01 | - |
| PanNuke | 2D Pathology, 7904 Cases, 6 Categories of Nuclear Segmentation | Project Homepage | 2020-03 | - |
| SICAPv2 Prostate Pathology Segmentation Dataset | 2D Pathological Imaging, 18783 Cases, 4 Categories of Prostate Cancer Grade | Mendeley | 2020-07 | - |
| ANHIR | 2D Pathological Imaging, 481 Cases, Pathological Image Lung Lobes and Breast Tissue Registration | Grand Challenge | 2020-07 | ISBI'2019 |
| MitoEM2021 | 3D Histopathology Imaging, 2 Cases, 1 Category of Mitochondria Segmentation | Grand Challenge | 2021 | ISBI'2021 |
| CoCaHis | 2D Pathological Imaging, 82 Cases, 2 Categories of Colon Cancer Tissue Segmentation | Project Homepage | 2021-01 | - |
| ARCH | 2D Pathological Imaging, 11816 Cases, Pathological Images and Corresponding Text Descriptions | Project Homepage | 2021-03 | - |
| Malaria Cell Images | 2D Microscopic Imaging, 27558 Cases, 2 Categories of Malaria Classification | Project Homepage | 2021-03 | - |
| SegPC21 | 2D Microscopic Imaging, 498 Cases, 2 Categories of Myeloma Segmentation | Grand Challenge | 2021-04 | ISBI'2021 |
| MHIST | 2D Pathological Imaging, 3152 Cases, 2 Categories of Colon Polyps Classification | Project Homepage | 2021-06 | - |
| Bone Marrow Cytomorphology | 2D Pathological Imaging, 171,375 Cases, 21 Categories of Bone Marrow Cell Morphological Classification | Project Homepage | 2021-11 | - |
| Chaoyang | 2D Pathological Imaging, 6160 Cases, 4 Categories of Colonic Lesions Classification | Github | 2021-11 | - |
| CoNIC2022 | 2D Pathological Imaging, 4981 Cases, 7 Categories of Nuclei within Tissues Segmentation | Grand Challenge | 2022 | ISBI'2022 |
| NeurIPS 2022 Cell Seg | 2D Microscopic Imaging, 3022 Cases, 1 Category of Cell Instance Segmentation | Grand Challenge | 2022-06 | NeurIPS'2022 |
| BRACS | 2D Pathological Imaging, 4539 ROIs/547 WSIs, 7 Categories of Breast Cancer Subtype Classification | Project Homepage | 2022-10 | - |
| BCI | 2D Pathological Imaging, 4870 Cases, 4 Categories to convert HE images to IHC images | Project Homepage | 2023-04 | - |
| MIDOG++ | 2D Pathological Imaging, 22688 Cases, 2 Categories of Tumor Tissue Mitotic Classification | Github | 2023-07 | - |
| SegPANDA200 | 2D Pathological Imaging, 100960 Cases, 6 Categories of Prostate Tissue Segmentation | Project Homepage | 2023-10 | - |
| MIST-HER2 | 2D Pathological Imaging, 22688 Cases, 4 Categories of Critical Biomarkers in Breast Cancer Diagnosis Image Transformation | Project Homepage | 2023-10 | - |
| KPIs | 2D Pathological Imaging, 10428 Patches, 1 Category of Glomerular Tissue Segmentation | Project Homepage | 2024-03 | MICCAI'2024 |
Image text dataset
<details> <summary> </summary>| Dataset | Description | Official Website | Release Date |
|---|---|---|---|
| IU-Xray | RG, 7,470 Frontal or Lateral Chest X-ray Images, with 3,955 Corresponding Reports | PaperWithCode | 2016 |
| Linguistic Meaning | Semantic Decoding, Functional Magnetic Resonance Imaging (fMRI), and Semantic Vector Representations | Project Homepage | 2018-03 |
| VQA-RAD | VQA, 3515 Cases QA Pair | Project Homepage | 2018-11 |
| ImageClef-2019-VQA-Med | VQA, 15292 Cases QA Pair | Project Homepage | 2019-09 |
| ZuCo 2.0 | eeg-to-text | Project Homepage | 2019-12 |
| PathVQA | VQA, 32799 Cases QA Pair | Grand Challenge | 2020-03 |
| MedICaT | VQA, 217060 Cases QA Pair | Github | 2020-12 |
| SLAKE | VQA, 14028 Cases QA Pair | Project Homepage | 2021-02 |
| Montgomery County CXR Set | 2D X-Ray, 138 Cases, 2 Categories of CXR Image Abnormality Diagnosis | Project Homepage | 2021-06 |
| MMMU Health&Medicine | VQA, 1752 Cases QA Pair | Mendeley | 2022-07 |
| PMC-OA | VQA, 1.6M QA Pair | Project Homepage | 2023-03 |
| PMC-VQA | VQA, 227K Cases | Github | 2023-05 |
| Quilt-1M | Caption, 768826 Cases | Project Homepage | 2023-06 |
| ROCOV2 | Caption, 80080 Cases Image-Caption Pair | Zenodo | 2023-11 |
| RP3D-Caption | Caption, 69523 Cases Image-Caption Pair | Project Homepage | 2023-11 |
| PMC-Inline | Caption, 11,000,000 Images | Hugginface | 2023-11 |
| CT-RATE | Caption, 47149 Cases | Hugginface | 2024-03 |
| MedPromptX-VQA | VQA, 968 Cases QA Pair | Project Homepage | 2024-03 |
| WSI-VQA | VQA, 8672 Cases QA Pair | Github | 2024-07 |
| Medical-CXR-VQA | 2D X-Ray, 780014 Cases, LLMs specializing in chest X-ray Images | Github | 2024-07 |
| PathMMU | VQA, 33,428 Cases QA Pair and 24,067 Cases Pathological Images | Project Homepage | 2024-08 |
| ColonINST-v1 | VQA, 450,724 visual dialogues | Github | 2024-10 |
| EIT-1M | Semantic Decoding, 1 million EEG-image-text Data Pairs, suitable for EEG Signal Decoding Tasks | Project Homepage | 2025-07 |
Text dataset
<details> <summary> </summary>| Dataset | Description | Official Website | Release Date |
|---|---|---|---|
| LiveQA | QA, 634 Cases QA Pair | Github | 2017 |
| cMedQA v2.0 | QA, 108K Cases QA Pair | Github | 2018-12 |
| webMedQA | QA, 63,284 Cases QA Pair | Github | 2019 |
| PubMedQA | QA, 1000 Cases Expert annotation QA Pair | Project Homepage | 2019 |
| MedDialog-CN | QA, 1.1M Cases QA Pair | Github | 2020-07 |
| MedQA | QA, 61,097 Cases QA Pair | Github | 2020-09 |
| Chinese Medical Dialogue Dataset | QA, 792K Cases QA Pair | Project Homepage | 2021-02 |
| MedMCQA | QA, 193,155 Cases QA Pair | Project Homepage | 2022-03 |
| Huatuo-26M | QA, 26M Cases QA Pair | Github | 2023-05 |
| HealthSearchQA | QA, 3173 Cases QA Pair | Paper | 2023-07 |
| CMB | QA, 270K Cases QA Pair | Github | 2023-08 |
| ShenNong-TCM-Dataset/EB | QA, 113K Cases QA Pair | Github | 2023-08 |
| CMExam | QA, 68K Cases QA Pair | Github | 2023-10 |
| PathText | Caption, 9009 Cases, WSI-Text Pair | Github | 2023-11 |
| MedBench | QA, 113K Cases QA Pair | Project Homepage | 2023-12 |
| RJUA-QA | QA, 213 Cases QA Pair | Github | 2023 |
| ChineseEEG | Semantic Decoding and Matching, 25 Phases and 115,233 Characters | Github | 2024-03 |
| MedConceptsQA | QA, 800K Medical concepts | Project Homepage | 2024-09 |
Other Medical Awesome Collection Projects
- SegLossOdyssey: A collection of loss functions for medical image segmentation.
- SOTA-MedSeg: SOTA medical image segmentation methods based on various challenges.
- awesome-transformers-in-medical-imaging: A collection of resources on applications of Transformers in Medical Imaging.
- awesome-gan-for-medical-imaging: Awesome GAN for Medical Imaging.
- Awesome-Diffusion-Models-in-Medical-Imaging: Diffusion Models in Medical Imaging (Published in Medical Image Analysis Journal).
- Awesome-CLIP-in-Medical-Imaging: A Survey on CLIP in Medical Imaging.
- awesome-multimodal-in-medical-imaging: A collection of resources on applications of multi-modal learning in medical imaging.
- awesome-medical-vision-language-models: A collection of resources on Medical Vision-Language Models.
- Awesome-Medical-Large-Language-Models: Curated papers on Large Language Models in Healthcare and Medical domain.
- awesome-healthcare: Curated list of awesome open source healthcare software, libraries, tools and resources.
- awesome_Chinese_medical_NLP: 中文医学NLP公开资源整理：术语集/语料库/词向量/预训练模型/知识图谱/命名实体识别/QA/信息抽取/模型/论文/etc.
- Data-Centric-FM-Healthcare: A survey on data-centric foundation models in computational healthcare.
Dataset Platforms
You can search for more medical datasets not included in this project on these websites:
- Grand Challenges: A platform for end-to-end development of machine learning solutions in biomedical imaging.
- Kaggle: One of the largest AI & ML community.
- TCIA: A service which de-identifies and hosts a large archive of medical images of cancer accessible for public download.
- Synapse: A platform for supporting scientific collaborations centered around shared biomedical data sets.
- Medical Segmentation Decathlon: The MSD challenge tests the generalisability of machine learning algorithms when applied to 10 different semantic segmentation tasks.
- CodaLab: An open-source web-based platform that enables researchers, developers, and data scientists to collaborate, with the goal of advancing research fields where machine learning and advanced computation is used.
- Tianchi (Chinese): Tianchi is a developer competition platform under Alibaba Cloud.
- OpenDataLab (Chinese): China Big Model Corpus Data Alliance open source data service designated platform, provides high-quality open data sets for large models.
Evaluation Benchmark
Noted: Many of the datasets collected in this project are benchmarks on the data platform. This section collects comprehensive benchmarks specifically used to evaluate model performance.
| Benchmark | Organization | Paper | Website |
|---|---|---|---|
| MedBench | Shanghai AI Lab |  | Project Link |
| OmniMedVQA | Shanghai AI Lab |  |  |
| A-Eval | Shanghai AI Lab |  |  |
| GMAI-MMBench | Shanghai AI Lab |  |  |
| Touchstone | JHU |  |  |
SOTA Methods
Segmentation
| Model | Organization | Paper | Github |
|---|---|---|---|
| nnU-Net | DKFZ |  |  |
| MedNeXt | DKFZ |  |  |
| STU-Net | Shanghai AI Lab |  |  |
| U-Net & CLIP | CityU |  |  |
| UNETR | NVIDIA |  |  |
| Swin UNETR | NVIDIA |  | |
| Swin UNETR & CLIP | CityU | | |
| MedFormer | Rutgers |  |  |
| UniSeg | NPU |  |  |
| Diff-UNet | HKUST |  |  |
| LHU-Net | UR |  |  |
| NexToU | HIT |  |  |
| SegVol | BAAI |  |  |
| UNesT | NVIDIA |  | |
| SAM-Adapter | Duke |  |  |
Related Foundation Toolbox Projects
Many of the papers that use the datasets collected in this project have their code written based on the following Github code project.
| Projects | Organization | Paper | Github |
|---|---|---|---|
| nnU-Net | DKFZ | | |
| MONAI | NVIDIA |  |  |
| SAM | META |  |  |
| MMSegmentation | Shanghai AI Lab | - |  |
| MMPretrain | Shanghai AI Lab | - |  |