Awesome
Hyper-Convolution Networks for Biomedical Image Segmentation
Code for our WACV 2022 paper:
Hyper-Convolution Networks for Biomedical Image Segmentation (https://arxiv.org/abs/2105.10559)
and our journal extension published at Medical Image Analysis
Hyper-convolutions via implicit kernels for medical image analysis (https://www.sciencedirect.com/science/article/pii/S1361841523000579)
Convolutional Kernels are generated by a hyper-network instead of independtly learned
<img src="https://github.com/tym002/Hyper-Convolution/blob/main/architecture_nn.png" width="600">The input to the hyper-network are the spatial coordinates of the kernels
requirements:
tensorflow-gpu 1.15.0
python 3.6.13
Code:
To initiate training or testing, run:
python main.py --mode train --config_path config.json
--mode train
for training, --mode test
for testing
--config_path
is the path to config json file that contains all model related config
kernal.py
contains the input to the hyper-network, which is a two-channels coordinates grid (x and y)
unet_vanilla.py
contains all the networks including the baseline UNet, non-local UNet and our method
Citation:
If you find our code useful, please cite our work, thank you!
@inproceedings{ma2022hyper,
title={Hyper-convolution networks for biomedical image segmentation},
author={Ma, Tianyu and Dalca, Adrian V and Sabuncu, Mert R},
booktitle={Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision},
pages={1933--1942},
year={2022}
}
@article{ma2023hyper,
title={Hyper-convolutions via implicit kernels for medical image analysis},
author={Ma, Tianyu and Wang, Alan Q and Dalca, Adrian V and Sabuncu, Mert R},
journal={Medical Image Analysis},
pages={102796},
year={2023},
publisher={Elsevier}
}