Awesome

glest: Estimation of the grouping loss of a probabilistic classifier

Install

From PyPi:

pip install glest

From source:

pip install git+https://github.com/aperezlebel/glest.git

Cite

@inproceedings{perez-lebel2023,
    title={Beyond calibration: estimating the grouping loss of modern neural networks},
    author={Alexandre Perez-Lebel and Marine Le Morvan and Gaël Varoquaux},
    booktitle={Proceedings of the International Conference on Learning Representations},
    year={2023},
    url={https://doi.org/10.48550/arXiv.2210.16315}
}