Awesome
GHOST
This repository is part of the Supporting Information to
GHOST: Adjusting the Decision Threshold to Handle Imbalanced Data in Machine Learning
Carmen Esposito,<sup>1</sup> Gregory A. Landrum,<sup>1,2</sup> Nadine Schneider,<sup>3</sup> Nikolaus Stiefl,<sup>3</sup> and Sereina Riniker<sup>1</sup>
<sup>1</sup> Laboratory of Physical Chemistry, ETH Zurich, Vladimir-Prelog-Weg 2, 8093 Zurich,Switzerland <br /> <sup>2</sup> T5 Informatics GmbH, Spalenring 11, 4055 Basel, Switzerland <br /> <sup>3</sup> Novartis Institutes for BioMedical Research, Novartis Pharma AG, Novartis Campus,4002 Basel, Switzerland <br />
Installing GHOST
You can install the most recent release of GHOST from pypi:
python -m pip install ghostml
or, if you want to install the development version directly from github:
python -m pip install git+https://github.com/rinikerlab/GHOST
Content
Notebooks:
-
library_example.ipynb <br /> Example of how to use the ghostml library.
-
example_oob_threshold_optimization.ipynb <br /> Example of how to use the oob-based thresholding method to optimize the decision threshold of a random forest classifier.
-
example_GHOST.ipynb <br /> Example of how to use GHOST (Generalized tHreshOld ShifTing) to optimize the decision threshold of classification models.
-
Tutorial_Threshold_Optimization_RF.ipynb <br /> Notebook explaining step by step how to reproduce the results reported in our work. Here, the code is only executed for 6 public datasets and the random forest model.
-
Reproduce_Results_Public_Datasets.ipynb <br /> Notebook to reproduce the results reported in our work. Here, results are produced for all 138 public datasets. The user can choose between four different machine learning methods, namely random forest (RF), gradient boosting (GB), XGBoost (XGB), and logistic regression (LR). The user can also choose between two different molecular descriptors, ECFP4 and RDKit2D.
-
DeepChem_PubChem.ipynb <br /> Notebook to reproduce the results of the multi-task classification models for the PubChem datasets.
-
DeepChem_MoleculeNet.ipynb <br /> Notebook to reproduce the results of the multi-task classification models for the MoleculeNet datasets.
Validation Data:
The threshold optimization methods have been validated agaist 138 public datasets and these are all provided here in the folder notebooks/data.
Dependencies:
If you are just interested in using ghostml in your own code/notebooks, you'll just need these packages:
- numpy
- pandas
- sklearn
A list of dependencies to run the example notebooks is available in the file notebooks/ghost_env.yml. This conda environment was used to obtain the results reported in our work.
Authors
Carmen Esposito (GHOST procedure) and Greg Landrum (oob-based threshold optimization approach, data collection, initial code).
Acknowledgements
Conformal prediction (CP) experiments were adapted from the CP functions provided by the Volkamer Lab.
License
This package is licensed under the terms of the MIT license.