Home

Awesome

BigBIO: Biomedical Dataset Library

BigBIO (BigScience Biomedical) is an open library of biomedical dataloaders built using Huggingface's (🤗) datasets library for data-centric machine learning.

Our goals include:

Currently BigBIO provides support for:

How to Use BigBIO

The preferred way to use these datasets is to access them from the Official BigBIO Hub.

Minimally, ensure you have the datasets library installed. Preferably, install the requirements as follows:

pip install -r requirements.txt.

<br>

You can access BigBIO datasets as follows:

from datasets import load_dataset
data = load_dataset("bigbio/biosses")

In most cases, scripts load the original schema of the dataset by default. You can also access the BigBIO split that streamlines access to key information in datasets given a particular task.

<br>

For example, the biosses dataset follows a pairs based schema, where text-based inputs (sentences, paragraphs) are assigned a "translated" pair.

from datasets import load_dataset
data = load_dataset("bigbio/biosses", name="biosses_bigbio_pairs")

Generally, you can load your datasets as follows:

# Load original schema
data = load_dataset("bigbio/<your_dataset>")

# Load BigBIO schema
data = load_dataset("bigbio/<your_dataset_here>", name="<your_dataset>_bigbio_<schema_name>")

Check the datacards on the Hub to see what splits are available to you. You can find more information about schemas in Documentation below.

Benchmark Support

BigBIO includes support for almost all datasets included in other popular English biomedical benchmarks.

Task TypeDatasetBigBIO (ours)BLUEBLURBBoXDUA needed
NERBC2GM✓✓✓
NERBC5-chem✓✓✓✓
NERBC5-disease✓✓✓✓
NEREBM PICO✓✓
NERJNLPBA✓✓✓
NERNCBI-disease✓✓✓
REChemProt✓✓✓✓
REDDI✓✓✓✓
REGAD✓✓
QAPubMedQA✓✓✓
QABioASQ✓✓✓✓
DCHoC✓✓✓✓
STSBIOSSES✓✓✓
STSMedSTS*✓✓
NERn2c2 2010✓✓✓✓
NERShARe/CLEF 2013*✓✓
NLIMedNLI✓✓✓
NERn2c2 deid 2006✓✓✓
DCn2c2 RFHD 2014✓✓✓
NERAnatEM✓✓
NERBC4CHEMD✓✓
NERBioNLP09✓✓
NERBioNLP11EPI✓✓
NERBioNLP11ID✓✓
NERBioNLP13CG✓✓
NERBioNLP13GE✓✓
NERBioNLP13PC✓✓
NERCRAFT*✓
NEREx-PTM✓✓
NERLinnaeus✓✓
POSGENIA*✓
SAMedical Drugs✓✓
SRCOVIDprivate
SRCookingprivate
SRHRTprivate
SRAccelerometerprivate
SRAcromegalyprivate

* denotes dataset implementation in-progress

Documentation

Tutorials

TBA - Links may not be applicable yet!

Contributing

BigBIO is an open source project - your involvement is warmly welcome! If you're excited to join us, we recommend the following steps:

Currently, only admins will be merging all accepted changes to the Hub.

Feel free to join our Discord!

Citing

If you use BigBIO in your work, please cite

@article{fries2022bigbio,
	title = {
		BigBIO: A Framework for Data-Centric Biomedical Natural Language
		Processing
	},
	author = {
		Fries, Jason Alan and Weber, Leon and Seelam, Natasha and Altay,
		Gabriel and Datta, Debajyoti and Garda, Samuele and Kang, Myungsun
		and Su, Ruisi and Kusa, Wojciech and Cahyawijaya, Samuel and others
	},
	journal = {arXiv preprint arXiv:2206.15076},
	year = 2022
}

Acknowledgements

BigBIO is a open source, community effort made possible through the efforts of many volunteers as part of BigScience and the Biomedical Hackathon.