Awesome
π£ gRNAde: Geometric Deep Learning for 3D RNA Inverse Design
gRNAde is a geometric deep learning pipeline for 3D RNA inverse design, analogous to ProteinMPNN for protein design.
𧬠Tutorial notebook to get started: gRNAde 101 <a target="_blank" href="https://colab.research.google.com/drive/16rXKgbGXBBsHvS_2V84WbfKsJYf9lO4Q"> <img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/> </a>
βοΈ Using gRNAde for custom RNA design scenarios: Design notebook <a target="_blank" href="https://colab.research.google.com/drive/1ajcikLbM9v8_mYwWuZAcVP57nek6UBQD"> <img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/> </a>
βοΈ New to 3D RNA modelling? Here's a currated reading + watch list for beginners: Resources
π For more details on the methodology, see the accompanying paper: 'gRNAde: Geometric Deep Learning for 3D RNA inverse design'
Chaitanya K. Joshi, Arian R. Jamasb, Ramon ViΓ±as, Charles Harris, Simon Mathis, Alex Morehead, and Pietro LiΓ². gRNAde: Geometric Deep Learning for 3D RNA inverse design. ICML Computational Biology Workshop, 2023.
gRNAde generates an RNA sequence conditioned on one or more 3D RNA backbone conformations, i.e. both single- and multi-state fixed-backbone sequence design. RNA backbones are featurized as geometric graphs and processed via a multi-state GNN encoder which is equivariant to 3D roto-translation of coordinates as well as conformer order, followed by conformer order-invariant pooling and sequence design.
Installation
In order to get started, set up a python environment by following the installation instructions below. We have tested gRNAde on Linux with Python 3.10.12 and CUDA 11.8 on NVIDIA A100 80GB GPUs and Intel XPUs, as well as on MacOS (CPU).
# Clone gRNAde repository
cd ~ # change this to your prefered download location
git clone https://github.com/chaitjo/geometric-rna-design.git
cd geometric-rna-design
# Install mamba (a faster conda)
wget https://github.com/conda-forge/miniforge/releases/latest/download/Miniforge3-Linux-x86_64.sh
bash Miniforge3-Linux-x86_64.sh
source ~/.bashrc
# You may also use conda or virtualenv to create your environment
# Create new environment and activate it
mamba create -n rna python=3.10
mamba activate rna
Set up your new python environment, starting with PyTorch and PyG:
# Install Pytorch on Nvidia GPUs (ensure appropriate CUDA version for your hardware)
mamba install pytorch torchvision torchaudio pytorch-cuda=11.8 -c pytorch -c nvidia
# Install Pytorch Geometric (ensure matching torch + CUDA version to PyTorch)
pip install torch_geometric
pip install torch_scatter torch_cluster -f https://data.pyg.org/whl/torch-2.1.2+cu118.html
<details>
<summary>Install Pytorch/PyG on Intel XPUs (specific to Cambridge's Dawn supercomputer)</summary>
module load default-dawn
source /usr/local/dawn/software/external/intel-oneapi/2024.0/setvars.sh
export ZE_FLAT_DEVICE_HIERARCHY=COMPOSITE
python -m pip install torch==2.1.0a0 torchvision==0.16.0a0 torchaudio==2.1.0a0 intel-extension-for-pytorch==2.1.10+xpu --extra-index-url https://pytorch-extension.intel.com/release-whl/stable/xpu/us/
pip install torch_scatter torch_cluster
</details>
<br>
Next, install other compulsory dependencies:
# Install other python libraries
mamba install jupyterlab matplotlib seaborn pandas biopython biotite -c conda-forge
pip install wandb gdown pyyaml ipdb python-dotenv tqdm cpdb-protein torchmetrics einops ml_collections mdanalysis MDAnalysisTests draw_rna
# Install X3DNA for secondary structure determination
cd ~/geometric-rna-design/tools/
tar -xvzf x3dna-v2.4-linux-64bit.tar.gz
./x3dna-v2.4/bin/x3dna_setup
# Follow the instructions to test your installation
# Install EternaFold for secondary structure prediction
cd ~/geometric-rna-design/tools/
git clone --depth=1 https://github.com/eternagame/EternaFold.git && cd EternaFold/src
make
# Notes:
# - Multithreaded version of EternaFold did not install for me
# - To install on MacOS, start a shell in Rosetta using `arch -x86_64 zsh`
# Download RhoFold checkpoint (~500MB)
cd ~/geometric-rna-design/tools/rhofold/
gdown https://drive.google.com/uc?id=1To2bjbhQLFx1k8hBOW5q1JFq6ut27XEv
<details>
<summary>Optionally, you can also set up some extra tools and dependencies.</summary>
# (Optional) Install CD-HIT for sequence identity clustering
mamba install cd-hit -c bioconda
# (Optional) Install US-align/qTMclust for structural similarity clustering
cd ~/geometric-rna-design/tools/
git clone https://github.com/pylelab/USalign.git && cd USalign/ && git checkout 97325d3aad852f8a4407649f25e697bbaa17e186
g++ -static -O3 -ffast-math -lm -o USalign USalign.cpp
g++ -static -O3 -ffast-math -lm -o qTMclust qTMclust.cpp
</details>
<br>
Once your python environment is set up, create your .env
file with the appropriate environment variables; see the .env.example file included in the codebase for reference.
cd ~/geometric-rna-design/
touch .env
You're now ready to use gRNAde via the tutorial. In order to train your own models from scratch though, you still need to download and process raw RNA structures from RNAsolo (instructions below).
Directory Structure and Usage
Detailed usage instructions are available in the tutorial notebook.
.
βββ README.md
βββ LICENSE
|
βββ gRNAde.py # gRNAde python module and command line utility
βββ main.py # Main script for training and evaluating models
|
βββ .env.example # Example environment file
βββ .env # Your environment file
|
βββ checkpoints # Saved model checkpoints
βββ configs # Configuration files directory
βββ data # Dataset and data files directory
βββ notebooks # Directory for Jupyter notebooks
βββ tutorial # Tutorial with example usage
|
βββ tools # Directory for external tools
| βββ draw_rna # RNA secondary structure visualization
| βββ EternaFold # RNA sequence to secondary structure prediction tool
| βββ RhoFold # RNA sequence to 3D structure prediction tool
| βββ ribonanzanet # RNA sequence to chemical mapping prediction tool
| βββ x3dna-v2.4 # RNA secondary structure determination from 3D
|
βββ src # Source code directory
βββ constants.py # Constant values for data, paths, etc.
βββ evaluator.py # Evaluation loop and metrics
βββ layers.py # PyTorch modules for building Multi-state GNN models
βββ models.py # Multi-state GNN models for gRNAde
βββ trainer.py # Training loop
|
βββ data # Data-related code
βββ clustering_utils.py # Methods for clustering by sequence and structural similarity
βββ data_utils.py # Methods for loading PDB files and handling coordinates
βββ dataset.py # Dataset and batch sampler class
βββ featurizer.py # Featurizer class
βββ sec_struct_utils.py # Methods for secondary structure prediction and determination
Downloading and Preparing Data
gRNAde is trained on all RNA structures from the PDB at β€4A resolution (12K 3D structures from 4.2K unique RNAs) downloaded via RNASolo with date cutoff: 31 October 2023.
If you would like to train your own models from scratch, download and extract the raw .pdb
files via the following script into the data/raw/
directory (or another location indicated by the DATA_PATH
environment variable in your .env
file).
π¨ Note: Alternatively to the instructions below, you can download a pre-processed .pt
file and .csv
metadata, and place them into the data/
directory.
Method 1: Script
# Download structures in PDB format from RNAsolo (31 October 2023 cutoff)
mkdir ~/geometric-rna-design/data/raw
cd ~/geometric-rna-design/data/raw
gdown https://drive.google.com/uc?id=10NidhkkJ-rkbqDwBGA_GaXs9enEBJ7iQ
tar -zxvf RNAsolo_31102023.tar.gz
<details>
<summary>Older instuctions for downloading from RNAsolo (not working)</summary>
curl -O https://rnasolo.cs.put.poznan.pl/media/files/zipped/bunches/pdb/all_member_pdb_4_0__3_300.zip
unzip all_member_pdb_4_0__3_300.zip
rm all_member_pdb_4_0__3_300.zip
</details>
RNAsolo recently stopped hosting downloads for older versions, such as the 31 October 2023 cutoff that we used in our current work, so you can download the exact data we used via our Google Drive link.
Method 2: Manual
Manual download link: https://rnasolo.cs.put.poznan.pl/archive. Select the following for creating the download: 3D (PDB) + all molecules + all members + res. β€4.0
Next, process the raw PDB files into our ML-ready format, which will be saved under data/processed.pt
.
You need to install the optional dependencies (US-align, CD-HIT) for processing.
# Process raw data into ML-ready format (this may take several hours)
cd ~/geometric-rna-design/
python data/process_data.py
Each RNA will be processed into the following format (most of the metadata is optional for simply using gRNAde):
{
'sequence' # RNA sequence as a string
'id_list' # list of PDB IDs
'coords_list' # list of structures, i.e. 3D coordinates of shape ``(length, 27, 3)``
'sec_struct_list' # list of secondary structure strings in dotbracket notation
'sasa_list' # list of per-nucleotide SASA values
'rfam_list' # list of RFAM family IDs
'eq_class_list' # list of non-redundant equivalence class IDs
'type_list' # list of structure types (RNA-only, RNA-protein complex, etc.)
'rmsds_list' # dictionary of pairwise C4' RMSD values between structures
'cluster_seqid0.8' # cluster ID of sequence identity clustering at 80%
'cluster_structsim0.45' # cluster ID of structure similarity clustering at 45%
}
Splits for Benchmarking
We have provided the splits used in our experiments in the data/
directory:
- Single-state split from Das et al., 2010:
data/das_split.pt
(called the Das split for compatibility with older code) - Multi-state split of structurally flexible RNAs:
data/structsim_split.pt
The precise procedure for creating the splits (which can be used to modify and customise them) can be found in the notebooks/
directory. The exact PDB IDs used for each of the splits are also available in the data/split_ids/
directory, in case you are using a different version of RNAsolo after the 31 October 2023 cutoff.
Citation
@article{joshi2023grnade,
title={gRNAde: Geometric Deep Learning for 3D RNA inverse design},
author={Joshi, Chaitanya K. and Jamasb, Arian R. and Vi{\~n}as, Ramon and Harris, Charles and Mathis, Simon and Morehead, Alex and Anand, Rishabh and Li{\`o}, Pietro},
journal={arXiv preprint},
year={2023},
}