Home

Awesome

EthereumETL for Neo4j

ETL for moving Ethereum data to a Neo4j database.

  1. Create a new VM using the official Neo4j image:
gcloud compute instances create ethereum-neo4j-instance-0 \
    --image neo4j-enterprise-1-3-5-7-apoc \
    --image-project launcher-public \
    --machine-type n1-standard-2 \
    --boot-disk-size 2000GB \
    --tags neo4j \
    --zone us-central1-a \
    --boot-disk-type pd-ssd

# Create a firewall rule:
gcloud compute firewall-rules create allow-neo4j-bolt-https \
   --allow tcp:7473,tcp:7687 --source-ranges 0.0.0.0/0 --target-tags neo4j
  1. ssh to the instance and clone https://github.com/blockchain-etl/ethereum-etl-neo4j:
gcloud auth login

git clone https://github.com/blockchain-etl/ethereum-etl-neo4j
cd ethereum-etl-neo4j
  1. Run the import (may take up to 24 hours). If you change the END_DATE make sure to also update the disk size for the instance:
export PROJECT=<your-project>
export END_DATE=2020-03-24
nohup bash batch-import.sh &
tail -f nohup.out
# Monitor the logs
  1. Create the indexes:

nohup bash setup-indexes.sh &
sudo systemctl restart neo4j
  1. Open the Neo4j console at https://<vm_external_ip>:7473/browser/ and run some queries:
MATCH (address: Address)
RETURN address
LIMIT 10

MATCH (a1:Address { address_string: '0xd8da6bf26964af9d7eed9e03e53415d37aa96045' })-[r]-(a2)
RETURN *

Notes: