Home

Awesome

Zilliqa ETL

Build Status Telegram

Overview

Zilliqa ETL allows you to setup an ETL pipeline in Google Cloud Platform for ingesting Zilliqa blockchain data into BigQuery. It comes with CLI tools for exporting Zilliqa data into JSON newline-delimited files partitioned by day.

Data is available for you to query right away in Google BigQuery.

Architecture

zilliqa_etl_architecture.svg

Google Slides version

  1. Airflow DAGs export and load Zilliqa data to BigQuery daily. Refer to Zilliqa ETL Airflow for deployment instructions.