Awesome
Introduction
This is a demo project for PipeRider. It shows how you can use dbt+duckdb+PipeRider to transform and query data efficiently. With these tools, you can generate a report that gives you insights into your git projects.
Usage
-
Clone this repo
git clone git@github.com:InfuseAI/git-repo-analytics.git
-
Prepare git repositories repo for analysis by editing the
repos.csv
The format of the
repos.csv
file is as follows:name,repo dbt-core,dbt-labs/dbt-core duckdb,duckdb/duckdb PipeRider,InfuseAI/piperider
-
Install python package
python -m venv ./venv source ./venv/bin/activate pip install -r requirements.txt
-
Generate the db file from the repo.
make fetch make load
The file
git_repo.duckdb
is generated under./data
-
Run dbt
make transform
-
Generate report
make report
-
Run piperider
make piperider
You can either run step-by-step from step4 to step7 or simply do one command
make