Awesome

Why?

I wanted to learn Candle, so I decided to port Andrej Karpathy's tutorial. It gives a good feel for the Candle API and it's meant for people who want to use Candle and see how certain things can be done, so do look into that src directory!

Blogpost on Perceptive Bits.

How

This project was developed using Candle 0.3.2 and Rust 1.75.0

You can run it with

run --package gpt-from-scratch-rs --bin gpt-from-scratch-rs -- --input-path /home/jvlek/dev/datasets/tinyshakespeare.txt

Where input-path points to a text file you want to train on. See the file src/args.rs for more arguments like number of epochs (note that you need to convert underscores to dashes).