Home

Awesome

Tiny FlashAttention

WIP

A tiny flash attention implement in python, rust, cuda and c for learning purpose.

cutlass cute flash attention in action

my env: cutlass v3.4, torch 1.14, cuda 12.4