Awesome
Mentored decoding
Supplementary material for the blog post on A provably optimal lossy variant of speculative decoding:
- Optimality proof
- Code
Supplementary material for the blog post on A provably optimal lossy variant of speculative decoding: