Awesome
<div align=center> <img src="https://parcel.pyke.io/v2/cdn/assetdelivery/ortrsv2/docs/trend-banner.png" width="350px"> <hr /> <a href="https://app.codecov.io/gh/pykeio/ort" target="_blank"><img alt="Coverage Results" src="https://img.shields.io/codecov/c/gh/pykeio/ort?style=for-the-badge"></a> <a href="https://crates.io/crates/ort" target="_blank"><img alt="Crates.io" src="https://img.shields.io/crates/d/ort?style=for-the-badge"></a> <a href="https://opencollective.com/pyke-osai" target="_blank"><img alt="Open Collective backers and sponsors" src="https://img.shields.io/opencollective/all/pyke-osai?style=for-the-badge&label=sponsors"></a> <br /> <a href="https://crates.io/crates/ort" target="_blank"><img alt="Crates.io" src="https://img.shields.io/crates/v/ort?style=for-the-badge&label=ort&logo=rust"></a> <img alt="ONNX Runtime" src="https://img.shields.io/badge/onnxruntime-v1.20.1-blue?style=for-the-badge&logo=cplusplus"> </div>ort
is an (unofficial) ONNX Runtime 1.20 wrapper for Rust based on the now inactive onnxruntime-rs
. ONNX Runtime accelerates ML inference and training on both CPU & GPU.
π Documentation
π€ Support
π Projects using ort
<sub>Open a PR to add your project here π</sub>
- Twitter uses
ort
to serve homepage recommendations to hundreds of millions of users. - Bloop uses
ort
to power their semantic code search feature. - edge-transformers uses
ort
for accelerated transformer model inference at the edge. - Ortex uses
ort
for safe ONNX Runtime bindings in Elixir. - Supabase uses
ort
to remove cold starts for their edge functions. - Lantern uses
ort
to provide embedding model inference inside Postgres. - Magika uses
ort
for content type detection. sbv2-api
is a fast implementation of Style-BERT-VITS2 text-to-speech usingort
.- Ahnlich uses
ort
to power their AI proxy for semantic search applications.