Awesome
LmScript
Controllable Language Model Interactions in TypeScript
- A suite of tools for easy, fast, and controllable interactions with language models.
- Open models and open source.
- Supports SGLang and vLLM (Outlines).
Documentation, Tutorial, Examples
Check out the LmScript Docs
Projects
| Project | Description |
|---|---|
| Typescript Client | Dependency-free client that creates and executes LmScript programs with different backends. |
| GUI | Desktop Application that creates and executes LmScript programs. |
| Runpod Serverless SGLang | Docker image that runs SGLang on Runpod Serverless. |
| Docker SGLang | Docker image that runs SGLang |
| Runpod Serverless vLLM | Docker image that runs vLLM (Outlines) on Runpod Serverless. |