Home

Awesome

Orion

Orion is a web-based chat interface that simplifies interactions with multiple AI model providers. It provides a unified platform for chatting and exploring multiple large language models (LLMs), including:

Orion Screenshot

With Orion, you can easily navigate and assess the strengths and limitations of different AI models through an intuitive, user-friendly interface.

Key Features

API Key Management

Your API keys are stored locally using localStorage, and requests are sent directly to the official provider's API (OpenAI, Anthropic, Google, Groq, Cerebras) without routing through any external proxy.

Free API Keys

Some companies offer free API access. Check their terms and conditions before you get started.

Paid API Keys

Special Commands

Use special commands to perform an action quickly and easily.

Translation

Translate: Translate text with ease using special command.

YouTube Summary Ask AI to summarize a YouTube video or answer any question based on the video caption. See an example of use below.

It is recommended to use a larger context window model when using this functionality, such as Google Gemini.

Retrieval-Augmented Generation (RAG)

Search: Perform quick searches and retrieve relevant information with ease from Google.

Execution of JavaScript code in the user's browser.

Please perform this functionality with caution and always check code before accepting execution.

Executing Python code in a remote environment

Google CSE API Key

To search using Google, you will need Google CSE (Custom Search Engine) API Key and CX.

Rag Endpoint

BETA

For better search results, you can configure a search endpoint.

A POST request with query will be sent to this endpoint, where query is the search term.

These configurations were created to be compatible with https://github.com/EliasPereirah/SearchAugmentedLLM/ (Not perfect, but better than just Google snippet)

If you want to use any other endpoint, make sure it returns a JSON with the text field, where text will be the content passed to the LLM.

By adding such an endpoint you will be able to use it by writing at the beginning of the chat s: what's the news today and the answer will be based on the context returning from the "rag endpoint"

An advanced option for those using Google Gemini may be to use "Grounding with Google Search", this feature is not implemented here and has a cost of $35 / 1K grounding requests.

Proxy

To get around CORS errors when working with SambaNova a proxy may be necessary.

If you are using Orion via localhost or a hosting with PHP support, you can use the PHP proxy code available in this repository (proxy.php file) for this you will also need to add the following JavaScript code in plugins.

To do this, click on "Options" -> Plugins and paste the JavaScript code provided below:


let proxy_url =  window.location.origin + window.location.pathname + "/proxy.php";
// This assumes that the proxy url is on the same host, if not enter it here
if(chosen_platform === "sambanova" || chosen_platform === "nvidia"){
  endpoint = proxy_url+"?platform="+chosen_platform;
}
function setProxyEndpoint(event){
  if(chosen_platform === "sambanova" || chosen_platform === "nvidia"){
    let proxy_endpoint = proxy_url+"/proxy.php?platform="+chosen_platform;
    if(proxy_endpoint !== endpoint){
      endpoint = proxy_endpoint;
      removeLastMessage();
    }
  }
}


let button_send = document.querySelector("#send");
chat_textarea.addEventListener('keyup', (event) => {
  if (event.key === 'Enter' && !event.shiftKey) {
    setProxyEndpoint();
  }
});

button_send.addEventListener("click", ()=>{
  setProxyEndpoint()
})

Be careful when using any other proxy as sensitive data will be passed through it like your API key and messages. Use only trusted services.

YouTube Captions

To enable AI responses based on YouTube video captions, create an API endpoint to fetch them.

Here's a code snippet you can use as a basis for easily implementing this. https://github.com/EliasPereirah/YoutubeSubtitlesDownloader