Home

Awesome

KubeRay

Build Status Go Report Card

KubeRay is a powerful, open-source Kubernetes operator that simplifies the deployment and management of Ray applications on Kubernetes. It offers several key components:

KubeRay core: This is the official, fully-maintained component of KubeRay that provides three custom resource definitions, RayCluster, RayJob, and RayService. These resources are designed to help you run a wide range of workloads with ease.

Community-managed components (optional): Some components are maintained by the KubeRay community.

Documentation

From September 2023, all user-facing KubeRay documentation will be hosted on the Ray documentation. The KubeRay repository only contains documentation related to the development and maintenance of KubeRay.

Quick Start

Examples

Kubernetes Ecosystem

External Blog Posts

  1. Evolving Niantic AR Mapping Infrastructures with Ray Niantic (September 6, 2023)
  2. Building a Modern Machine Learning Platform with Ray at Samsara Samsara (August 29, 2023)
  3. Using Ray on Kubernetes with KubeRay at Google Cloud Google (August 15, 2023)
  4. How DoorDash Built an Ensemble Learning Model for Time Series Forecasting with KubeRay Doordash (June 20, 2023)
  5. AI/ML Models Batch Training at Scale with Open Data Hub Red Hat (May 15, 2023)
  6. A cloud-native, open-source stack for accelerating foundation model innovation IBM (May 9, 2023)
  7. Distributed Machine Learning at Instacart Instacart (March 17, 2023)
  8. Unleashing ML Innovation at Spotify with Ray Spotify (February 1, 2023)
  9. Best Practices For Ray Cluster On ACK Alibaba Cloud (Mar 12, 2024)

Talks

  1. Supercharge Your AI Platform with KubeRay Anyscale + Google (November 8, 2023)
  2. Sailing Ray Workloads with KubeRay and Kueue in Kubernetes Volcano + DaoCloud (October 17, 2023)
  3. Serving Large Language Models with KubeRay on TPUs Google (September 19, 2023)
  4. KubeRay: A Ray Cluster Management Solution on Kubernetes Anyscale (September 18, 2023)
  5. The Different Shades of using KubeRay with Kubernetes Microsoft (September 18, 2023)
  6. On-Demand Ray Clusters in ML Workflows via KubeRay & Sematic Sematic (September 18, 2023)
  7. KubeRay - A Kubernetes Ray Clustering Solution Microsoft (February 8, 2023)
  8. KubeRay x Flyte Integration Flyte (August 24, 2022)
  9. Operationalizing Ray Serve on Kubernetes Anyscale (August 24, 2022)

Helm Charts

KubeRay Helm charts are hosted on the ray-project/kuberay-helm repository. Please read kuberay-operator to deploy the operator and ray-cluster to deploy a configurable Ray cluster. To deploy the optional KubeRay API Server, see kuberay-apiserver.

# Add the Helm repo
helm repo add kuberay https://ray-project.github.io/kuberay-helm/
helm repo update

# Confirm the repo exists
helm search repo kuberay --devel

# Install both CRDs and KubeRay operator v1.1.0.
helm install kuberay-operator kuberay/kuberay-operator --version 1.1.0

# Check the KubeRay operator Pod in `default` namespace
kubectl get pods
# NAME                                READY   STATUS    RESTARTS   AGE
# kuberay-operator-6fcbb94f64-mbfnr   1/1     Running   0          17s

Development

Please read our CONTRIBUTING guide before making a pull request. Refer to our DEVELOPMENT to build and run tests locally.

Getting Involved

Join Ray's Slack workspace, and search the following public channels:

Security

If you discover a potential security issue in this project, or think you may have discovered a security issue, we ask that you notify KubeRay Security via our Slack Channel. Please do not create a public GitHub issue.

License

This project is licensed under the Apache-2.0 License.