开源软件名称：

开源软件地址：

开源软件介绍：

Volcano is a batch system built on Kubernetes. It provides a suite of mechanisms that are commonly required bymany classes of batch & elastic workload including: machine learning/deep learning, bioinformatics/genomics andother "big data" applications. These types of applications typically run on generalized domain frameworks likeTensorFlow, Spark, PyTorch, MPI, etc, which Volcano integrates with.

Volcano builds upon a decade and a half of experience running a widevariety of high performance workloads at scale using several systemsand platforms, combined with best-of-breed ideas and practices fromthe open source community.

Until June 2021, Volcano has been widely used around the world at a variety of industries such as Internet/Cloud/Finance/Manufacturing/Medical. More than 20 companies or institutions are not only end users but also active contributors. Hundredsof contributors are taking active part in the code commit/PR review/issue discussion/docs update and design provision. Weare looking forward to your participation.

NOTE: the scheduler is built based on kube-batch;refer to #241 and #288 for more detail.

Volcano is a sandbox project of the Cloud Native Computing Foundation (CNCF). Please consider joining the CNCF if you are an organization that wants to take an active role in supporting the growth and evolution of the cloud native ecosystem.

Overall Architecture

Talks

• Intro: Kubernetes Batch Scheduling @ KubeCon 2019 EU
• Volcano 在 Kubernetes 中运行高性能作业实践 @ ArchSummit 2019
• Volcano：基于云原生的高密计算解决方案 @ Huawei Connection 2019
• Improving Performance of Deep Learning Workloads With Volcano @ KubeCon 2019 NA
• Batch Capability of Kubernetes Intro @ KubeCon 2019 NA
• Intro: Kubernetes Batch Scheduling @ KubeCon 2019 EU

Ecosystem

• spark-operator
• kubeflow/tf-operator
• kubeflow/arena
• Horovod/MPI
• paddlepaddle
• cromwell

Quick Start Guide

Prerequisites

• Kubernetes 1.12+ with CRD support

You can try Volcano by one of the following two ways.

Note:

• For Kubernetes v1.17+ use CRDs under config/crd/bases (recommended)
• For Kubernetes versions < v1.16 use CRDs under config/crd/v1beta1 (deprecated)

Install with YAML files

Install Volcano on an existing Kubernetes cluster. This way is both available for x86_64 and arm64 architecture.

For x86_64:kubectl apply -f https://raw.githubusercontent.com/volcano-sh/volcano/master/installer/volcano-development.yamlFor arm64:kubectl apply -f https://raw.githubusercontent.com/volcano-sh/volcano/master/installer/volcano-development-arm64.yaml

Enjoy! Volcano will create the following resources in volcano-system namespace.

NAME                                       READY   STATUS      RESTARTS   AGEpod/volcano-admission-5bd5756f79-dnr4l     1/1     Running     0          96spod/volcano-admission-init-4hjpx           0/1     Completed   0          96spod/volcano-controllers-687948d9c8-nw4b4   1/1     Running     0          96spod/volcano-scheduler-94998fc64-4z8kh      1/1     Running     0          96sNAME                                TYPE        CLUSTER-IP      EXTERNAL-IP   PORT(S)   AGEservice/volcano-admission-service   ClusterIP   10.98.152.108   <none>        443/TCP   96sNAME                                  READY   UP-TO-DATE   AVAILABLE   AGEdeployment.apps/volcano-admission     1/1     1            1           96sdeployment.apps/volcano-controllers   1/1     1            1           96sdeployment.apps/volcano-scheduler     1/1     1            1           96sNAME                                             DESIRED   CURRENT   READY   AGEreplicaset.apps/volcano-admission-5bd5756f79     1         1         1       96sreplicaset.apps/volcano-controllers-687948d9c8   1         1         1       96sreplicaset.apps/volcano-scheduler-94998fc64      1         1         1       96sNAME                               COMPLETIONS   DURATION   AGEjob.batch/volcano-admission-init   1/1           48s        96s

Install from code

If you don't have a kubernetes cluster, try one-click install from code base:

./hack/local-up-volcano.sh

This way is only available for x86_64 temporarily.

Install monitoring system

If you want to get prometheus and grafana volcano dashboard after volcano installed, try following commands:

make TAG=latest generate-yamlkubectl create -f _output/release/volcano-monitoring-latest.yaml

Meeting

Community weekly meeting for Asia: 15:00 - 16:00 (UTC+8) Friday. (Convert to your timezone.)

Community biweekly meeting for America: 08:30 - 09:30 (UTC-8) Thursday. (Convert to your timezone.)

Community biweekly meeting for Europe: 11:00 - 12:00 (UTC+1) Thursday. (Convert to your timezone.)

Resources:

• Meeting notes and agenda
• Meeting link
• Meeting Calendar | Subscribe

Contact

If you have any question, feel free to reach out to us in the following ways:

Volcano Slack Channel

Mailing List