Best practices for testing schedulers.

[hwdef]

I want to test some scenarios using 3rd party scheduler like volcano. But I don't understand how to use kwok in this scenario.These are my steps:

1. install kwok
2. kwokctl create cluster --name=kwok
3. create a fake node https://kwok.sigs.k8s.io/docs/user/kwok-manage-nodes-and-pods/#create-a-node
4. install volcano kubectl create -f https://raw.githubusercontent.com/volcano-sh/volcano/master/installer/volcano-development.yaml

and I got this error

NAMESPACE        NAME                                   READY   STATUS    RESTARTS   AGE
volcano-system   volcano-admission-6cd4c958c9-l2pkl     0/1     Pending   0          9m24s
volcano-system   volcano-admission-init-mhzv8           0/1     Pending   0          9m24s
volcano-system   volcano-controllers-7d7c4bb8b6-7j4qq   0/1     Pending   0          9m24s
volcano-system   volcano-scheduler-7db897f747-7lb9f     0/1     Pending   0          9m24s

Warning  FailedScheduling  4m14s  default-scheduler  0/1 nodes are available: 1 node(s) had untolerated taint {kwok.x-k8s.io/node: fake}. preemption: 0/1 nodes are available: 1 Preemption is not helpful for scheduling.

My needs:

1. Deploy volcano
2. Create some fake nodes, each node has different resources
3. Create some pods to be scheduled by volcano
4. pods are scheduled to those fake nodes according to volcano’s scheduling policy

[wzshiming]

kwok itself does not actually run the container see more

I recommend using kwokctl to create a cluster without a scheduler, and then using kubeconfig to schedule the pods from an external scheduler.

kwokctl create cluster --disable-kube-scheduler

external-scheduler --kubeconfig ~/.kube/config

The following are cases for some projects
Istio
Linkerd
Argo
KubeVirt
Kyverno
YuniKorn
Karmada
Karpenter
KubeAmiral
MCAD

[hwdef]

Thanks, I will try this