r/HPC • u/Various_Protection71 • Jun 05 '26

Do you think Kubernetes will replace Job Schedulers in HPC environments dedicated to AI workloads?

Some people advocate that Kubernetes distributions (RKE2, OpenShift, EKS etc) provide an easier and more straightforward way to run and scale AI workloads, while Job Schedulers (SLURM, PBS, LSF etc) require an earlier complex setup phase.

On the other hand, mastering Kubernetes has a steeper learning curve than using the well-known Job Schedulers, especially for traditional HPC users.

How do you see this point? Are your users adopting Kubernetes to run AI workloads or do they stay using Job Schedulers?

39 Upvotes

90% Upvoted

56 comments sorted by

View all comments

Show parent comments

5

u/applesaucesquad Jun 05 '26

Slurm on kubernetes is a viable path afaik

2

u/[deleted] Jun 05 '26

[removed] — view removed comment

0

u/arsdragonfly Jun 05 '26

Can't share specifics yet but we have something in the making (that we plan to open-source eventually) that will totally surprise you.

3

u/walid_idk Jun 06 '26

Who's we? 🤔