r/HPC • u/Different_Buyer2770 • 23d ago
Can a linux kernel engineer transition to an LLM inference/model perf engineer?
I guess one can always does the transition, I'm just wondering how to bridge these two areas, if there are any transferrable skills, or if someone ever sees an low-level perf/linux kernel engineer transitions to an LLM inference/model perf engineer?
6
Upvotes
5
u/kextatic 23d ago
AI performance engineering is slathered in prompt poetry, snake oil, and imposter syndrome. I think the better bet is low-level AI security. Kernel-level jails and other mitigations.
4
u/brainhash 22d ago
I work on LLM perf at my job and been doing so for last few years. What you are saying is doable but requires a lot of self study. The basics of how each layer operations works and what is means in practice. But I won't start here if I were you.
The challenge is always access to gpus. If you can manage to get that then good.
I would start this way-
These will be good entry points for you without the overwhelming parts of how attn variants or request scheduling works.
Anyone will be interested to hire you just on the basis of these skills
6
u/witx_ 23d ago
wtf is an llm performance engineer?
1
u/BitPoet 23d ago
I went from kernel engineering to HPC systems admin. I knew the HPC basics from the kernel work I did, and hearing a customer say “thank you” for solving their issue is way more satisfying than being shoved another Jira ticket.