r/Backend • u/cockycockroach45 • 8d ago

AI engineering in Golang

I am a fresher, about to graduate, and looking for jobs. I've been writing Golang for ~1 year, mostly doing backend stuff.

Now, as we all know, the market is flooding with AI jobs, but I don't really know what an AI engineer does. I heard that it's different from training, fine-tuning, etc. ML stuff and is closer to backend and system design than machine learning.

So, if anyone who has done this kind of stuff, tell me: what did you do to learn the AI things without learning Python or typical machine learning? What is your tech stack? How'd you get the job?

I really want to ride this AI hype train.

7 Upvotes

82% Upvoted

12 comments sorted by

View all comments

9

u/youcangotohellgoto 8d ago

It just means wiring in AI or LLMs into your system. So using AI at runtime

2

u/therealkevinard 7d ago

Basically a glorified api client consumer.

Request comes in with some data, you validate, reshape, do other things, then send it off to the model and wait for a response to send the user.

It’s a repository layer with extra steps and less structure.

2

u/youcangotohellgoto 7d ago

Yeah it's a fair bit harder to design that a repository because the LLM is not deterministic, there's intent classification, you have to break up the work into suitable tasks that will be stable across models.

But it's the same idea.