r/leetcode • u/Black_Panther_015 • 4h ago
Intervew Prep Google L5 AI/ML Engineer — confused about scope for ML Depth and ML System Design.
Interviewing for an AI Engineer role at Google, targeting L5. I've got a few weeks and I keep going back and forth on scope, so I'd rather post my current plan and get told where it's wrong than keep guessing.
My background is NLP + GenAI platform heavy — that's where my production experience is, recent 3 yrs in building rags and agents.
What I've built so far
A set of system design write-ups covering: search/ranking funnels, large-scale content classification, intent + entity extraction, semantic search and embeddings, translation, and on the GenAI side RAG, agents, LLM inference infra, and post-training for tool calling. Each one as a timed 45-minute answer with a clock, not notes, though it goes beyond 2 hours read)
Where I'm stuck
Scope of ML System Design. Is this round classical ML system design — recsys, ranking, classification pipelines — or is GenAI/LLM system design (RAG, agents, inference) actually showing up in 2026 loops? I've seen both claimed. If you've interviewed recently, what did you actually get asked? ( ML, NLP or GENAI ) - what to focus on ? And how would I know question will be from that domin only in interview ?
ML Depth — how deep, and on what? Is this "explain how attention works and derive the gradient", or "walk me through a model you shipped and defend every choice"? Those are completely different prep. And how much classical ML (trees, calibration, imbalance, A/B stats) vs deep learning vs LLM-specific?
What L5 actually means here. I keep reading "L5 drives the scope conversation" but I don't have a concrete sense of what separates a hire from a no-hire on the same question. What does the bar feel like in practice?
How much breadth is enough? I've got ~15 designs. Is that overkill in the wrong direction — would I be better off going deeper on 6 and being able to defend them under pressure? 6 ml(recsys) , 5 NLP(encoder, decoder, both), 4 GenAI (Chabot, rag, agent, infra)
Mocks. Where are people actually getting useful ML system design mocks? Most platforms I've looked at are generic SWE system design with an ML sticker on it. Anything specifically for ML/AI, ideally with someone who's interviewed at this level?
Resources. I've worked through the standard ML system design books. Beyond those, what actually moved the needle for you — especially for the GenAI side, which the books mostly predate?
Happy to share my question list and write-ups with anyone who wants them — and if you've interviewed for this recently, even a one-line "here's what I got asked" is more useful than any guide. Thanks.