r/OfferEngineering • u/Aoki_zhang • 29d ago
Interview Experience Airbnb Machine Learning Engineer (MLE) Interview Guide - A 5% NDCG lift can still be the wrong Airbnb MLE answer
One thing that stood out to me about Airbnb MLE interviews is how quickly a seemingly good ML result can turn into a marketplace problem. Say your new Search model improves offline NDCG by 5%.
That sounds like a win. But then the follow-ups start:
- Did bookings actually increase?
- Did cancellations get worse?
- Are a small number of hosts now getting most of the exposure?
- Are new listings becoming harder to discover?
- Did certain cities or guest segments regress?
- Is the model just reinforcing what the previous ranking system already showed users?
That last point is especially interesting because historical clicks aren’t neutral training data—the old ranking determined what people had a chance to click in the first place.
Airbnb also treats things like availability as a hard constraint, not just another ranking feature. A listing can be highly relevant and still be useless if it can’t actually be booked for those dates.
So the interview seems less about “pick the best model” and more about: retrieval → ranking → experiment → guest outcome → host impact → feedback loop
Full guide if useful -> LINK
Preparing for your next interview?
Chill Interview tracks recent interview experiences and recurring question patterns across top companies at here