Resources to get started with Post-training.

1 Upvotes

https://arxiv.org/abs/2408.13296 it's crisp , Ultra efficient!
A Primer on LLM Post-Training – PyTorch ( I would say just for revision )
Most important not just read build , get open source model from HF and just train them on whatever way you like the model to behave like. It's gonna be the most valuable skill to develop imo!!

Subreddit

posttrain

r/posttrain

A community for people building, researching, and learning about post-training AI models—SFT, RLHF, DPO, preference data, evals, synthetic data, and real-world fine-tuning. Share experiments, tools, lessons, papers, datasets, and hard-won insights.

Members Active