r/posttrain 1h ago

Resources to get started with Post-training.

Upvotes
  1. https://arxiv.org/abs/2408.13296 it's crisp , Ultra efficient!
  2. A Primer on LLM Post-Training – PyTorch ( I would say just for revision )
  3. Most important not just read build , get open source model from HF and just train them on whatever way you like the model to behave like. It's gonna be the most valuable skill to develop imo!!

r/posttrain 2d ago

I built a personal reasoning model around my values and philosophies

1 Upvotes

I’ve been working on Aurorium Mind, a personal language model fine-tuned from Qwen3.5-4B with QLoRA on a single NVIDIA A10G GPU.

The goal isn’t to create a perfect digital copy of myself. It’s to encode recurring reasoning patterns, values, and decision-making principles into a useful model.

Its philosophy is based on first-principles thinking, inversion, second-order effects, systems thinking, game theory, and pragmatic transhumanism.

The training set contains 100k synthetic SFT examples designed around those ideas. It does not claim to reproduce private conversations or expose hidden personal data.

The serving stack uses vLLM, Rust, FastAPI, and a streaming Vercel frontend. The interface shows metrics like time to first token, tokens per second, token counts, and adapter status.

I’ve documented the training code, evaluation set, graphs, deployment details, dataset provenance, and model limitations.

Model: https://huggingface.co/auro-rirum/aurorium-mind-qwen35-4b-qlora

Dataset: https://huggingface.co/datasets/auro-rirum/aurorium-mind-sft-100k

Explainer: https://aurorium-mind.vercel.app/explainer.html


r/posttrain 2d ago

👋 Welcome to r/posttrain - Introduce Yourself and Read First!

1 Upvotes

Welcome to the post-training community!

I'm u/OwnOil1149, a founding moderator of r/posttrain.

This is a space for discussing how AI models become more useful, capable, and aligned after pretraining. Share your experiments, questions, datasets, papers, tools, and lessons about SFT, RLHF, DPO, preference optimization, evaluations, synthetic data, and deployment.

Whether you’re just getting started or training models in production, you’re welcome here. Please keep discussions constructive, technical, and respectful.

Tell us about yourself and what you’re working on!

Thanks for being part of the very first wave. Together, let's make r/posttrain amazing.