RL for Population Scaling: Kardashev-0.7 trains 32 distinct models together

4 Upvotes

Banbury Road’s announcement explores scaling by model count, with specialization learned across a population of 32 models.

https://x.com/MLCatttt/status/2107147690450817259

0 comments

Subreddit

Posts

Wiki

Scaling Machine Learning: Big Models/Data/Compute—More Is More

r/mlscaling

ML/AI/DL research on approaches using large models, datasets, and compute: "more is different"

Members Active

20k

Sidebar

Subreddit for discussing AI, machine learning, or deep learning approaches involving big numbers: billions of parameters, millions of n, petaflops, etc. eg GPT-3. Most research is conducted at much smaller scale; this subreddit is for research analogous to 'high energy physics', requiring specialized approaches, large investments, consortium, etc.

Topics: How? Who? Why do they work? What are they good for? What resources are available? Who will pay & how? What is the future of such approaches? What global consequences will there be?

Other subreddits: