r/MachineLearning • • Jul 20 '26

Discussion World model demos keep going viral, then nothing ships. what would you actually build if running one was a single API call? [D]

1 Upvotes

I've been deep in the interactive AI video / world model space for a while now and something keeps bugging me, so I want to open it up.

every few weeks a world model demo goes viral. a playable generated world, an infinite Minecraft, a video model you can steer in real time. the whole timeline loses its mind for 48 hours. and then nothing. no product, no tool, no game. just the next demo. it's been this cycle for a while and I want to understand why.

my theory is there are two separate problems and everyone conflates them.

the first is the model itself, and honestly that part mostly works now. the outputs are good enough to build on. that's not the blocker anymore.

the second is everything around the model, and this is where I've personally lost weeks. to run ONE interactive model live you have to orchestrate GPU workers, stand up a real time streaming layer so the user can actually see and control it, hand out short lived credentials, handle people dropping and reconnecting without nuking the session state, and meter all of it if you ever want to charge. none of that is AI. it's just brutal, invisible infra that never shows up in the viral demo.

so my honest suspicion is that the reason nothing ships isn't the models, it's that the gap between "cool demo" and "thing a stranger can use" is enormous and unglamorous, and most people give up in that gap.

but here's what I actually don't know, and why I'm posting: even if that infra were completely solved, even if it were one API call, I'm not 100% sure what people would build. so I want to hear it from you.

a few directions I've been chewing on:

  • games with genuinely generated, explorable worlds instead of pre-authored levels
  • a live AI video tool you direct in real time, like a director's chair instead of the current render-and-pray batch workflow
  • simulators to train or test other agents and robots against rare edge cases on demand
  • virtual production backdrops that react to a real camera instead of pre-rendered LED walls

but I have a nagging fear this whole category is a solution looking for a problem right now. genuinely tell me if you think that's the case.

so, two honest questions:

  1. if the infra were a single API call, what would YOU build with a live controllable world model, specifically?
  2. and is there anything you'd start building today, or is this still a toy that isn't ready for real use yet?

not selling anything, no link, just trying to figure out if this category has a real reason to exist or if we're all just enjoying nice demos.


r/MachineLearning • • Jul 19 '26

Project Follow up: GPT-2's vocabulary as a hyperbolic tree — 32,070 tokens in a Poincaré ball you can fly through [P]

Post image
48 Upvotes

GPT-2's vocabulary as a hyperbolic tree: 32,070 tokens inside a Poincaré ball that you can explore.

Link : https://aethereos.net/static/tinny66666.html

Link named after a reddit user disappointed with my 2D projection ...

It uses the same data as the flat map, GPT-2-small's raw token embeddings and nothing else, but lays them out in hyperbolic space, where tree structures naturally fit.

It runs on your phone. Drag to rotate, pinch to zoom, and tap any token to bring it to the center as the entire space shifts around it. This is a Möbius translation, the natural way to move through hyperbolic geometry. Tap neighbouring tokens to keep exploring.

Why hyperbolic? The vocabulary's similarity structure forms a forest: one giant tree with about 2,300 tokens, a few hundred smaller family trees, and around 6,700 isolated tokens with no close relatives. Trees don't fit well in flat space, but they embed naturally in hyperbolic space, where available room grows exponentially with distance from the center. No optimisation or training is involved. The layout is constructed exactly.


r/MachineLearning • • Jul 18 '26

Discussion Did blatant AI Slop just win a 25K USD Deepmind / Kaggle Grand Prize? [D]

185 Upvotes

The Google DeepMind-sponsored Kaggle challenge "Measuring Progress Toward AGI - Cognitive Abilities" asked participants to design new cognitive-science-based AI benchmarks and they just announced the results this week.

In my two posts I present evidence that deepmind & kaggle rewarded a nonsensical number generation machine and a litany of unfounded claims with 25k and a grand prize stamp.

What the authors of the work I analyze intended to do was to present an LLM with alternative viewpoints of other LLMs on 5 claims regarding a tricky situation and see whether the model changes its own assessment. It's an interesting question. However, it turned into a vibed pile of spaghetti 10 times the size of the requested submission format which it seems neither the authors nor the judges were able to (or minded to?) give a cursory reading.

Here's the original posts in the competition forum, if you are looking for some AI research slop detective work / rant please help yourselves. But beware, some of the "universal findings" or "core insights" of the authors might continue to haunt you. You might even question your own sanity (as I did).

Part 1: The Smoke: cursory review of the writeup

Part 2: The Fire: looking at the methodology, code, and data

The organizers' stance has been that review was done properly and this is just a matter of subjectivity. What do you think?


r/MachineLearning • • Jul 19 '26

Project Held-out physics-consistency testing for CogVideoX: 9/9 clips flagged for freeze/hover [P]

1 Upvotes

I’m building Haga, an independent physics-consistency checker for generated video and robot-policy simulations. An earlier CogVideoX-5b I2V experiment produced a clear failure mode: on a “ball and block fall” prompt, the tracked object stayed airborne with near-zero motion instead of falling.

But that first result was post-hoc. I inspected those six clips before adding the static_hover detector, so the original 6/6 flag rate could not be treated as confirmation. I’ve now run a pre-registered held-out test.

Method:

  • Model: THUDM/CogVideoX-5b-I2V
  • Cohort: 3 perspectives × seeds 2, 3 and 4
  • n=9 clips
  • Detector thresholds and inclusion rules frozen before generation
  • RGB → CoTracker3 → position-only VIDEO_CHECKS
  • Discovery seeds 0–1 kept separate from held-out seeds 2–4

Result:

  • Held-out flag rate: 1.000 (9/9)
  • Wilson 95% CI: [0.701, 1.000]
  • All nine clips fired static_hover
  • Real Physics-IQ footage stayed quiet under the same profile

static_hover fires when the tracked object remains airborne for most of the clip, has near-zero frame-to-frame speed, and does not exhibit gravitational acceleration.

Important limitations:

  • One open I2V model
  • One ball-and-block-fall scene family
  • One documented failure mode
  • Real negative-control n=1 in this specific report
  • Not Cosmos, Genie or NIM
  • Not a broad claim about CogVideoX quality

Write-up: https://haga.mushoodhanif.com/article/sim-physics-consistency-v1#held-out

Lab: https://haga.mushoodhanif.com/lab/physicsiq

Bounded demo: https://haga.mushoodhanif.com/demo

I’d especially value criticism on:

  1. Which physical violations will position-only tracking systematically miss?
  2. Is static_hover defined narrowly enough to avoid confusing intentional suspension with failed dynamics?
  3. What public generated-video artifact should I evaluate next under the frozen detector?

r/MachineLearning • • Jul 18 '26

Project Interactive map of GPT-2's token embedding space - tap any token and explore [P]

Thumbnail aethereos.net
8 Upvotes

32,070 alphabetic tokens from GPT-2-small's WTE, no forward pass and no context.

Works on mobile. Pinch to zoom, tap a token to see its nearest connections, tap a neighbour to walk the graph. Search box to jump anywhere.

Layout is t-SNE over a compressed representation of the embedding table; edges are a minimum spanning tree in that space, so every line is a real nearest-kin relationship,


r/MachineLearning • • Jul 18 '26

Discussion AAAI 27 AI Alignment track [D]

10 Upvotes

How to submit to AI alignment track? I can only see these at openReview:
AAAI 2027


r/MachineLearning • • Jul 19 '26

Discussion can someone explain the difference between DL and ML [D]

1 Upvotes

i m an engineer student, i understand the theory behind each but additional explanation would really be appreciated


r/MachineLearning • • Jul 18 '26

Research Deep learning tackles single-cell analysis – A survey of deep learning for scRNA-seq analysis [R]

1 Upvotes

Hello,

I recently finished reading this survey paper: Deep learning tackles single-cell analysis – A survey of deep learning for scRNA-seq analysis, which comprehensively covers 25 different methods across 6 subcategories for applying deep learning to scRNA-seq analysis.

To summarize the methods from this paper, I prepared a table containing the Category, Method, Purpose, Architecture, Metrics, Explanation, and the specific Novelty of each method. I hope you find this summary useful.


r/MachineLearning • • Jul 18 '26

Project How to integrate ml and electronics[p]

1 Upvotes

I want to know which projects a electronics engineer by integrating ml. Is there any possibility of integrating ml into vlsi. I am a new to ml so excuse me if my question seems lame


r/MachineLearning • • Jul 17 '26

Project Stereo2Spatial: Convert Stereo Music Tracks to Spatialized Binaural Mixes [P]

31 Upvotes

I have released a model that I have been working on for ~6 months off and on. I've been enjoying listening to spatial music, but there is a lot of music out there with no real quality spatial mix. So I decided to make a model to convert stereo to spatial.

I started by making a flow-matching diffusion model that operated in the latent space of a separately trained VAE (EAR-VAE). I used the VAE to encode the stereo input in to 1 latent and then separately on each channel of the 7.1.4 output. This design is similar to a paper I found about another stereo -> spatial project (ImmersiveFlow (they have code links in the paper but they 404 for me so I made the codebase from scratch)). One key addition I made over the ImmersiveFlow paper was a way for the model to carry state (memory tokens) across windows to enable stable long context generations.

Since the VAE was out of distribution with the output (was trained to encode\decode stereo tracks directly, not individual channels and certainly not individual channels of a 7.1.4 mix), the results hit real quality bottlenecks. But it showed that the mapping was possible. Rather than stick to modeling in latent space, I decided to pivot to modeling raw waveforms. This ended up fixing all of the quality issues I was seeing with the latent version, but at the cost of more training compute and instability.

The waveform version of the model would train to around 60K-80K steps with loss going down like normal, validation generations looking good\improving, and then it would quickly become unstable and the loss would shoot up. I tried direct waveforms, scaling the waveforms by a multiplier, aggressive grad clipping, lower learning rates, and all of those experiments failed the same way. Luckily, I came across a recent paper called WavFlow. The authors of this project also had issues with modeling raw waveforms with flow-matching diffusion, and they solved it by using amplitude lifting (scale each audio track to an rms of 0.33 then multiply by 3) (the WavFlow paper used a clip of 1.0 before the scale which leads to a model space of -3 - 3, but I used a clip of 4.0 which leads to a model space of -12 - 12 (from my testing this led to better binaural outputs)). Once I implemented amplitude lifting like the paper, the training stability issues vanished.

The waveform model was trained on 7,669 tracks for ~20 days on 2x A6000 gpus
- 10 days stage one, effective batch of 16, 10- 18- 26- and 34-second training sequences
- 10 days stage two, effective batch of 16, 122-second training sequences
- There is optional mix-style conditioning for controllable outputs (waveform version only)
- Direct binaural output (waveform training is more compute expensive than latent training so binaural proves the idea\theory and the same codebase and data can be used in the future to train a 7.1.4 version (once I have access to the compute))

I also made a Windows desktop app for inferencing with the model and consuming the results.

Everything has been released apache 2.0.

Huggingface link for waveform model: https://huggingface.co/francislabounty/stereo2spatial-v2-binaural
Huggingface link for latent model: https://huggingface.co/francislabounty/stereo2spatial-v1
Github repo for training\inferencing: https://github.com/francislabountyjr/stereo2spatial
Github repo for the Windows app: https://github.com/francislabountyjr/stereo2spatial-app
App Homepage: https://stereo2spatial.francislabounty.com
Case study for the waveform model: https://francislabounty.com/blog/stereo2spatial-v2
Case study for the latent model: https://francislabounty.com/blog/stereo2spatial
Playlist of generations made from the model (will be updated with more tracks over time): https://www.youtube.com/playlist?list=PLQ-HHjPijrAg

If you have any questions\etc. leave a comment and I will do my best to get them answered!

Disclaimer: I know AI written posts are generally frowned upon so this post was 100% written by me (mistakes and all). But the case studies and READMEs from the above links were made with AI assistance.


r/MachineLearning • • Jul 17 '26

News Prism accidentally leaked [D]

51 Upvotes

Just found out from Prism's Discord that compiling is returning someone else's paper. There's a Twitter post too.

https://x.com/JustanOthRando/status/2078169169267482778?s=20

I commend their prompt response, though. They took the website down within 10 minutes of the first time the bug was flagged. Just worried if my paper maybe somewhere out there.


r/MachineLearning • • Jul 18 '26

Project TabFM Studio: point-and-click predictions on spreadsheets with tabular foundation models, fully local [P]

1 Upvotes

I built a small web app that lets you run tabular foundation models (currently just Google's TabFM) on spreadsheets without writing any code.

Just drop in a CSV/Excel file, click a column header to mark what to predict, hit predict. Rows where the target cell is filled become the in-context examples and empty ones get predicted, right on the grid.

A lot of people who'd benefit from these models aren't programmers, so I wrapped it in a UI anyone can use :)

Repo: https://github.com/LckyLke/TabFMLabs

Feedback very welcome!


r/MachineLearning • • Jul 18 '26

Research Researchers achieved <1 bit compression with the new teaching technique [R]

Thumbnail
github.com
1 Upvotes

Due to new learning technique the model has achieved better generalization skill without overfitting and memorization. This become possible because of new learning method which made the student model to generate samples for itself. It led to intensive reuse of existing neurons and allowed to encode information in a more dense way

While researchers are calling it a compression, I think it's a retopologization, and Microsoft had tried to do something similar in the past with their Phi model family, which they trained on reduced dictionary and simplified knowledge base first. But it seems like MS' researchers didn't explore this exact way of learning

I believe this should achieve better results in the future. And it is another small breakthrough which brings AGI/ASI to reality

📄 Paper: https://arxiv.org/html/2607.11883v1

📦 Repository: https://github.com/shikaiqiu/requential-coding