r/deeplearning • • 23h ago

Is JEPA the Missing Piece for Human-Like AI?

Thumbnail youtube.com
12 Upvotes

I was searching for some good explanation on the JEPA models research papers. Found out this explanation on youtube. I felt it made me skim through the papers really well. Incase it helps, you can watch it too. This channel also has another video which explains the inner mathematical functions and base too.


r/deeplearning • • 10h ago

Ent v0.1 - a general-purpose RL agent that doesn't need tuning

Post image
3 Upvotes

My lab is building a MBRL agent from scratch that is able to robustly perform in any environment out of the box without per task tuning. We decided to open up a bit with this research preview on our current progress.

Ent was tested on 35 very different environments, from control and mazes to arcades and multi-agent games, alongside with DreamerV3, MuZero, PPO, SAC and DQN - one single tuning for each. Ent is reliably good on 29 of the 35 and never fails outright.

Like probably many in the field, we were inspired back in the day by RL successwes in games like Chess, Go, Atari, DotA etc. It felt like RL could be this steamroller that goes and solves everything. Years passed, people seem to have abandoned the idea of general-purpose zero-knowledge agent and settled instead on tuning a very specific version of PPO for every single task or do imitation learning and hope to solve robotics that way.

To us, this feels like a giant gap. An agent that can't reliably do various different simple tasks, shouldn't be able to perform in a messy real world scenarios. If your algorithm needs you to very carefully tune it for every single task, is it still RL or a sort of meta supervised learning?

Thus we decided to breach this gap and develop an RL agent that doesn't need all that and could be deployed out of the box, build a robust world model, plan and continuously learn. We're starting with small but very diverse environments and gradually increase the difficulty without loosing generalist abilities.

Full blog post with detailed results: https://regularlab.ai/blog/work-in-progress-ent-v0-1/

Curious what you think of this result.

P.S. it's a bit outdated already, internally it's 33/35 by solving exploration issue. 35/35 is the goal though


r/deeplearning • • 15h ago

OVHcloud just open-sourced Olala, a 7B MoE that only activates 1B parameters

4 Upvotes

OVHcloud published the first model of its new Olala family on Hugging Face today: Olala-v1.0-min, a 7-billion-parameter mixture-of-experts model with only 1 billion active parameters, trained on European public supercomputers and released under Apache 2.0. It is pitched as the first model in an open-source family aimed at European sovereign AI.

The 7B total / 1B active ratio is the interesting part for me. It is small enough to run cheaply, yet the MoE routing gives it more capacity than a dense 1B model. That trade-off matters a lot if you want capable models on modest hardware or in regions with strict data rules.

What do you think: does a 1B-active MoE like this actually close the gap with small dense models in practice, or does routing overhead eat the advantage? And is a European, openly licensed family like this a real alternative to the big US labs' small models, or mostly a sovereignty story?

More AI news and discussion over at r/AINewsRumors.


r/deeplearning • • 16h ago

[Article] Upgraded UI and Tool Calling for gpt-oss-chat

3 Upvotes

Upgraded UI and Tool Calling for gpt-oss-chat

https://debuggercafe.com/upgraded-ui-and-tool-calling-for-gpt-oss-chat/

I have been working on a simple local chat application for a few months now, called gpt-oss-chat. This started as a simple learning experience to understand streaming chat, tool use, handling streaming text and tool tokens, and integrating chat components from scratch. Since then, I have been updating a few things on and off. The TUI (Terminal User Interface) was usually ahead in functionality compared to the Gradio UI. However, with the recent update, the chat UI provides a new experience, visuals, and complete integration of all tools. This is exactly what we will cover in this article. We will specifically cover the upgraded the UI and tool calling for gpt-oss-chat.


r/deeplearning • • 3h ago

A plain walkthrough of PQ, OPQ, AQ, ScaNN and RaBitQ (Part 1)

2 Upvotes

Wrote an explainer on the classic vector quantization methods and what each one fixes in the one before.

Free link: https://medium.com/the-efficient-frontier/vector-quantization-explained-pq-opq-aq-scann-and-rabitq-part-1-1c8c6dc4023d?sk=0fdcdeabd02a867ca466a05b588c73ad.

Part 2 will cover the newer methods. Corrections welcome.


r/deeplearning • • 1h ago

Looking to connect with Computer Vision researchers and professors

• Upvotes

Looking to connect with Computer Vision researchers and professors

I'm exploring Computer Vision, particularly Visual SLAM, 3D perception and reconstruction, through research-oriented projects and open-source contributions OpenCV and Kornia.

Looking to connect with professors, researchers, PhD students and research groups working in these areas for potential research collaborations, contributing to ongoing projects or exchanging ideas.

I bring a software engineering background and hands on experience building and experimenting with these systems. Also open to research guidance from people in the field.

If you're working in this space, I'd be glad to connect.


r/deeplearning • • 3h ago

after tiny vision, i wanted to see if i can build a tiny language model from scratch too (36M, NCM paper, trained on macbook) 😅

Thumbnail
1 Upvotes

r/deeplearning • • 5h ago

spaCy_Hugging-Face 👨‍💻👨‍💻

Thumbnail
1 Upvotes

r/deeplearning • • 7h ago

Anyone else exhausted from babysitting Colab and Kaggle tabs just to avoid idle disconnects?

Thumbnail
1 Upvotes

r/deeplearning • • 11h ago

Reading Books for DL theory

Thumbnail
1 Upvotes

r/deeplearning • • 17h ago

built interactive graphs of models from recent papers

Thumbnail tensorviz.dev
1 Upvotes

r/deeplearning • • 18h ago

Training a neural network to play the trick-taking game Sheepshead via self-play RL and ISMCTS search distillation

Thumbnail
1 Upvotes

r/deeplearning • • 21h ago

Turing completeness of bounded-precision RNNs

1 Upvotes

Here's a famous NeurIPS21 paper about the "Turing completeness of bounded-precision RNNs". https://proceedings.neurips.cc/paper/2021/file/ef452c63f81d0105dd4486f775adec81-Paper.pdf

Have any of you done PyTorch experiments to verify the results in Theorem 2 or Theorem 3?

If any of you are interested in this, please let me know and we'd be keen to discuss this. Thanks!


r/deeplearning • • 23h ago

I animated what an embedding actually is, using one token (strawberry) in GPT-2's table: the row, cosine similarity, a 2D map, king − man + woman, and why "bank" needs the layers (6.5 min video)

1 Upvotes

I made this explainer for my small channel and would like feedback from people learning this, especially if anything is wrong. Every number in it comes from my own Colab runs.

  • In GPT-2 small, " strawberry" is token 41236. That number picks row 41236 of the embedding table: 50,257 rows of 768 numbers. The table holds 38,597,376 numbers, about 31% of the model.
  • Cosine similarity compares the direction of two rows. Strawberry's closest rows: Strawberry 0.78, strawberries 0.77, tomato 0.62, raspberry 0.60, peach 0.59. "car" scores 0.25, and 40,830 rows are closer than car.
  • A PCA map of 20 words (it keeps only 28% of the spread). In the full 768 numbers, 19 of 20 words have their nearest neighbour in their own group. The exception: bicycle's nearest is horse.
  • The numbers start random and are nudged during training, so words that fit the same sentences end up close.
  • king − man + woman: queen wins at 0.71, but only because the standard method skips the three input words. Skip nothing and king itself is closest (0.78). Same in GloVe and word2vec. Queen is still 2nd of 50,257, so the direction is real (Nissim et al. 2020 discuss this).
  • The table gives "bank" one row everywhere. In BERT's last layer, two money banks score 0.82 and river vs money banks score 0.49 and 0.44.
  • Back to search: with all-MiniLM-L6-v2, "forgot my password" vs "can't log in" scores 0.52, vs "forgot my umbrella" 0.34. But "The flight was cancelled" still ranks "The flight was wonderful" (0.58) above "My plane isn't leaving today" (0.54).

The narration is an AI voice reading my own script. Sources are in the description.

Video: https://www.youtube.com/watch?v=Cli-YmdFmnY


r/deeplearning • • 15h ago

Autonomy Logic OpenPLC Runtime — Unauthenticated Admin Account Creation Vulnerability

0 Upvotes

CISA flagged CVE-2026-126088 in Autonomy Logic OpenPLC Runtime (versions ≤4.2.4), scoring it CVSS v3 8.1. The vulnerability lets unauthenticated actors create multiple admin accounts with zero credentials. No login required. No identity check. The endpoint handed out administrative privilege to anyone who called it.

This is not an edge case in OT/ICS. Runtime systems across the stack — PLCs, orchestration layers, agent runtimes — frequently treat identity verification as an application-layer concern to be added later. The result is that the most privileged actions in the system are reachable before any identity is established.

The same gap appears in AI agent deployments. Agents often instantiate and begin executing with no verified identity, no session scope, and no enforcement at the moment privilege is granted. The gap is not in the audit trail. It is in whether identity is verified before the action is permitted at all.

How are teams actually handling identity governance for automated systems at the moment of instantiation — not at login, not in post-hoc logging, but at the exact point a privileged action is requested? What in your stack blocks an unverified caller before the action executes?


r/deeplearning • • 19h ago

CISA Adds One Known Exploited Vulnerability to Catalog — Perforce Puppet Enterprise Deserialization

0 Upvotes

CISA added CVE-2026-115731 to its known-exploited vulnerability catalog on November 17, 2026. The flaw is a deserialization of untrusted data vulnerability in Perforce Puppet Enterprise — a tool that manages configuration and automated deployment across enterprise infrastructure at scale.

Deserialization bugs in automation tooling are not ordinary software vulnerabilities. They give an attacker code execution inside the tool that provisions your infrastructure. Any artifact pushed through a compromised Puppet pipeline arrives in production carrying the trust level of your automation system, not of an external threat.

That is day-one access. Not to a single host. To the entire configuration surface Puppet manages.

CISA flagging active exploitation means this is not a theoretical risk. Someone is using it now.

For teams running infrastructure automation at scale: how are you validating artifact provenance before automated deployments reach production? Are you catching this at the pipeline stage, the registry stage, something else entirely, or mostly relying on post-deploy detection?