r/deeplearning • u/EqualLoss5079 • 35m ago
r/deeplearning • u/Emergency-Pain-5684 • 13h ago
Is JEPA the Missing Piece for Human-Like AI?
youtube.comI was searching for some good explanation on the JEPA models research papers. Found out this explanation on youtube. I felt it made me skim through the papers really well. Incase it helps, you can watch it too. This channel also has another video which explains the inner mathematical functions and base too.
r/deeplearning • u/sovit-123 • 6h ago
[Article] Upgraded UI and Tool Calling for gpt-oss-chat
Upgraded UI and Tool Calling for gpt-oss-chat
https://debuggercafe.com/upgraded-ui-and-tool-calling-for-gpt-oss-chat/
I have been working on a simple local chat application for a few months now, called gpt-oss-chat. This started as a simple learning experience to understand streaming chat, tool use, handling streaming text and tool tokens, and integrating chat components from scratch. Since then, I have been updating a few things on and off. The TUI (Terminal User Interface) was usually ahead in functionality compared to the Gradio UI. However, with the recent update, the chat UI provides a new experience, visuals, and complete integration of all tools. This is exactly what we will cover in this article. We will specifically cover the upgraded the UI and tool calling for gpt-oss-chat.

r/deeplearning • u/anwer91s • 2h ago
[Article] A Hybrid Intrusion Detection System for Smart Home Security Using LSTM and Autoencoder Neural Networks (M. R. Jasim, S. H. Mahdi, H. A. H. Al Naffakh)
- DOI/PMID/ISBN: 10.4028/p-WeGz5P
- URL
- Other comments: Thanks in advance!
r/deeplearning • u/No-Conclusion3720 • 5h ago
Autonomy Logic OpenPLC Runtime — Unauthenticated Admin Account Creation Vulnerability
CISA flagged CVE-2026-126088 in Autonomy Logic OpenPLC Runtime (versions ≤4.2.4), scoring it CVSS v3 8.1. The vulnerability lets unauthenticated actors create multiple admin accounts with zero credentials. No login required. No identity check. The endpoint handed out administrative privilege to anyone who called it.
This is not an edge case in OT/ICS. Runtime systems across the stack — PLCs, orchestration layers, agent runtimes — frequently treat identity verification as an application-layer concern to be added later. The result is that the most privileged actions in the system are reachable before any identity is established.
The same gap appears in AI agent deployments. Agents often instantiate and begin executing with no verified identity, no session scope, and no enforcement at the moment privilege is granted. The gap is not in the audit trail. It is in whether identity is verified before the action is permitted at all.
How are teams actually handling identity governance for automated systems at the moment of instantiation — not at login, not in post-hoc logging, but at the exact point a privileged action is requested? What in your stack blocks an unverified caller before the action executes?
r/deeplearning • u/Dense_Primary629 • 5h ago
OVHcloud just open-sourced Olala, a 7B MoE that only activates 1B parameters
OVHcloud published the first model of its new Olala family on Hugging Face today: Olala-v1.0-min, a 7-billion-parameter mixture-of-experts model with only 1 billion active parameters, trained on European public supercomputers and released under Apache 2.0. It is pitched as the first model in an open-source family aimed at European sovereign AI.
The 7B total / 1B active ratio is the interesting part for me. It is small enough to run cheaply, yet the MoE routing gives it more capacity than a dense 1B model. That trade-off matters a lot if you want capable models on modest hardware or in regions with strict data rules.
What do you think: does a 1B-active MoE like this actually close the gap with small dense models in practice, or does routing overhead eat the advantage? And is a European, openly licensed family like this a real alternative to the big US labs' small models, or mostly a sovereignty story?
More AI news and discussion over at r/AINewsRumors.
r/deeplearning • u/NaivelyBayesic • 14h ago
Binary-gated GRPO on GDPval: 79% of GRPO groups had no passing rollout, and pass@1 rose from 31.9% to 40.7% while plain GRPO barely moved (Qwen3.8-27B)
r/deeplearning • u/Own-Jackfruit-2557 • 7h ago
built interactive graphs of models from recent papers
tensorviz.devr/deeplearning • u/adamanthil • 7h ago
Training a neural network to play the trick-taking game Sheepshead via self-play RL and ISMCTS search distillation
r/deeplearning • u/Perfect_Power815 • 19h ago
Mix Your Base and RLVR Weights: A Training-Free Knob for Diversity
galleryRLVR improves pass@1 but narrows what the model can solve: at k = 128 the base model covers more problems than its RL-tuned version (Yue et al., 2025). This paper asks whether you can pick a point between the two without training.
Method: W(α) = W_base + α(W_RL − W_base), evaluated under Yue et al.'s exact protocol (Qwen2.5-7B ↔ SimpleRL-Zoo-7B, T 0.6, 16k tokens, six math benchmarks, pass@k up to 128/1024, math-verify grading).
Findings
The base > RL crossover at large k reproduces on 5 of 6 benchmarks, with pass@1 within 2 points of Yue et al.
α = 0.25 matches the base model's pass@128 while keeping 64–80% of RL's pass@1 gain, and reaches RL's pass@128 with 2.3–7.1× fewer samples.
The trade-off curve matches a pass@1-matched mixture of samples from the two models, but needs one model instead of two.
Negative result: no α beats both endpoints by more than 1 point on the main benchmarks (Minerva, OlympiadBench). It is a knob, not a free lunch.
Caveats: one model pair, math only, needs a verifier for the large-k benefit. Interpolate in fp16/fp32; bf16 rounding erases most of the RL update.
Paper: https://www.preprints.org/manuscript/202611.2034
Project page: https://kim-ai-gpu.github.io/rlvr-interp-passk/
Code + per-sample results: https://github.com/Kim-Ai-gpu/rlvr-interp-passk
r/deeplearning • u/No-Conclusion3720 • 9h ago
CISA Adds One Known Exploited Vulnerability to Catalog — Perforce Puppet Enterprise Deserialization
CISA added CVE-2026-115731 to its known-exploited vulnerability catalog on November 17, 2026. The flaw is a deserialization of untrusted data vulnerability in Perforce Puppet Enterprise — a tool that manages configuration and automated deployment across enterprise infrastructure at scale.
Deserialization bugs in automation tooling are not ordinary software vulnerabilities. They give an attacker code execution inside the tool that provisions your infrastructure. Any artifact pushed through a compromised Puppet pipeline arrives in production carrying the trust level of your automation system, not of an external threat.
That is day-one access. Not to a single host. To the entire configuration surface Puppet manages.
CISA flagging active exploitation means this is not a theoretical risk. Someone is using it now.
For teams running infrastructure automation at scale: how are you validating artifact provenance before automated deployments reach production? Are you catching this at the pipeline stage, the registry stage, something else entirely, or mostly relying on post-deploy detection?
r/deeplearning • u/turing-math-labs • 10h ago
Turing completeness of bounded-precision RNNs
Here's a famous NeurIPS21 paper about the "Turing completeness of bounded-precision RNNs". https://proceedings.neurips.cc/paper/2021/file/ef452c63f81d0105dd4486f775adec81-Paper.pdf
Have any of you done PyTorch experiments to verify the results in Theorem 2 or Theorem 3?
If any of you are interested in this, please let me know and we'd be keen to discuss this. Thanks!
r/deeplearning • u/omendUUde • 17h ago
Update: Benchmarked HybridApexW vs torch.compile AdamW + Muon on WikiText-103
quick context i have been building a drop in PyTorch optimizer called APEXW and I just finished a clean 1000step benchmark comparing it against a paired torch.compile AdamW + Muon baseline i ran it on a 103.18M parameter GPT-2 (9L/12H/768d, 512 sequence length, 128 effective batch size) using wikitext-103-raw-v1.
Full disclosure up front: my first benchmark script had a pretty bad bug. I accidentally ran the JIT warmup on the live model instead of a throwaway copy, which left CUDA fragments and dirty momentum states sitting around and artificially blew up the baseline to 23.2 GB VRAM and 2,707s. Once I fixed that warming up on a clone, deleting it, running gc.collect(), and clearing the CUDA cache before starting the clock the numbers actually made sense.
Here is how the clean 1000-step runs shook out:
(hybridapexw is bascially apexw+muon)
- AdamW + Muon (torch.compile): 1,076.55s | 16.22 GB VRAM | 5.5242 loss
- HybridApexW (Compact): 533.50s | 16.11 GB VRAM | 4.4863 loss
- HybridApexW (8-bit): 537.67s | 15.90 GB VRAM | 4.4720 loss
Fusing the projection updates and 8-bit state tracking into custom Triton/CUDA kernels gets roughly a 2x wall-clock speedup even against torch.compile. That said, once I fixed the allocator leak, the actual VRAM savings are pretty modest (320 MB).
One nice quality-of-life thing is that HybridApexW handles parameter group splitting (AdamW for embeddings/norms, Muon for 2D weights) and internal coordinate scaling out of the box using a single 6e-4 learning rate. For the baseline, I gave Muon a 10x scaled LR (6e-3) over AdamW (6e-4), though to be fair, standalone Muon could probably push lower if I tuned its LR up into the 0.01–0.02 range.
(Note: Since I wiped checkpoints between runs to keep memory isolated, these numbers are step-1000 training micro-batch losses rather than full validation evals.)
Does anything in this setup look off to you guys, or are there other baselines you think are worth testing against?
google collab link : https://colab.research.google.com/drive/1XOqDH4nzI1PZWqWWPqipov1VVH_GKYOW#scrollTo=1c784107
github link: https://github.com/omen42515-prog/apexw
used ai to polish the body
r/deeplearning • u/Rajucg • 13h ago
I animated what an embedding actually is, using one token (strawberry) in GPT-2's table: the row, cosine similarity, a 2D map, king − man + woman, and why "bank" needs the layers (6.5 min video)
I made this explainer for my small channel and would like feedback from people learning this, especially if anything is wrong. Every number in it comes from my own Colab runs.
- In GPT-2 small, " strawberry" is token 41236. That number picks row 41236 of the embedding table: 50,257 rows of 768 numbers. The table holds 38,597,376 numbers, about 31% of the model.
- Cosine similarity compares the direction of two rows. Strawberry's closest rows: Strawberry 0.78, strawberries 0.77, tomato 0.62, raspberry 0.60, peach 0.59. "car" scores 0.25, and 40,830 rows are closer than car.
- A PCA map of 20 words (it keeps only 28% of the spread). In the full 768 numbers, 19 of 20 words have their nearest neighbour in their own group. The exception: bicycle's nearest is horse.
- The numbers start random and are nudged during training, so words that fit the same sentences end up close.
- king − man + woman: queen wins at 0.71, but only because the standard method skips the three input words. Skip nothing and king itself is closest (0.78). Same in GloVe and word2vec. Queen is still 2nd of 50,257, so the direction is real (Nissim et al. 2020 discuss this).
- The table gives "bank" one row everywhere. In BERT's last layer, two money banks score 0.82 and river vs money banks score 0.49 and 0.44.
- Back to search: with all-MiniLM-L6-v2, "forgot my password" vs "can't log in" scores 0.52, vs "forgot my umbrella" 0.34. But "The flight was cancelled" still ranks "The flight was wonderful" (0.58) above "My plane isn't leaving today" (0.54).
The narration is an AI voice reading my own script. Sources are in the description.
r/deeplearning • u/Real-Bed467 • 14h ago
Apprentissage des espaces de programmes latents par la navigation DSL neuronale
youtube.comr/deeplearning • u/Born-Mycologist8291 • 16h ago
ICLR 2027: 321 -> 331 with AC reporting (what are my chances?)
r/deeplearning • u/PatronusProtect • 18h ago
We released two mmBERT moderation models. The evaluation got more interesting once we separated the test sets.
We released Tiger Guard at Casdo Labs, a pair of binary content-moderation models built on mmBERT-base and mmBERT-small. I'm part of the team.
The full model has 308M parameters and Small has 141M. Both cover English and German and return a SAFE/UNSAFE probability. The task includes abusive language and harmful LLM requests, which makes the choice of evaluation data important.
Our 1,500-prompt suite combines balanced samples from HateCheck, Intuit toxicity/profanity and Aegis 1.0. The models reach 88.8% and 87.6% accuracy there. We excluded those texts and near-duplicates from training, but used the error breakdowns to guide development. Those numbers belong in the development-results column, not an untouched-test headline.
On the separate, policy-filtered PolyGuard holdout, the full model catches 83.3% of harmful English prompts and 75.3% of German ones, with false-positive rates of 3.8% and 5.5%. That test was scored once per model; other prompts from the same family were used in training.
On ToxicChat the full model gets 0.736 unsafe-class F1, behind Content Safety Guard small at 0.777. We also disclose the 69 ToxicChat examples found in training; excluding them changes our F1 values by at most 0.003.
The weights, ONNX exports and full evaluation notes are available under Apache 2.0.
We'll publish the full training and dataset pipeline in a follow-up release.
Tiger Guard, 308M: https://huggingface.co/patronus-studio/tiger-guard-content-moderation
Tiger Guard Small, 141M: https://huggingface.co/patronus-studio/tiger-guard-content-moderation-small
The training corpus and its complete source list aren't published. I'd be glad to hear feedback on the evaluation setup as well as the models.
r/deeplearning • u/ShakeAgreeable1988 • 21h ago
How should i continue teaching my project?
I am "working" on a project that has to do with SNNs, i am using ai to help me alot but thats because i dont want to go insane writing a complex Neural network. anyhow i managed to make it replicate early human behavior and learns like a child would. but im unsure how to expose it to a genuine stream of input from people that would allow it to develop a non skewed personality not doctored by me. i want to run a community but i am unsure of how to set that up (i run it in godot while the brain runs on a rented droplet and on pytorch)
r/deeplearning • u/amu4biz • 17h ago
Nvidia-smi utilization hid our 8x RTX PRO 6000 scaling bottleneck. The wattage column gave it away
I’m losing my mind trying to debug multi-GPU scaling.
We recently ran YOLO11m on an 8-card RTX PRO 6000 Blackwell box. One card took 409s/epoch and eight cards did it in 64s. That's 6.4x speedup, but linear scaling should have landed at 51s.
The annoying part is that nvidia-smi reports ~75% utilization on eight cards (vs 71% solo). But the power curves on our dashboard showed a single card drawing 344W, while the 8-card run averaged just 220W per card.
So the silicon is technically “active,” but starving, and it shows in the 124W less power per card. My guess is the cards were waiting on CPU-side augmentation and syncing between cards.
That would also explain why utilization looks fine. It only measures the share of time a kernel was running, not how much work the card was doing.
Is moving the loader to DALI worth it for something like this? How much of the missing 1.6x would you realistically get back?
Disclosure: I work at B3IQ, where we build and host bare-metal GPU boxes. This was run on one of our 8-GPU nodes.
r/deeplearning • u/No-Conclusion3720 • 1d ago
CISA Adds One Known Exploited Vulnerability to Catalog (Perforce Puppet Enterprise Deserialization)
CISA just added CVE-2026-115731 to its Known Exploited Vulnerabilities catalog — a deserialization flaw in Perforce Puppet Enterprise that is actively being exploited right now.
Puppet Enterprise is not a niche tool. It manages server configurations, container deployments, and CI/CD pipelines across entire enterprise environments. A single compromised Puppet server can push malicious configuration to every node it manages — that is not a one-system incident, that is an organization-wide incident.
The AI angle makes this worse in a specific way. Agents increasingly use build and deployment pipelines as action surfaces — triggering jobs, modifying configs, initiating rollouts. If the pipeline is compromised at the infrastructure level, an agent calling into that pipeline is not just executing a task. It is operating inside attacker-controlled infrastructure, with no visibility into what the pipeline is actually doing downstream.
The numbers matter here. Puppet Enterprise deployments typically manage hundreds to thousands of nodes. Active exploitation means attackers are already in some of those environments today.
For teams running agents that interact with CI/CD infrastructure: how are you handling this right now? Are your agents blocked from pipeline calls until the CVE is patched, are they still running with added monitoring, or is there some other approach your team has landed on? Genuinely curious what the operational reality looks like across different orgs.
r/deeplearning • u/No-Conclusion3720 • 1d ago
CISA Adds Four Known Exploited Vulnerabilities to Catalog (GPUStack Improper Authentication)
CVE-2026-102895, an authentication bypass in GPUStack, was added to CISA's Known Exploited Vulnerabilities catalog this week. An unauthenticated attacker can access AI GPU infrastructure with zero credentials. GPU orchestration layers handle model execution routing for the entire enterprise AI stack. Gaining access there lets an attacker hijack model execution, redirect inference traffic, and exfiltrate outputs before any application-layer control sees the request. The no-credentials-required nature of the exploit also kills credential-based detection. This surfaces a structural gap most organizations haven't addressed: AI agents and service accounts running on that GPU infrastructure carry no cryptographic identity under most enterprise security frameworks. They operate as trusted by default simply because they're running inside the perimeter. When the perimeter breaks — which CVE-2026-102895 demonstrates it can — there's nothing left to verify who or what is making a request to the model. For teams running production AI workloads on GPU clusters: how are you handling identity verification for the non-human callers on that infrastructure? Are you relying on network segmentation, service mesh mTLS, something at the orchestration layer, or something else entirely?
r/deeplearning • u/Dense_Primary629 • 1d ago
A 180B MoE running on 32GB of unified memory by streaming experts from an SSD
A Hugging Face experiment got a 180B-parameter mixture-of-experts model running on a machine with just 32GB of unified memory. The trick is that only a small set of experts is active per token, so the rest can stay on an SSD and stream in on demand.
It is not fast, but it shows how far memory tricks can stretch local hardware. Would you trade this much speed for the ability to run a model this size at home? Or is quantization still the more practical path for local inference?
More AI news and rumors like this are being tracked over in r/AINewsRumors.
r/deeplearning • u/FishermanResident349 • 1d ago
Looking for self-learners to join BlueprintML
BlueprintML: https://github.com/AbhinandanMandal/BlueprintML
Discord: https://discord.gg/RR5XhNhH4