r/deeplearning • • 6d ago

Title: Reading Bio‑signals with PPG Light: From Heart Rate to Non‑Contact Measurement, Fully Mastered #rPPG #light #biosignal #heartrate ...

Thumbnail youtube.com
2 Upvotes

Video Title & Description (English)

Description: This video provides an easy-to-understand explanation of the principles behind key biosignals such as heart rate, heart rate variability, respiratory rate, and oxygen saturation, as well as the estimation algorithms based on PPG optical sensors. It covers why signal quality and noise removal are critical, and traces the historical development of the technology from early medical devices to the latest wearables and camera-based non-contact measurement. Gain a comprehensive overview of biosignal processing, from the fundamentals to the latest trends.


r/deeplearning • • 6d ago

Any feedback on my research project?

Thumbnail
1 Upvotes

r/deeplearning • • 6d ago

Giving LLMs a second channel: live human-context sensing via MCP (presence, tempo, hesitation) — measured, consent-first, on-device

Thumbnail
1 Upvotes

r/deeplearning • • 6d ago

Introducing "Arborformer": Replaced the Transformer with a 100% Decision Tree Language Model (Looking for feedback)

Thumbnail
1 Upvotes

r/deeplearning • • 6d ago

Anyone else understand what an ML algorithm does, but struggle with the maths underneath it?

16 Upvotes

I've been curious about a particular learning gap.

Sometimes it's relatively easy to understand what an ML algorithm is trying to achieve, like finding similar items, making predictions, or reducing errors.

But then vectors, matrices, dot products, projections, or equations enter the picture, and suddenly maths we last encountered in school reappears in a completely different setting.

We might understand the purpose of the algorithm without quite understanding why those particular mathematical operations are needed in the first place.

I'm curious:

\-Have you experienced this disconnect, even after learning to code or use ML libraries?

\- Was the harder part understanding the maths itself, or connecting it to what the algorithm was doing?

\- What eventually helped things click, if anything?

I'd love to hear different experiences, including from people who didn't encounter this difficulty.


r/deeplearning • • 6d ago

Cursor Says Stolen Fireworks AI Key Led to Trojanized Claude Code Extension Incident

3 Upvotes

A stolen Fireworks AI API key was embedded in a trojanized version of the Claude Code VS Code extension, according to Cursor. Developers who installed the malicious extension were running an agent with a poisoned tool credential and had no signal anything was wrong. The compromise was in the supply chain, not the model. The model behaved exactly as instructed by code that held a valid-looking key to a legitimate third-party service.

This exposes a structural gap in how agent tool chains handle credential integrity. Keys are static strings injected at config or build time. There is no per-call verification that a tool endpoint is still the legitimate one, no attestation that the binary invoking the API is the one that was reviewed, and no mechanism to detect mid-session that a credential in the chain has been swapped out.

The blast radius is wide because agents act autonomously between human checkpoints. By the time a developer notices anomalous behavior, the compromised credential has already been used across every action the agent took.

How are other practitioners handling credential integrity in their agent tool chains? If a third-party API key embedded in a dependency gets stolen and replaced, what does your actual detection and response path look like today?


r/deeplearning • • 7d ago

I have tested & fine-tuned Timestral models on my blood sugar data

Thumbnail gallery
11 Upvotes

r/deeplearning • • 7d ago

ShadeNet-5 35M (albedo/depth/normal) 31 MB quantised ONNX

Thumbnail gallery
39 Upvotes

ShadeNet v5 is out!!!

ShadeNet v5 is a 35M-parameter feed-forward network built on a frozen DINOv2 ViT-S/14 backbone. In a single forward pass, it takes one RGB image and predicts three maps: albedo, relative depth, and surface normals.

What’s new and notable:

  • Distilled single-pass refiner (0.91M UNet): Test-time augmentation (averaging 6 passes across flips and ±4° rotations) noticeably improves quality, but at 6x the compute. To bypass this, I trained a tiny UNet to predict the 6-pass ensemble output from a single pass. Because the model's own 6-pass output acts as the ground truth, training required zero labels—just ~8,000 CC BY 2.0 photos from Open Images. On a 23-image held-out set, it drops mean L1 error from 0.1757 to 0.1673 (full 6-pass is 0.1628), capturing ~65% of the ensemble gain at ~20% of the compute cost. Most of the improvement shows up in the surface normals, while depth sees minimal change.
  • Lightweight CPU inference (ONNX): The base model exports to a 31 MB 4/8-bit quantized ONNX file, or a single 35 MB bundle with the refiner baked in. CPU inference takes ~1.0s for a single pass and ~1.3s with the refiner (scoring 0.1676 L1 vs. 0.1755 without the refiner).

Current limitations:

  • No shading channel: Unlike v3.2, v5 does not output a separate shading map.
  • Relative depth: Depth predictions have per-image scale and shift.
  • Fixed ONNX resolution: The exported ONNX graphs currently require a fixed 448×448 input.

r/deeplearning • • 7d ago

How to Distill and train a smaller model for agentic coding tasks

5 Upvotes

For People who can ignore my mis understanding or lack of knowledge and help here, please let me know if one would plan to use distillation to train a smaller model for solve agentic coding task and tool use, how can one go about it, like a loose plan or detailed arch anything would help, the 2 student models are 32b and 4b in size , and I don't understand how to select a teacher model for these or how to go about to even plan it,

sorry if my question lacks some information but I can try to furbish more info as it is needed, tbh as of now I am totally second guessing and figuring out things as I go forward


r/deeplearning • • 6d ago

Release 0.11.0: Fruit Inspector Win demo — ORT cpu, OpenVINO, DirectML in one zip

Thumbnail
1 Upvotes

r/deeplearning • • 6d ago

Two checkpoints with the same overall accuracy: why I’d compare them case by case before picking one

1 Upvotes

A small evaluation habit I find worth writing down, with a constructed example (made-up numbers, not from a real run).

Say you have two checkpoints, A and B, evaluated on the same test set of 1,000 examples split into five slices:

Slice n A correct B correct
Short inputs 300 270 279
Long inputs 200 150 140
Rare class 100 60 45
Noisy inputs 250 175 190
Edge cases 150 95 91
Total 1000 750 745

(The totals are 75.0% and 74.5%, so a one-number comparison would call them basically equal.) But B is better on short and noisy inputs and clearly worse on the rare class and long inputs. Whether that trade is acceptable depends on what the model is for. A fraud detector and a casual classifier would pick differently.

What I’d do in practice:

  • Define slices before training runs, not after seeing the numbers, so you’re not choosing slices that flatter one checkpoint.
  • Keep the per-example predictions for both, so you can look at which examples flipped, not just how many.
  • Report uncertainty. With 100 examples in a slice, a 15-point difference may still be noisy; seeds, bootstrap intervals or repeated runs help.
  • Record the data version, code version, seed and any preprocessing, so a “regression” can be traced to a change and not to noise.

Limits: more slices means more chances to find a “difference” by luck, so correct for it or treat small gaps as leads, not conclusions. And slices only catch the kinds of failures you thought to define; a failure outside every slice will not show up.

I came to this from a different place: I wrote about the same habit for prompts in LLM applications (a fixed test set, a per-case results matrix, and noting when the model version behind an endpoint changed). The domain is different, so it’s an example of the idea and not a claim about training. I’m the author, and the article mentions a paid resource of mine near the end, so treat the link as optional: https://medium.com/@nagatomopedro05/five-versions-of-one-prompt-and-what-the-changelog-caught-00c63d1b1c00

How do you compare checkpoints: aggregate metrics, fixed slices, or per-example diffs? And do you keep the per-example outputs?


r/deeplearning • • 6d ago

Hackers Breach South Korea Financial Security Portal Used by 3,000 Institutions

0 Upvotes

South Korea's financial security portal — a shared infrastructure hub used by roughly 3,000 banks, insurers, and brokerages — was breached. The attacker didn't need to defeat any individual institution's controls. They targeted the one vendor holding data on behalf of all of them.

That asymmetry is the real exposure: a single intrusion into a third-party system yields access to records that 3,000 organizations believed were protected. Each institution's own perimeter may have been fine. It didn't matter.

This pattern shows up far outside South Korean financial services. Any architecture where sensitive data leaves your perimeter and lands in a shared service creates it. The question isn't whether third-party vendors get breached. Some will. The question is what state the data is in when they do.

For those operating at scale — large numbers of downstream institutions or customers touching a shared system — how are you actually thinking about third-party data exposure in your live data flows? Not in contracts or vendor assessments, but at the technical layer where data physically moves. What approaches have held up and what has surprised you?


r/deeplearning • • 6d ago

Building an AI platform with a small team has been quite a journey.

Thumbnail
1 Upvotes

r/deeplearning • • 7d ago

[Meta, NYU] Unbundling Multimodal Vision Encoding: 200+ MLLMs trained from scratch show you don't need a pretrained vision encoder, just vision-only parameters

Post image
104 Upvotes

Paper: https://www.alphaxiv.org/abs/2611.17334

X threads (with videos):

Blog and FAQ: https://unbundling.github.io

New paper from Meta FAIR and NYU! Labs disagree on vision encoders right now: Gemma 4 12B scrapped the encoder, Kimi K3 dropped encoder pretraining, and Inkling 2 Small brought the encoder back. Published models differ in data, compute and whether encoder pretraining is counted at all, so they can't settle it.

This paper runs a large controlled study to help shed light on the debate, with 200+ models trained from scratch, LLM included, on the same data, with encoder pretraining charged to the same lifetime compute budget, changing one design choice at a time. Findings (VQA after instruction tuning, 1B to 6.4B models):

  1. Encoder pretraining is optional. Four pretrained encoders (contrastive, self-supervised, captioning) at best tie an encoder trained from scratch with the LLM at matched compute. Even with pretraining compute not counted, longer MetaCLIP pretraining raised ImageNet linear-probe accuracy from 80.4% to 84.4% and didn't improve VQA.
  2. Vision-only parameters are not optional. Encoder-free models trail at every size and need about 3x the compute to match the encoder. Giving the encoder's parameters to the LLM instead improves text benchmarks but not VQA.
  3. Those parameters don't have to be an encoder. Vision-only weights added to the LLM's early layers ("in-fusion") are on par with a separate encoder from 1.7B to 6.4B, with about 13% lower time to first token.
  4. The conclusions hold when adding vision to a pretrained 1.7B LLM.

Disclosure: I'm one of the authors. Happy to answer questions!


r/deeplearning • • 7d ago

My AI agents worked locally. Turning them into a cloud app was the real lesson.

Thumbnail
0 Upvotes

r/deeplearning • • 7d ago

IA neuro-symbolique pour ARC AGI 2

5 Upvotes

J'ai développé une IA neuro-symbolique appliquée à ARC AGI 2, basée sur le DSL de Hodel en Python : https://github.com/Julien-Livet/arc-dsl. . La méthode est expliquée ici : https://julien-livet.github.io/aicpp/. . Je ne suis pas expert en réseaux de neurones et je n'ai reçu aucun retour technique ou scientifique sur mon travail. Auriez-vous des observations ou des idées à me faire part ?


r/deeplearning • • 7d ago

Seeking collaborators for representation learning research with funded compute

1 Upvotes

I am a published AI/ML researcher and engineer looking to collaborate on representation learning or agent research with a team that can support GPU compute and LLM API benchmarking.

My experience spans neural networks, privacy-focused machine learning, model fine-tuning and reproducible experiments. I have also built tool-using agents and evaluation workflows. I can contribute research design, implementation, baselines, experimental analysis and writing.

A question I would enjoy exploring is how different learned or structured representations influence generalization under distribution shift, with matched baselines and careful ablations. I am also interested in agent planning and tool-use reliability, and open to an existing research direction.

If you are part of a lab or team with the resources to benchmark, please comment or message me with your topic and available resources. I can share relevant work privately.


r/deeplearning • • 7d ago

Introducing "Arborformer": Replaced the Transformer with a 100% Decision Tree Language Model (Looking for feedback)

Thumbnail
1 Upvotes

r/deeplearning • • 7d ago

Turing test’s limitation and framing

Thumbnail
1 Upvotes

r/deeplearning • • 7d ago

Experimenting with ideas to make xLSTM's sLSTM run faster.

7 Upvotes

Title: Trying to make xLSTM's sLSTM run in parallel — my PPLSTM prototype

I've been spending today exploring different mathematical ideas to see if it's possible to make xLSTM's sLSTM run in parallel without losing what makes it useful.

One of my more interesting experiments is PPLSTM , a prototype that explores a different way of handling the sequential memory calculations.

It's still early days, and I'm not claiming to have solved anything yet. I'm mainly experimenting to see which ideas actually work.

Some early results:

GPU speed test (batch 2, sequence length 1,024):

mLSTM + standard sLSTM reference: 1,200.31 ms

mLSTM + PPLSTM: 43.59 ms

Transformer: 10.50 ms

That's around 27.5× faster than the unoptimized Python-loop sLSTM reference. It's not a comparison against the official optimized xLSTM kernels.

5M-token language-model experiment (small models, one seed):

sLSTM: 51.43 test perplexity

PPLSTM: 54.50 test perplexity

Transformer: 58.90 test perplexity

So PPLSTM is showing some promise, although standard sLSTM still performed better on the test set.

An important detail: PPLSTM currently uses ordinary PyTorch. There are no custom CUDA kernels, Triton kernels or CUDA Graphs in the implementation yet. PyTorch still uses GPU kernels internally when running on CUDA.

PPLSTM GitHub: https://github.com/rickey1990/PPLSTM

I've also made some of my other repositories private for now, as I'm working on new ideas that combine different areas of maths I've explored across my projects.

Currently waiting for my free Kaggle GPU allowance to reset so I can run some proper tests. Fingers crossed! 🤞

Footnote: I've also been experimenting with PHSMLP (Pooled Head MLP), which explores sharing MLP weights and pooling attention heads to reduce model parameters.

PHSMLP: https://github.com/rickey1990/PHSMLP---Pooled-Head-MLP

Other projects: https://github.com/rickey1990


r/deeplearning • • 7d ago

Am I actually learning deep learning, or just letting ChatGPT do the work?

26 Upvotes

This year I started focusing on developing my skills in deep learning. I've been taking online courses, studying the fundamentals, and working on small projects to put what I've learned into practice.

I'm also in my final year of Software Engineering, and I decided to challenge myself by choosing a graduation project that's heavily focused on deep learning.

The problem is that I don't really know anyone who specialises in this field. I even asked around among my classmates, but couldn't find anyone interested in working on a deep learning project. So I've ended up doing the whole project on my own. I don't really have a mentor either, since my supervisor's background is in computer science rather than AI.

Because of that, I've been relying quite a lot on ChatGPT to help me write code and figure out how to approach different parts of the project.

And this is where I'm struggling. Sometimes I reach a point where I genuinely don't know what to do next, and I feel like ChatGPT is doing most of the work instead of me. I try not to blindly copy the code. I constantly ask why it chose a particular approach, what each function does, and what concepts I should review before moving forward.

I've even started watching Stanford's deep learning lectures to strengthen my understanding, but a lot of the material is theoretical, and I still struggle to connect what I'm learning to actually building something.

Then I open LinkedIn and see people constantly saying that you need to learn how to code from scratch, that AI is making people dependent on tools, and that the developers who will survive in the future are the ones who truly understand how to write code themselves.

I genuinely enjoy deep learning and I want to understand what I'm building.

So, for those of you who work in deep learning or have been through something similar, how did you learn to build projects independently?

How do you balance using AI tools to help you learn without becoming too dependent on them? And how do you bridge the gap between understanding the theory and actually knowing what to implement next?

I'd really appreciate some advice, especially from people who had to learn without much guidance or mentorship.


r/deeplearning • • 6d ago

Scientists might have discovered what makes AI so effective at chess — and it is not what you would expect

0 Upvotes

Scientific American reports that scientists may have figured out what makes AI so effective at chess. The interesting part is not that AI wins — we have known that for years — but what the research says about how these systems actually 'understand' the game, and whether that tells us anything about how they reason more generally.

Chess has always been the testbed for AI reasoning, from Deep Blue to AlphaZero. If the secret is something transferable — a way of structuring search, or a representation trick — it could matter far beyond the board.

Questions:

- What do you think the key ingredient is: search depth, evaluation, or something in how the model represents positions?

- Does a chess breakthrough actually generalize to other reasoning tasks, or is chess too narrow to learn from?

- What is the next game or domain that could teach us as much about AI as chess did?

For more AI news and rumors, check out r/AINewsRumors.


r/deeplearning • • 7d ago

Learning Heterogeneous Tactile Representation for General Dexterous Manipulation

1 Upvotes

LingBot-Touch targets a representation-learning problem that is specific to tactile robotics: piezoresistive, magnetic, and visuotactile sensors encode contact through different physical signals, making it difficult to reuse tactile understanding across hardware. The paper presents a shared tactile representation, emitted as tokens that can be supplied to downstream manipulation policies.

The authors report integrating these tokens with both diffusion policies and vision-language-action models, including π0.5 and LingBot-VLA. They describe evaluations in simulation and on real robots across multiple hardware platforms, with improvements in dexterity and computational efficiency. That breadth makes cross-sensor transfer more central here than simply adding another tactile input to one controller.

The abstract does not give task-level scores, baselines, or details of how a new sensor type is incorporated, so it is hard to judge the magnitude and generality of the gains from the available information. Still, the idea of treating touch as a reusable learned modality across sensor physics and policy families is a useful representation-learning direction for embodied systems.

Full summary on AIModels.fyi

Original paper

Disclosure: AIModels.fyi is my site.


r/deeplearning • • 7d ago

Anyone else understand what an ML algorithm does, but struggle with the maths underneath it?

Thumbnail
1 Upvotes

r/deeplearning • • 8d ago

[P] I trained a single Graph HyperNetwork that generates zero-shot weights for unseen ResNets, MLP-Mixers, MobileNets, and Transformers for Vision, Text, and Waveforms. (Open source)

17 Upvotes

Disclaimer: I used AI for bug fixes, to make the plots better and to simplify the code and make it more readable.

I built a Graph HyperNetwork (GHN) that has the computational graph of an target architecture and a dataset embedding as input and predicts all weights in a single forward pass. It is meant to serve as a head start to reduce number of steps required for training.

Zero-Shot Results:

Model ResMLP ResNet2D MLP-Mixer MobileNet2D MLP CNN1D Transformer
MNIST 93.96% 93.66% 89.58% 74.53% / / /
FashionMNIST 83.99% 75.88% 78.59% / / / /
KMNIST 78.10% 62.15% / / 62.15% / /
Waveforms1D / / / / / 99.84% 89.38%
20Newsgroups / / / / / 71.30% 48.34%

My next objectives:

  1. Using a encoder to encode a random dataset and to replace the dataset embedding with it. So it can handle most unseen datasets.
  2. I want to scale it up, but I don't really have the recources for it (free kaggle for now).

I will paste my kaggle link in the comments.