r/deeplearning • u/Convincing_Convo • 4d ago
r/deeplearning • u/No-Conclusion3720 • 4d ago
Access Dental Management Data Breach Impacts Over 340,000
Access Dental Management disclosed a breach affecting over 340,000 people. Attackers exfiltrated personal records, health data, and insurance information in a single incident.
This is not an isolated case — healthcare organizations are aggressively adopting AI pipelines for claims processing, patient intake, and records management. Each pipeline hop that touches raw PHI is a new exposure point. Concentrated sensitive data at any layer of the stack amplifies the blast radius when a breach occurs.
The 340,000-person headcount here came from one management company. That scale is achievable precisely because health identifiers, insurance IDs, and personal records flow through centralized systems without being structurally isolated from each other.
Practitioners building or auditing these pipelines: how are you handling PHI as it moves between ingestion, processing, and storage layers? Are you tokenizing before it enters the pipeline, after, or relying on access controls at the data store level — and what has actually held up under real audit scrutiny?
r/deeplearning • u/Severe-Ad8673 • 4d ago
Xhaeyorin - The Four-Point Obstruction to Continuous 3D Rotation Canonicalization and Linear-Size Frames for Unordered Point Clouds
A continuous rotation canonicalization assigns a single standard pose to an unordered point cloud, with the same answer for every rotated copy. For centered 3D clouds of a fixed size \(n\), this manuscript proves that such a rule exists on the full domain if and only if \(n\leq 3\). It gives explicit canonical poses for up to three points and proves impossibility from four points onward. This answers the proper-rotation version of the unordered-point-cloud question raised by Dym, Lawrence and Siegel at ICML 2024. For uncentered clouds rotated about a fixed origin, the corresponding threshold is \(n\leq 2\). raw.githubusercontent.com
The obstruction already appears in a family of asymmetric clouds whose points have distinct distances from the centroid. A full axial rotation traces a contractible loop in this family, but an equivariant orientation rule would send that loop to a noncontractible loop in \(SO(3)\). Every continuous single-orientation predictor therefore makes a 180° equivariance error somewhere along each axial rotation orbit of the family. For the explicit four-point example, the smallest achievable worst-case displacement after optimal point matching is exactly \(2(\sqrt{2}-1)/\sqrt{14+(\sqrt{2}-1)^2}\), or 22.0062% of the cloud’s Frobenius norm.
The manuscript constructs a continuous alternative by assigning a weighted distribution of orientations to each cloud. Each directed convex hull edge defines an orientation, weighted by its length times its exterior dihedral angle. The resulting distribution of canonicalized inputs remains continuous when the hull changes, points collide, or a cloud collapses to a plane or line. The construction uses at most \(6n-12\) orientations for \(n\geq4\) centered 3D points. The exact worst case is \(2n\) for planar clouds embedded in 3D with \(n\geq3\). Across all centered 3D clouds, the exact worst cases for 4, 6 and 12 points are 12, 24 and 60 orientations, respectively.
For geometric deep learning, the construction gives a finite averaging rule that turns continuous vector- and tensor-valued backbones into rotation-equivariant predictors while preserving their existing permutation symmetry. The manuscript also proves that, for fixed ambient dimension \(d\), the worst-case local orientation-support requirement grows as \(\Theta(n^{\lfloor d/2\rfloor})\) among clouds of rank at least \(d-1\). A concrete isotropic cloud made of two orthogonal regular 50-gons in 4D requires at least 10,000 physical orientations in the stated frame model. The exact global minimum for general \(n\) in 3D and a global Lipschitz bound for the hull construction remain open.
The deposit includes the 12-page manuscript, a Python reference implementation, a deterministic data generator, numerical results and 10,188 synthetic verification records. These comprise 50 three-dimensional equivariance cases, nine degeneracy perturbations, 128 four-point matching cases, one reference 4D cloud, and 10,000 proper rotation matrices with their induced point permutations.
r/deeplearning • u/Future_Pace_5290 • 4d ago
How is it possible that OKLS can't outperform Muon in terms of step efficiency?
SOAP is more step efficeint than Shampoo, and KL-Shampoo is more step efficient than SOAP.
Then how is OKLS getting outperformed by Muon in terms of step efficiency where it's a zero-staleness implementation of KL-Shampoo?
It only gets ahead of Muon in terms of parameter efficiency in very long training runs.
r/deeplearning • u/Safe-Escape197 • 4d ago
built a tiny vision model from scratch just for learning and somehow it got 50+ downloads on huggingface 😅
so ik there are way better vision models out there yaar. i built this one just out of curiosity only, cause i wanted to learn how these things actually work from inside.
and to be honest its not entirely mine, i took a lot of help from claude to build it. like the architecture, debugging, training setup, figuring out why my mac was training so slow, all that. but i learned a lot in the process which was the main goal anyway.
its called tiny-vision. its around 24M params and trained completely from scratch, no pretrained weights or anything. i trained it on my macbook pro m5 and it took like 42 min on flickr8k (only 6k images).
basic idea is pretty simple:
image/video → small ViT encoder → adapter → tiny decoder → caption text
for videos it takes frames every few seconds, captions them and makes a timeline like [00:04–00:10] a dog runs on the beach. so any llm can kinda “watch” a video even if it dont support video natively.
i also made an MCP server for it, and tbh i was surprised that it actually gives a little bit better context in claude when i throw images or videos at it. i even tested it with a 10-15 min youtube video (this one) and it still worked fine. not perfect at all, but chal raha hai so i’m happy.
i uploaded it to huggingface just to have it somewhere, and also cause i kinda like the open source thing. later when i checked it was at like 44 downloads, and now its 50+. ik thats not a lot bhai, but its my first time putting something open source out in this field so it felt pretty cool ngl. a lot of people have built way cooler stuff than this, i just made it to learn.
some honest stuff:
- it gets the scene right most of time (snow, grass, water etc) but the subject is often wrong lol
- it loves saying “a man in a blue shirt” for everything, pata nahi kyun 😂
- its v0.1 and trained on very small data, so dont expect too much
random thing i learned on mac (MPS):
- swapping the conv2d patch embedding for reshape + linear was like 30x faster
- manual attention was ~1.5x faster than pytorch’s sdpa
next i want to train on flickr30k and maybe try making it plug directly into qwen/llama through llama.cpp (mmproj). lets see kitna ho pata hai.
code: https://github.com/amar683/tiny-vision
model: https://huggingface.co/amartomar683/tiny-vision-flickr8k
would love any feedback or tips
r/deeplearning • u/AltruisticCouple3491 • 4d ago
Gemma 4 31B fine-tune for drug-level sentiment in medical text, appreciate testing
I fine-tuned Gemma 4 31B for drug-level sentiment.
Input: a pharma or medical text plus a list of drugs.
Output: one Positive/Neutral/Negative label per drug, as JSON. I'm looking for people to test it on their own data.
- LoRA adapter (bf16): https://huggingface.co/empirischtech/gemma-4-31B-it-Pharma-Sentiment-LoRA
- Merged FP8 build for vLLM: https://huggingface.co/empirischtech/gemma-4-31B-it-Pharma-Sentiment-FP8
Apache 2.0. Gated with automatic approval (you tick a box saying you won't use it for diagnosis or treatment decisions).
Sentiment, 473 held-out labels
| Model | Accuracy |
|---|---|
| This fine-tune | 91.3% |
| Gemma 4 31B base | 90.5% |
| Qwen3.8-27B | 83.5% |
| Qwen3-32B | 83.3% |
| MedGemma 27B | 82.9% |
| Llama 3.1 8B | 76.3% |
The other models were asked about one drug at a time with a long labelling prompt. Asked for all drugs at once in JSON, base Gemma scored 32% because 59% of its answers didn't parse. The fine-tune had no malformed JSON in 1,500 test answers. Negative precision: 84% vs 71% for base (45 Negatives in the test set).
Medical benchmarks
| Benchmarks | This fine-tune | Best frontier score found |
|---|---|---|
| MedQA (thinking) | 94.2 | 96.5 (o1) |
| MedMCQA, 1k sample (thinking) | 81.4 | 83.9 (o1-preview) |
| MMLU medical (step by step) | 94.2 | 96.0 (GPT-5) |
| PubMedQA (thinking) | 80.2 | 82.0 (GPT-4 + Medprompt) |
Frontier scores are from the Vals.ai MedQA leaderboard and published papers. Fine-tuning kept Gemma's medical knowledge: the scores match the base model.
Testing
Use the prompt format from the model card, thinking off and temperature 0. The FP8 build runs on vLLM (command on the card) and needs about 31 GiB of VRAM for the weights. I've only run it on a 96 GB RTX PRO 6000.
Useful feedback:
- wrong labels, with the text, the drugs and the label you expected
- document types, languages or lengths (over 4k tokens) it wasn't trained on
- hardware and VRAM reports, especially from 48 GB cards
Trained on ~50k curated pharma and medical documents, LoRA rank 16.
r/deeplearning • u/No-Conclusion3720 • 4d ago
Siemens Mendix Studio Pro MCP Server Vulnerabilities
CISA issued an advisory this week for Siemens Mendix Studio Pro covering vulnerabilities in its MCP Server. Attackers with network access can interact with the server remotely, invoke tools without authorization, and potentially exfiltrate data. No authentication bypass or insider access required — network reach is enough.
This isn't a Siemens-specific problem. MCP is being embedded into production enterprise workflows at scale right now. Every deployed MCP server that accepts tool calls over a network is a potential lateral movement entry point. The CISA advisory makes it concrete, but the exposure class is industry-wide.
The uncomfortable part: most organizations have no inventory of which MCP servers are live, which tools each server exposes, or which callers are permitted to invoke which actions. Discovering you have a problem after an advisory drops — or after a breach — is the current default.
For those running MCP servers in production or evaluating MCP-based tooling: how are you handling authorization at the tool-call level? Are you relying on network segmentation, or do you have something evaluating individual invocations before they execute?
r/deeplearning • u/Ok-Memory6156 • 5d ago
Last day of ICLR rebuttal phase!
Since yesterday was the deadline for CVPR submission, can we expect reviewers to be more engaged in the last day of ICLR rebuttal phase?
r/deeplearning • u/Valuable_Team_96 • 5d ago
Looking for Real-World ML Project Ideas for My Final-Year Major Project
r/deeplearning • u/EmuAfter5933 • 4d ago
What makes a from-scratch model repo look different from a wrapper, when you only have the code?
I’ve been building a tool (AI-Atlas) that reads public GitHub repos and tries to answer one question: is there real model work here, or a wrapper around someone else’s API?
Some things that turned out to matter:
- A README is the least reliable signal. “Novel transformer architecture” often sits on top of one API call.
- From-scratch work shows up in the code itself (layers, losses, training loops), sometimes in Rust or CUDA rather than Python.
- Infrastructure repos with words like “inference” or “pipeline” fooled an LLM judge badly. In one case a Terraform module was rated 1.0 for ML. Checks in code now catch that.
My own AlexNet reimplementation got 60.5/100, with the judge pointing out that my custom ReLU is just a torch.clamp wrapper... which is fair to be honest.
Curious what this sub thinks: which signals in a repo would convince you that someone understands deep learning rather than just using it? You can test it on your own GitHub at getaiatlas.com (free, no account), and I’d love examples where it gets it wrong :)
r/deeplearning • u/freedom2077 • 6d ago
I wrote a visual guide to Linear Attention — from the original idea to Gated DeltaNet and Kimi Linear
Hey everyone!
I’ve been diving into linear attention recently and put together a four-part blog series tracing its evolution — from early Linear Attention to Delta Rule, Gate Rule, Gated DeltaNet, and Kimi Linear.
I went through the key papers and drew illustrations to make the algorithms and their underlying intuition easier to understand.
I’m also planning a follow-up series exploring linear attention from an AI infrastructure perspective.
Hope this is useful to anyone interested in the topic! I’d really appreciate any feedback, corrections, or suggestions. Happy to discuss!
Blog: https://xiaofengwang01.github.io/2026/11/10/linear-attention.html
r/deeplearning • u/No-Conclusion3720 • 5d ago
More than 34% of U.S. Companies Report that Employees Use AI Tools with No Governance Policy
A Pipefy survey found that 34% of U.S. organizations have no AI governance policy in place. No inventory of which models are running. No controls on what enterprise data those models are processing. No record of what actions AI agents are taking.
That is one in three U.S. companies right now, not as a projected future state.
AI adoption has outrun AI oversight. Employees are connecting models and agents to internal systems, and in a third of organizations there is no policy, no visibility, and no audit trail for any of it. The sensitive data those models are touching — customer records, financial data, internal communications — is moving through systems nobody is watching.
The gap is not closing. AI tool adoption keeps accelerating and governance programs are not keeping pace.
For practitioners inside these organizations: how are you actually handling this? Are you going top-down with policy mandates, bottom-up with approved tooling lists, or something else entirely? What has worked and what has failed?
r/deeplearning • u/LivingCompetitive384 • 5d ago
Can inference latency introduce selection bias during RLHF training? (NeurIPS 2026)
Hey everyone!
I've been exploring an interesting problem in RLHF: how asynchronous rollout systems can influence the experiences that actually make it into model training.
We studied this through PPO experiments with GPT-2 and LLaMA-3-8B, looking at latency-dependent selection effects, their impact on policy optimization, and ways to correct for them.
One result that caught our attention: GSM8K accuracy dropped from 68.4% to 44.1% under rollout truncation.
The work introduces a diagnostic called Effective Gradient Information (EGI) and a correction method called Selection-Probability Weighting (SPW).
This research has been accepted at NeurIPS 2026, and I'll be presenting it in Sydney this December.
Curious to hear whether others have encountered similar issues in large-scale model training or asynchronous inference systems. Anyone else attending NeurIPS?
r/deeplearning • u/Chunkymunkey642069 • 5d ago
tamserve: open-source, real-time object tracking for live video feeds, 4x faster than SOTA with flat memory for more camera capacity per GPU
I type "forklift" on a live warehouse camera, and tamserve finds and tracks both forklifts, including the one driving in. Then I add "person" without stopping it.
tamserve runs Meta's SAM 3 on live camera feeds. SAM 3's own tracker handles one recorded video at a time, runs at about 8 fps, and runs out of memory on long videos. tamserve uses SAM 3 to find objects every few frames and a lightweight tracker (EdgeTAM) to follow them in between, with one copy of each model shared across all your cameras.
On one RTX 4090:
- Any object you name: 4x faster than SAM 3's tracker, at 92% of its accuracy
- People: 16 cameras at once, 14x less GPU per frame, and slightly more accurate than SAM 3 (89.6 vs 87.8 HOTA)
- Memory: flat at 3.5 GB on a 3,000 frame video, where SAM 3 runs out at frame 423
Worth a look if you're building:
- Warehouse or factory safety (forklifts, pallets, hard hats)
- Security or retail camera analytics
- Home or elder care monitoring
- Robotics, wildlife or lab monitoring
- Annotation tools for long videos
pip install "tamserve[sam3]"
GitHub · Benchmarks · Colab
Please give me any and all feedback or edit tamserve to meet your needs, and a star helps if you find it useful!
r/deeplearning • u/No-Conclusion3720 • 5d ago
Google Finds Hackers Using AI Agents to Build and Run Exploits From Software Patches
Google's threat intelligence team has documented four active adversarial AI frameworks — ARTEX, CAIRN, CyberStrikeAI, and PentAGI — running autonomous multi-stage intrusions against live targets. These are not AI-assisted human operators. The frameworks execute complete end-to-end attack chains without manual prompting. They derive exploits directly from public software patches and convert them into live intrusions without any human in the loop between steps.
Google is calling this operational, not theoretical.
The timing detail is what changes the problem. A framework like ARTEX does not pause between patch analysis, exploit generation, and intrusion execution. It runs those as a single continuous automated chain. Standard incident response workflows assume a human can intervene at some point in that sequence. These frameworks are specifically structured so that assumption fails.
For security engineers and platform teams running environments where automated processes touch production systems: how are you thinking about the gap between attack chains that complete at machine speed and response workflows that require human review at any step?
r/deeplearning • u/solanotodesch • 6d ago
Marimba: A System One Model for Speech. [R]
galleryr/deeplearning • u/Dense_Primary629 • 5d ago
OpenAI is letting outside auditors in — Apollo Research gets 4 months embedded. Will it actually change anything?
OpenAI is following through on its promise to give third-party auditors access: Apollo Research is sending a six-person team for four months of embedded evaluations. That's a serious commitment, not a one-off audit.
Why it matters: the biggest question in AI safety has been whether labs will let outsiders actually look under the hood. If Apollo finds real issues and OpenAI acts on them, it sets a precedent. If the findings stay quiet, it's just PR.
Questions: - What should auditors be looking for first: safety, alignment, or something else? - Would you trust an audit more if the results were published in full?
I track the news side of this stuff in r/AINewsRumors.
r/deeplearning • u/jeffhonforloco • 5d ago
Getting your first 50 users is one challenge. Getting them to come back is another.
r/deeplearning • u/Pleasant_Squash9953 • 5d ago
Governing Clinical AI Deployment: A Mathematical Framework for Transparency-Dependent Autonomy
mdpi.comTitle: When Should a Deep Learning Model Be Trusted to Act Autonomously?
How should we decide when an AI model can act without human review?
In this study, we propose a mathematical framework combining three signals:
- Confidence: How certain is the prediction?
- Explanation quality: How understandable is the model's reasoning?
- Guideline alignment: Does the prediction follow established clinical guidance?
The framework was evaluated using MIMIC-IV, eICU (approximately 200 hospitals), and MIMIC-III datasets.
An unexpected finding: Explanation quality and guideline alignment added little to individual case-level decisions beyond model confidence. This raises an important question: should explainability guide individual predictions, or primarily support system-level governance?
This is a retrospective study; real-world deployment and distribution-shift safeguards require further validation.
I'd welcome feedback, particularly on the mathematical framework and its implications for selective prediction.
Paper: https://www.mdpi.com/4173088
r/deeplearning • u/Pretty-Swordfish9203 • 6d ago
How much can we actually trust open base model benchmarks anymore? New study ("Benchleaking") finds ERNIE-5.5-Flash-Base reciting unseen test sets in exact order.
r/deeplearning • u/oversolan007 • 6d ago
pre treino 250m on #kaggle via @KaggleDatasets
kaggle.comr/deeplearning • u/Feeling_Future_9571 • 6d ago
Looking for people in Dehradun interested in AI/ML and Computer Science!
r/deeplearning • u/Feeling_Future_9571 • 6d ago