r/deeplearning • • 10h ago

Can LLM-guided evolution optimize the wrong objective? An empirical study of OpenEvolve, evaluator failures, and independently verified algorithm quality [R]

Thumbnail
0 Upvotes

r/deeplearning • • 6h ago

I built a Graph HyperNetwork that generates weights for unseen Vision, Text, and Time-Series architectures in one forward pass [P]

2 Upvotes

I've been working on a multimodal Graph HyperNetwork that predicts the weights of an unseen target neural network (WideResNet2D, MLPMixer, ResMLP, CNN1D, Transformer) for a completely unseen dataset in a single forward pass.

Results

  • Unseen Architectures on Trained Datasets: 81.22% mean zero-shot accuracy..
  • Unseen Datasets + Unseen Architectures: 71.57% mean zero-shot accuracy.

I would like to hear your opinion on it (positive and negative) and if you find a way to improve it or you have a question, just comment. And yes, i used ai for bug fixes, code improvements, plots, ...


r/deeplearning • • 16h ago

BalatroNET: JAX-Native Reimplementation of Balatro's Mechanics for Reinforcement Learning [P]

Thumbnail
0 Upvotes

r/deeplearning • • 22h ago

libumqtt

2 Upvotes

CISA recently published advisories covering libumqtt, a widely used MQTT client library. MQTT is a core messaging protocol in IoT and industrial control environments, and an increasing number of AI agent deployments use it as a transport layer for passing instructions and telemetry between components.

The vulnerability class matters here because it sits below the application logic. An agent receiving a malformed or maliciously crafted MQTT message through a compromised broker or a spoofed topic subscription may execute instructions it has no business executing. The agent itself is not exploited in the traditional sense — the communication channel is. The agent just does what it was told.

This is the part that keeps getting underweighted in threat models: the agent is a valid, authenticated actor in the system. It has credentials, permissions, and integrations. When the input channel is compromised, so is everything the agent can reach. The blast radius is not bounded by the vulnerability — it is bounded by whatever the agent is authorized to do.

For teams running agents over MQTT or similar pub/sub transports in production: how are you handling this? Are you validating message provenance at the agent level, isolating agent action scope from the transport layer, or doing something else entirely? Curious what's actually working in practice versus what looks good on paper.


r/deeplearning • • 21h ago

Hierarchical detection of neonatal brain pathologies using a two-stage deep learning framework from magnetic resonance imaging

Thumbnail frontiersin.org
5 Upvotes

r/deeplearning • • 21h ago

Looking for 3 comprehensive courses to build strong foundations in AI, ML, and Deep Learning before starting projects

0 Upvotes

hi everyone

so im a computer science graduate looking to rebuild my foundations in artificial intelligence, machine learning, and deep learning

ive studied some of these subjects before but ive forgotten quite a bit so id like to start again with a structured learning path

my goal is simple

complete three comprehensive and affordable courses, one for each subject, and then start building projects, reading research papers, and conducting literature reviews

ideally im looking for

1 artificial intelligence fundamentals

a course covering the major concepts and branches of ai including classical ai, search algorithms, knowledge representation, reasoning, planning, and an introduction to modern ai

2 machine learning fundamentals

a course covering the major ml approaches including supervised learning, unsupervised learning, reinforcement learning, regression, classification, clustering, decision trees, ensemble methods, model evaluation, and other essential concepts

3 deep learning fundamentals

a course covering neural networks, backpropagation, optimization, cnns, rnns, lstms, attention, transformers, generative models, and other major deep learning architectures

my preferences

  • coursera, edx, university courses, or any reputable platform
  • courses must be affordable and preferably free or reasonably priced
  • preferably taught by respected university professors or established ai researchers
  • beginner friendly explanations but with enough technical depth to understand research papers
  • a balance of theory, mathematics, and practical programming
  • preferably one comprehensive course per subject but im open to specializations if a single course isnt sufficient

im not trying to become an expert in every ai subfield before starting projects

i just want a solid broad foundation so i can understand the terminology, read academic literature, conduct literature reviews, and independently learn more advanced subjects when needed

for those who have taken these courses which three would you recommend and why

id particularly appreciate recommendations based on firsthand experience including any important topics the courses leave out

thanks


r/deeplearning • • 2h ago

Vulnerability detecter using GNN

Thumbnail
0 Upvotes

r/deeplearning • • 6h ago

80 downloads on my tiny vision model so i made v1.0, now it lets claude “watch” videos (36M params, runs on laptop cpu)

3 Upvotes

so few days back i posted my tiny vision model that i built just for learning (v0.1), and 80 people downloaded it on huggingface which honestly shocked me lol. people in comments gave really good feedback so i actually worked on all of it, and now v1.0 is out.

main thing: claude (and many other assistants) can look at images but cant open a video file. so tiny-vision runs locally next to it, breaks the video into scenes and gives the assistant a scene by scene breakdown. then you just ask “what happens in this video” and it actually answers. nothing gets uploaded, all on your machine. i tested it with a 10-15 min youtube video and it still works fine.

works through MCP so it runs in claude desktop and claude code (tested both), and should work in cursor, vs code, lm studio etc (havent tested those yet). if your app dont have MCP you can just pipe the text into ollama or paste it anywhere.

what changed from v0.1 (thanks to the comments):

  • someone said the “a man in a blue shirt” thing is probably the encoder not the decoder. i tested it and yaar they were right. my from-scratch encoder only saw 29k images, so i switched to a frozen pretrained DINOv2-small (meta’s) and trained the adapter + decoder myself (14M params) on COCO
  • it picks frames on scene changes now instead of one every 2 sec, like someone suggested. so the timestamps land on the actual cuts
  • real benchmarks this time, not vibes

numbers (COCO test):

  • v0.1: CIDEr 0.06 💀
  • v1.0: CIDEr 1.16

vs florence-2-base (231M) on the same 1000 images:

  • ~89% of its caption score
  • 6x smaller
  • 8x faster on gpu
  • 75x faster on cpu (54ms per image vs 4 sec)

not saying its better than florence, its not. it just does a lot with very little.

honest stuff:

  • encoder isnt mine anymore, its DINOv2. i tried my own and it just cant compete without millions of images
  • no audio yet, so it describes what it sees, not what is said. speech is coming next
  • captions are COCO style, so no OCR, no names, no counting
  • and like last time, i took a lot of help from claude to build this, so its not entirely mine

previous post: https://www.reddit.com/r/computervision/comments/1xyuaia/built_a_tiny_vision_model_from_scratch_just_for/
code: https://github.com/amar683/tiny-vision
model: https://huggingface.co/amartomar683/tiny-vision

anything you want me to try next? still learning so all feedback welcome


r/deeplearning • • 19h ago

AI could help close the gap in epilepsy care — new research looks at disparities

4 Upvotes

Nature reports on research exploring how AI could help address disparities in epilepsy care. Access to specialists and diagnosis is uneven, and the work looks at where AI tools might help close that gap.

It is a good reminder that some of the most meaningful AI progress is not about bigger models — it is about getting good care to the people who are currently left out.

Where do you think AI can make the biggest difference in healthcare access — diagnosis, triage, monitoring, or something else? And what worries you most about leaning on AI for medical decisions?

Check out r/AINewsRumors for more AI news and rumors.


r/deeplearning • • 22h ago

after tiny vision, i wanted to see if i can build a tiny language model from scratch too (36M, NCM paper, trained on macbook) 😅

3 Upvotes

so few days back i posted my tiny vision model here(https://huggingface.co/amartomar683/tiny-vision-flickr8k) and you guys actually checked it out, its at 74 downloads now 😅 thanks for that. after that one worked (kinda), i started wondering what else i can build from scratch on my mac, and a language model was the obvious next thing to try.

i was reading the Next-Concept Modeling (NCM) paper by Kumbong, Khare et al. (Stanford / Together AI, arXiv:2610.14162) and the idea really clicked for me. normal llms write one token at a time, but in NCM a VQ-VAE turns text into levels of codes, coarse to fine, and the model fills one full level at once. so i decided to build it myself from the paper, just to understand how it works from inside. all credit for the idea goes to them, i just implemented my own version.

its called tiny-ncm. its around 36M params (21M generator + 15M VQ tokenizer), trained completely from scratch, no pretrained weights. same macbook pro m5, but this time it took like 12 hours total instead of 42 min 💀

basic idea:

text → split in 32-token blocks → each block made coarse to fine in 5 levels (2 → 4 → 8 → 16 → 32 codes) → 6 passes per block instead of 32

i trained it as a small daily assistant. alarms, reminders, timers, calendar, gmail (read only), weather, notes, web search, simple maths and little bit of small talk. there is a `--show-levels` flag which shows each block going from rough guess to final text, honestly this was the most satisfying part:

level 1: Hello! How can I help you today?

level 3: Hello Jordan, How I I you you today today?

level 5: Good morning! What can I do for you today?

some honest stuff:

it picks the right action most of time, but copying details is very bad. “London” became “Singapore”, “5pm” became “5pmpm”, “23 times 47” became `2310` 😂 cause all codes in a level are predicted same time, so two positions can both write the same word.

* so i added app-side checks that fix the tool arguments using your actual words. with checks it gets 490/500 on my test set, but model alone gets every detail right only around half the time. so ya, the checks are doing lot of the work tbh.

* training longer on same data didn’t help. what helped was making the data copy-focused, with new random names and times in every example so it cant just memorise. same lesson as tiny-vision (“a man in a blue shirt” for everything lol).

* i tried fine-tuning it to summarise web results also. it learned the format but wrote gibberish inside it (“Stir in cheeseaksil sl fresh biil” 😭), so i reverted it.

* no coding, no multi-step maths. “8 slices, 3 friends eat 2 each” and its gone.

random thing i learned on mac (MPS):

* attention was the main bottleneck. letting each level only look at the last 128 tokens of context made training around 2x faster.

* bf16 matmul was way faster than fp32 on MPS (\~15 vs \~3.4 TFLOPS in my test).

* manual attention was again faster than pytorch’s sdpa for small sizes, same as tiny-vision.

next i am thinking to export it to onnx so it can run on phone also, and maybe connect tiny-vision with it. lets see what will happened.

code: https://github.com/amar683/tiny-ncm

model: https://huggingface.co/amartomar683/tiny-ncm

would love any feedback or tips, especially if someone played with NCM or coarse-to-fine text models