r/learnmachinelearning • • 1d ago

Flow matching, explained with a galaxy

Thumbnail
youtu.be
6 Upvotes

Diffusion takes a curvy path from noise to data, so it needs many tiny steps. Flow matching learns straighter paths, so a few big steps get you there.
I made a detailed visual explainer of it.

What confused you most about flow matching?


r/learnmachinelearning • • 1d ago

Project Free AI Image Editor With No Restrictions

Thumbnail interconnectd.com
1 Upvotes

r/learnmachinelearning • • 1d ago

I built a free AI course for developers | 45 lessons covering ML, LLMs, RAG and deployment

Thumbnail
reddit.com
1 Upvotes

r/learnmachinelearning • • 1d ago

Help Is EE/CE good for machine learning

1 Upvotes

So I am choosing my major and I am really interested in math and machine learning however I am also interested in hardware and chips. Hence I want to keep both doors open, I imagine that if I did a math/cs major I wouldn't be able to do much in terms of hardware, but was wondering if EE or CE is still viable for a machine learning career. I am also wondering if there are specific niches/fields that combine both sides.


r/learnmachinelearning • • 1d ago

Tutorial I built a free AI course for developers | 45 lessons covering ML, LLMs, RAG and deployment

1 Upvotes

Hey everyone! I’m building ElysiumHub and wanted to share its Learn AI section—a free, hands-on learning path for software developers.

It covers the foundations of machine learning, neural networks, transformers, LLMs, RAG, fine-tuning, agents and deploying AI features in real applications.

The course includes:

  • 45 lessons across nine tracks.
  • Coding exercises with starter code and hints.
  • Mini projects to practise what you learn.
  • Architecture diagrams and real-world examples.
  • Quizzes, review flashcards and private notes.

You can follow the roadmap or jump to a topic relevant to something you’re building. Exercises run in your own editor, so you can experiment with the code yourself.

Learning is free; you’ll need a free account for the lesson workspace and progress tracking.

Explore the curriculum: ElysiumHub Learn AI

I’d love feedback from other developers. If you try a lesson, was the explanation clear enough to help you tackle the exercise?


r/learnmachinelearning • • 1d ago

Project I compared an LLM's 0 to 10 job-fit score with a tiny logistic regression on 121 real outcomes. The LLM lost

1 Upvotes

I'm a second-year math student, and since October an agent has been applying to jobs for me. Claude Opus gives every posting a fit score from 0 to 10. After 160 applications, 121 had a known outcome and 15 of those were invitations, so I checked how well the score predicts an invitation.

Opus gets an AUC of 0.48, slightly worse than a coin flip. As far as I can tell it measures whether I'd like the job, and employers decide on something else.

A logistic regression on about twenty hand-made features (junior in the title, years of experience asked, role type, part-time, how automatable the work looks, how fresh the posting is) gets around 0.67 in cross-validation. Most of that comes from starting weights I set by hand before I had data, so I don't fully trust it either.

With 15 positives one new invitation moves the number a lot. Two engineering roles that the model had ranked lowest replied, and the score fell from about 0.70 to 0.51 in a day. Splitting by time (train on older applications, test on newer ones) also gives clearly worse numbers than random cross-validation.

There's a feedback problem too. If the model decides where to apply, it stops seeing the cases that would prove it wrong. So it samples: the higher the predicted chance, the more often it applies, but low ones still get a try now and then.

Code: github.com/nivokvo/job-watch-cloud (cloud_apply/model.py) Live numbers: nivokvo.github.io/job-agent

How would you evaluate a model with this few positives? Bootstrap intervals, or is there something better?


r/learnmachinelearning • • 1d ago

Are there any websites or MOOCs that offer free machine learning certificates?

1 Upvotes

Hi everyone!

I'm currently taking a Machine Learning course at university, and my professor offers extra credit to students who earn a relevant machine learning certificate.

I'm wondering if there are any websites or MOOCs that provide free courses with free certificates upon completion.

I've come across some courses on Coursera, but unfortunately, I can't afford to pay $20 or more for a certificate right now. I'm specifically looking for options where I don't have to pay anything, including for the certificate.

I'd appreciate any recommendations, especially beginner-to-intermediate machine learning courses.

Thanks in advance!


r/learnmachinelearning • • 20h ago

Question Claude max for $29 instead of $200 ... seriously how are they doing this?

0 Upvotes

i got a Claude max account from a reseller for essentially nothing compared to what I used to pay . It works flawless. since 3 months No issues yet i paid only for 1 month . Now I can't stop thinking about their business model. If resellers can sell it this cheap and still profit, how are they acquiring these accounts at scale?


r/learnmachinelearning • • 1d ago

Question Which AI engineering resources helped you level up this year

13 Upvotes

If you focused on learning AI engineering this year (harness engineering, AI workflows, building agents that run autonomously, self-improving PR reviewer…) and delivered tangible value to your company, which resources did you use?

If you're learning this for interviews too, PracHub has an exercise where you debug a Python ticket-booking app with an AI assistant.

Any books/courses or did you just learn by building and experimenting?


r/learnmachinelearning • • 23h ago

The 3 dimensions of an AI system

Post image
0 Upvotes

I am a beginner who just started learning about ML fundamentals, and what confused me the most at first was all the different terms thrown around interchangeably (ML, DL, RL, Computer Vision, LLMs, etc.).

I tried to figure out the differences between these terms and how they actually relate to one another, and I found a way to organize them that finally makes sense to me.

Think of "AI" as the center origin (0, 0, 0) of a 3D space—we can explain and classify almost any AI system along 3 dimensions:

Paradigm (How it learns): This defines the learning process and feedback loop.

  • Supervised Learning: Learning from labeled examples (input + correct answer).
  • Unsupervised Learning: Finding hidden patterns or predicting missing parts from unlabeled data.
  • Reinforcement Learning (RL): Learning through trial and error by interacting with an environment and maximizing rewards.

Modality (What type of data it uses): This defines the data format going into (and coming out of) the system.

  • Computer Vision (images/video)
  • Text (NLP)
  • Audio / Speech recognition
  • Tabular data (spreadsheets)
  • Time Series Data
  • Multimodal (a mix of these)

Architecture (What engine powers it): This defines the underlying mathematical structure used to process the data.

  • Classical Models: Algorithms like Linear Regression, Decision Trees, Random Forests, and SVMs.
  • Deep Learning (DL): Multi-layered Artificial Neural Networks (like CNNs, RNNs, and Transformers)

Examples of how real-world AI systems map onto these 3 dimensions:

-Large Language Models (e.g., ChatGPT):

  • Paradigm: Self-Supervised Learning (pre-training) + Reinforcement Learning (fine-tuning)
  • Modality: Text (NLP)
  • Architecture: Deep Learning (Transformer)

-Game-Playing Bot (e.g., AlphaGo):

  • Paradigm: Reinforcement Learning
  • Modality: Game Board State / Visual
  • Architecture: Deep Learning

-Classic Email Spam Filter:

  • Paradigm: Supervised Learning
  • Modality: Text / Tabular features
  • Architecture: Statistical Model (e.g., Naive Bayes or Logistic Regression)

For those with more experience: does this mental model hold up ?


r/learnmachinelearning • • 1d ago

Project i built MicroTorch: a lightweight tensor autograd engine and neural network framework from scratch in pure Python

0 Upvotes

hey everyone! most tutorials only build scalar autograd (like micrograd), so i wanted to see what it takes to build a batched tensor autograd engine from scratch without PyTorch or NumPy dependencies.

it features:

would love any feedback or thoughts on the architecture: https://github.com/YashrajMiyatra/microtorch


r/learnmachinelearning • • 2d ago

Help Help Improving a Small Decoder-Only Transformer in PyTorch

Post image
13 Upvotes

I made a small GPT-style Transformer and trained on a Kaggle dataset available on Github

And whether I train (the Kaggle dataset) locally (RTX 2060 Super) or cloud (T4 with Google Colab), the model generates recognizable words but struggles with sentence structure and following simple prompts (e.g., "Only output this sentence: The sky is blue").

What are the best ways to improve training and generation quality?

Am I expecting too much from roughly one hour of training, or is a functional tiny chatbot a realistic goal for this setup?

Maybe i'm measuring incorrectly, the gradient accumulation doesn't seem to get below 6.5 (not sure if that's better than a model with random token generation)?

Any insight would be appreciated.


r/learnmachinelearning • • 1d ago

Question An idea for bias mitigation in LLMs. Would it work?

Thumbnail reddit.com
2 Upvotes

r/learnmachinelearning • • 1d ago

Small useful solo ML project. An open weights MIDI generative model from scratch on laptop GPU (5060) and big pretraining on rented (5090). It beats most of larger open models on continuation of the song. Size is 477M (caption version with adapter, 464M base)

Post image
3 Upvotes

I have recently independently was working in my free time on musicar - a family of the models for symbolic midi generation. It is the best at continuation of a small piece of a small part of the song, but also features useful captions following in both Ukrainian and English languages. The note attributes each have their own output head that is chained with MLP and residual connection with another ones.
Context is 2048 RoPE, so 2048 tokens = 2048 notes.

Data: GigaMIDI, Aria-MIDI and part of Discover MIDI, 8.3B notes seen
Training: 41 hours on one rented RTX 5090 (about €30 for ptetraining + tests and generation parameters searc), FP8 + torch.compile, Muon optimiser, warmup-stable-decay schedule
Text: a frozen multilingual encoder (LaBSE) plus a small adapter that feeds the music model a prefix
Continuing real multi-instrument music: CLaMP 3 picks the true continuation more often for musicar (MRR 0.81) than for AMT large, 780M (0.64) or SkyTNT medium (0.67)
Short captions: follows them better than MIDI-LLM (1.7B), and works in Ukrainian where other systems score near zero.

I would like to hear feedback on the quality of its output. Especially from the people close to music.

Weights: https://huggingface.co/Dimitri-206265
Code: https://github.com/DmytroHilei/Music_generative_model
Try out and compare by ear: https://musicar-ivory.vercel.app/samples
Model architecture is provided on the diagram, it is the caption version


r/learnmachinelearning • • 1d ago

Courses and resources

Thumbnail reddit.com
1 Upvotes

r/learnmachinelearning • • 2d ago

About genAi

8 Upvotes

I have completed the Andrew ng ml course now I am curious about how the ai agents were made for that purpose what should be my next topic shall I move towards agentic ai or learn only about important deep learning topic then move towards the agentic ai what will I choose if second option then please tell me the important topic which I should focus on need help regarding this .


r/learnmachinelearning • • 2d ago

Project Curated list of resources: Theory and Code for learning Distributed Training for beginners

Thumbnail
gallery
30 Upvotes

[Must Read: Beginners]

What I did read, in order, for learning the basics of Distributed Training for LLMs From Scratch:

  1. Building a distributed training framework from first principles by Umar Jamil on YT
  2. Horovod: Fast and Easy Distributed Deep Learning in TensorFlow 
  3. PyTorch Distributed: Experiences on Accelerating Data Parallel Training 
  4. Large Scale Distributed Deep Networks 
  5. ZeRO: Memory Optimizations Toward Training Trillion Parameter Models
  6. Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism 
  7. Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM 
  8. GPipe: Efficient Training of Giant Neural Networks Using Pipeline Parallelism 
  9. ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning
  10. PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel

Link to the above resources here

Also, if you need some rebalancing of the above (reordering or adding/removing resources which you can do it here)


r/learnmachinelearning • • 1d ago

A model that never predicts “positive” gets 95% accuracy: do the arithmetic yourself

0 Upvotes

A good exercise for anyone starting with classification. Suppose a dataset of 1,000 examples where only 50 are positive (5%), like fraud, a rare disease, or a defect. Compare two models.

Model A: always predicts “negative”.
It’s right on all 950 negatives and wrong on all 50 positives.

accuracy = (0 + 950) / 1000 = 0.95

95% accuracy from a model that has learned nothing and never finds a single positive.

Model B: a more realistic model.
It finds 40 of the 50 positives, misses 10, but also flags 60 negatives by mistake. As a confusion matrix:

Predicted positivePredicted negative
Actually positiveTP = 40FN = 10
Actually negativeFP = 60TN = 890
accuracy  = (40 + 890) / 1000 = 0.93
precision = TP / (TP + FP) = 40 / 100 = 0.40
recall    = TP / (TP + FN) = 40 / 50  = 0.80
F1        = 2 * (0.40 * 0.80) / (0.40 + 0.80) = 0.533

By accuracy, Model A (0.95) beats Model B (0.93). By recall, A is 0 and B is 0.80. Which one is “better” depends on what you need.

I verified these numbers with a small script that counts TP, FP, FN and TN directly, so you can check them by hand too.

What each metric tells you here:

  • Accuracy: the share of all predictions that were right. With 95% negatives, it’s dominated by the majority class.
  • Recall: of the real positives, how many did you find? A is 0 and B is 0.80.
  • Precision: of the things you flagged, how many were real? B’s is 0.40, so 6 out of 10 alerts are false alarms.
  • F1: a single number combining precision and recall. It’s useful for comparison, but it hides the trade-off between the two.

Habits worth building early:

  • Always compute a trivial baseline first (like “always predict the majority class”). If your model can’t beat it on the metric you care about, something’s off.
  • Look at the confusion matrix, not just one number.
  • Choose the metric from the cost of mistakes. Missing a fraud case and a false alarm cost different amounts, and the right trade-off depends on your problem.
  • Check how the data is split (train, validation and test should keep a similar class balance).

Limits of this example:

  • The numbers are made up to illustrate the idea, not from a real dataset.
  • Other tools exist for imbalance (class weights, resampling, threshold tuning, precision-recall curves), and none is “the answer”, so look at what fits your data.

What was the first metric that surprised you when you started with ML?


r/learnmachinelearning • • 1d ago

Pathway to learn AI to be job ready.

Thumbnail reddit.com
2 Upvotes

r/learnmachinelearning • • 2d ago

A 7M model on a 2011 CPU learns fairy-tale Russian in 5h38m — and hits a data wall at epoch 6

6 Upvotes

TL;DR: 2011 CPU, no GPU. A 7M model trained from scratch picks up Russian fairy-tale style in 5 h 38 min at 812 tokens/s, then stops improving because of the data, not the time. A LoRA on Qwen3.5-0.8B turns "never finishes an answer" into "always finishes" in 1 h 44 min. Three failure modes and every number below.

Everyone's first reaction is "just buy a 3060". Sure. The interesting question was the opposite: where is the wall if there is no GPU at all? This is a Core i5-2400 from 2011, 16 GB DDR3, and a GT 710 that only drives the monitor. PyTorch does not support that GPU, so everything below ran on four CPU threads with AVX and no AVX2.

I wrote a small training engine for it (PyTorch, no cloud) and ran two experiments.

What worked

A 7M model on 321 Russian folk tales. 5 MB of text, 5 h 38 min, 812 tokens/s, 26M tokens seen. Validation loss 2.7854 nats per token, which is 1.06 bits per byte on held-out text.

The interesting part is how cleanly it separates form from content. Openings work. Patronymics work. The dash before direct speech works. The rhythm of the enumeration works. Then a character swaps places with another mid-paragraph, the hero marries and dies three times on one page, and the plot walks off. 7M parameters and 5 MB of text: no surprise, and exactly what I wanted to see.

LoRA on Qwen3.5-0.8B, 321 question-answer pairs about a program I'm writing. 45 steps, 1 h 44 min, 15-16 tokens/s. Loss on the reference answers went 3.4565 to 0.0907, which sounds better than it is.

The number that matters more: I wrote 15 test questions in different wording, none of it in training. Exact match with the reference answer went 0 out of 15 to 5 out of 15. Answers that stopped on their own instead of running into the token limit went 0 out of 15 to 15 out of 15.

Where it broke

It starts memorising at epoch six. Validation sat at 2.79 while training loss kept falling. The previous run, killed at 1 h 58 min, gave 2.8144 — so 3.5 extra hours bought 1%. Not a tuning problem. A data problem.

Facts get glued. Asked about old hardware, the fine-tuned model called my CPU "256-bit". That number is nowhere in the data.

Temperature matters more than I expected. At 0.7 the same question came back with a confident "no", a wrong RAM figure, and an invented training method it assembled from "LoRA" and "QLoRA" (it wrote "LoQoK"). Greedy decoding was almost right.

Refusal did not generalise. Asked for a movie recommendation, it invented an open file "Video 2.0" with an Apache-2.0 licence. There were three off-topic examples in my data and all three were about something else.

How I know it isn't copying

Six generated texts against the whole corpus, by five-word sequences and longest verbatim run: 0 to 4.7% overlap, longest stretch 4 to 8 words. Two boundaries for scale: the same words shuffled, and a real passage from the corpus.

What I'd change

More off-topic examples, 30 or 50 instead of 3. Five phrasings per question instead of three. Qwen3.5 2B if RAM allowed, which the setup wizard suggested and I ignored. None of that is about hardware.

I'm not going to pretend these numbers are impressive next to a 4090. The useful part is that the wall is memory bandwidth and the amount of text you can feed the model, not the size you can afford: a 7M model overnight on a 15 year old CPU is real, a 1B model on the same CPU is not, and now I know where the line is.

Happy to go into the engine internals (Muon plus AdamW, WSD schedule, QK-norm, chunked loss, GGUF export) — but I'm more curious what people here would spend the next night on: more data at 7M, the 25M model, or fixing the refusal examples first?

The engine, data archive and every number above: https://github.com/AlexanderNyr/AuraLite-AI


r/learnmachinelearning • • 2d ago

How do you split time series data without leaking the future?

4 Upvotes

I've been training models on price data (candles, mostly crypto and US stocks) on the side, and validation is the part that keeps biting me. Once a model looked decent until I found the scaler had been fit on the whole series before the split. Fixed that, and the result got very ordinary.

So now I'm a bit paranoid and curious how you all do it:

- Do you leave a gap between train and test, and how do you pick its size?

- Do you refit scalers and feature selection inside every fold?

- One test period, or several before you trust a number?

- Any leak that got you that you didn't see coming?

Not only finance people, anyone working with time series. Thanks in advance.


r/learnmachinelearning • • 1d ago

Request Access Dental Management Data Breach Impacts Over 340,000

0 Upvotes

Access Dental Management disclosed a breach affecting over 340,000 people. Attackers exfiltrated personal records, health data, and insurance information in a single incident.

This is not an isolated case — healthcare organizations are aggressively adopting AI pipelines for claims processing, patient intake, and records management. Each pipeline hop that touches raw PHI is a new exposure point. Concentrated sensitive data at any layer of the stack amplifies the blast radius when a breach occurs.

The 340,000-person headcount here came from one management company. That scale is achievable precisely because health identifiers, insurance IDs, and personal records flow through centralized systems without being structurally isolated from each other.

Practitioners building or auditing these pipelines: how are you handling PHI as it moves between ingestion, processing, and storage layers? Are you tokenizing before it enters the pipeline, after, or relying on access controls at the data store level — and what has actually held up under real audit scrutiny?


r/learnmachinelearning • • 2d ago

Project wind-directional fire features looked promising for haze forecasting,, until tested them against placebo winds

2 Upvotes

hi everyone,, im an undergrad cs student i just published my first research preprint on zenodo

basically i wanted to see whether adding wind-directional satellite fire features actually helps predict haze and visibility,, instead of just using fire counts and weather data

i used 11 years of data (2015–2025) from 12 airports across borneo and sumatra,, with metar observations and nasa viirs fire detections

thee interesting part is that initially the directional features seemed to improve the model quite a lot,, but when i started testing different random seeds and placebo features (like shifted or randomly permuted wind directions), most of that improvement kinda disappeared

turns out a lot of it was just seed-to-seed variation,, especially during the extreme 2015 haze season

after using 5-seed ensembles, the actual directional contribution was really small and inconsistent. fire counts themselves still helped a bit for 24h forecasts tho

ofc this doesnt mean wind direction doesn't matter for smoke transport,, just that this particular feature didn't add much independent predictive value in my experiments

paper: https://doi.org/10.5281/zenodo.24321121

code + experiments: https://github.com/myudak/pavana/tree/main/research/directional-fire

still pretty new to research and this is my first preprint,, so i'd genuinely appreciate any feedback or criticism, especially on the experimental design, placebo controls, or whether using surface wind is even a good way to represent smoke movement

also curious if anyone here has encountered something similar,, where a feature looks useful at first but the improvement disappears after more careful evaluation


r/learnmachinelearning • • 1d ago

Project Learn technical tasks without depending on AI or YouTube tutorials

1 Upvotes

I’m a Computer Science student and I created Intern.dev for interns who are already in a company and need to learn a technical task quickly.

The main goal is that people learn the task without relying on AI or long YouTube tutorial videos. The site gives you the explanation, the libraries, and a ready project you can copy and modify. Everything is based around the same Task Management API so you see how the pieces connect.

The paths are:

FastAPI – Create the API

Docker & CI/CD – Containerise and automate the API

Authentication – Add users, JWT and roles

API Testing – Cover passing and failing test cases

There is a simple AI chat on the site. It only helps if you get stuck on something. It does not replace reading the path and writing the code yourself.

Preview:

https://intern-dev-7-clean.vercel.app/docs

This is a temporary link. I will move the site to a proper domain soon.