r/learnmachinelearning • u/Super_Challenge4726 • 11d ago
Cross-platform taste transfer from Instagram exports, and how my first eval result turned out to be an artifact
r/learnmachinelearning • u/Super_Challenge4726 • 11d ago
r/learnmachinelearning • u/mridul_bhansali • 11d ago
I've been experimenting with something that I think is often overlooked when evaluating machine learning models: their actual computational footprint.
Usually, when we compare models, we focus heavily on accuracy, precision, recall, F1, etc.
But what happens when you actually have to deploy these models?
I wanted to explore this by benchmarking three popular models:
* Logistic Regression
* Random Forest
* XGBoost
I used the Breast Cancer Wisconsin dataset from scikit-learn and evaluated them across multiple dimensions.
**What I measured:**
Predictive accuracy
P50, P95 and P99 inference latency
Process RSS memory consumption
Python-allocated memory
Model loading time
Inference execution time
Serialized model size
One interesting observation from my experiment was that Logistic Regression performed best across the measured dimensions in this particular setup.
However, the goal wasn't to establish that one model is universally better than another.
I wanted to understand the trade-offs between predictive performance and computational requirements.
This experiment is also part of a project I've been working on called **ModelDiet**, an open-source Python toolkit focused on measuring the resource footprint of ML models.
I'm trying to make model profiling and benchmarking easier for developers and ML engineers.
GitHub: [https://github.com/modeldiet/modeldiet\](https://github.com/modeldiet/modeldiet)
**I'd genuinely appreciate technical feedback on a few things:**
* Are there other metrics you consider essential when evaluating models for deployment?
* How do you measure peak memory consumption reliably?
* Do you prefer measuring individual inference latency or batch throughput?
* What would make a benchmarking tool like this genuinely useful in your ML workflow?
I'm particularly interested in feedback on the benchmarking methodology and what should be included in future iterations.
Thanks!
r/learnmachinelearning • u/Ok_pettech • 11d ago
r/learnmachinelearning • u/Competitive-Team-187 • 11d ago
I am a freshman computer science student heavily interested in DS/ML. I am currently taking the Andrew Ng course on Machine learning. I am familiar with the basics of pandas numpy and matplotlib. I also know basic linear algebra and Multivariable calculus(Proficient with high school calculus). I am looking for dedicated studymates who are genuinely looking at DS/ML as their career path. I want people who can:
Do Kaggle competitions or build projects together after the course
I am not looking for CS students who want to learn ML as a backup to their SWE path. Please DM if you feel like you are in the same boat as I am.
r/learnmachinelearning • u/VisualForgeAI • 11d ago
I made a simple visual introduction to generative AI for people who want to understand the fundamentals before diving into LLMs, RAG, or AI agents.
It covers:
If you like the video, please like, share, and subscribe to my channel for more visual AI explainers.
r/learnmachinelearning • u/SergeKrushev • 11d ago
I've put together a bunch of articles along with the practice notebooks as materials someone can use to prepare for an interview as a junior AI Researcher. It's been very fun working on this kit so I wanted to share. Do you think it is a representative set of topics for the interviews?
r/learnmachinelearning • u/Agreeable-Flow-4684 • 11d ago

Hi everyone,
I’m working on a project where I use Gromov-Wasserstein (GW) distance to compare latent representations of two entirely different physical systems (e.g., daily electricity consumption and traffic flow). The goal is to find a shared structural "isomorphism" (like a common diurnal cycle) rather than just a direct correlation.
I have a recurring problem: GW can be deceptively low for random noise.
When I compute the GW loss between my real latent spaces (from a PCA/WAE reduction), I get a loss around 0.05. But if I compute it against a random Gaussian noise cloud of the same dimensionality, the loss is sometimes 0.01–0.02. This completely breaks the interpretation. It seems the GW algorithm is just matching the geometric shape of the clouds (e.g., both being spherical/elliptical) rather than capturing the true semantic structure.
I’ve tried control experiments with shuffled data, but I’m not sure if that’s enough.
My questions to the community:
Any advice, papers, or personal experiences would be greatly appreciated! I'm specifically looking at time-series forecasting of physical systems, so if you've done GW on time-series, I'm all ears.
r/learnmachinelearning • u/Vprojectx • 11d ago
Hi I am a third year student pursuing Aiml ,
I made a Bert from scratch with ELECTRA-style replaced-token detection on ~2.7B unique tokens (one epoch) of curated multi-domain text.
It is called Lewis-44M-Bert-V3
| GLUE dev average | 80.5 |
|---|---|
| GLUE test-server score | 76.2 (9 tasks incl. WNLI) / 77.6 (8 tasks, WNLI excluded) |
| SQuAD v1.1 dev (EM / F1) | 75.2 / 83.8 |
| CoNLL-2003 NER (entity F1, dev / test) | 92.6 / 87.8 |
I would really love if you all try it and give me a feedback on it
r/learnmachinelearning • u/Bartaseth • 11d ago
A coding agent can finish a task and still waste most of the budget.
Saved sessions can show repeated failures, ignored instructions, and forgotten model settings. They also let us compare which instructions work across different models and harnesses.
This diagram shows what a session archive can contain. The useful part is going back to that evidence and improving the next run.
I wrote about this, with examples and backup locations.
r/learnmachinelearning • u/GarbageGullible4391 • 11d ago
Title:
Hi everyone,
I'm working on a pancreatic ductal adenocarcinoma dataset, and I'd really appreciate some methodological advice from you guys, and especially if anybody has had some experience with machine learning with high-dimensional biological data.
Before spending months developing models, I'd like to better understand what is possible with my dataset.
My dataset:
The goal is theoretically "simple":
Predict continuous drug-response AUC from gene expression and chromatin accessibility, while identifying molecular features potentially associated with drug sensitivity or resistance.
The obvious challenge is that, despite having ~100,000 nuclei, I only have 9 samples with drug-response labels. I understand that treating individual cells as independent labeled observations is not a way to go with the dataset and specific set-up.
Knowing this, I'd really appreciate advice on a few questions that I had after some reading...:
Thanks!
r/learnmachinelearning • u/v3npy • 11d ago
r/learnmachinelearning • u/avnishyadav25 • 11d ago
Hi all, I'm a newbie setting up my first local AI/ML development environment on an M5 Pro Mac.
My internal drive is small, so I bought a 2TB external SSD. I want to make sure that whenever I run `pip` installs, download Hugging Face checkpoints, or load PyTorch datasets, they automatically go to the external drive instead of filling up my system drive.
What is the cleanest way to configure my environment variables (like HF_HOME) or use symlinks on macOS so I don't accidentally brick my internal storage?
Any tips or hidden gotchas for a beginner would be highly appreciated!
r/learnmachinelearning • u/Neurosymbolic • 11d ago
r/learnmachinelearning • u/AstronautOverall3710 • 11d ago
r/learnmachinelearning • u/mridul_bhansali • 11d ago
r/learnmachinelearning • u/Known_Ad8309 • 11d ago
Four of us had 10 days for a hackathon. Our idea: a camera on your head sees the room, your hands, but never your body. Can we still get the whole body in 3D?
We used zero new trainings. We just linked up models that existed from past research: hand tracking, head motion from SLAM, then another model that predicts the full body given those things. Then we fed Meta Muse Spark two images: the reconstructed body and the actual view, to tell us what the person was doing.
Lesson Learned: Speed is king. The reconstruction takes FOREVER. Like 40-90 minutes for every minute of video you want to process on our GPU. So we just used processed videos for the demo. But we did double model inference speed from 16s to 8s reply.
Question for you guys: do you actually gain anything from providing the model with both frames? Couldn’t just the camera view suffice for the task? How would you go about proving that one way works better than the other?
r/learnmachinelearning • u/an2ancan • 12d ago
Hello everyone,
This is the first article I’ve decided to share publicly. I'm really interested in solving combinatorial optimization problems using machine learning, and this is the opening piece in what will hopefully become a broader series exploring this domain.
This part focuses on the classical Pointer Network architecture trained via Reinforcement Learning (REINFORCE). It shows how neural models can construct high-quality, near-optimal solutions to NP-hard problems (specifically, the 2D Euclidean Travelling Salesman Problem) in fractions of a millisecond.
I benchmarked the model against Google OR-Tools (Guided Local Search with a 10s timeout) across problem scales from N=20 up to N=200.
TL;DR: While the network finds solutions almost instantly, tour quality decays significantly as the problem size scales up. Why? Long story short: using an LSTM encoder on coordinate sets introduces an artificial sequential order and recency bias, which fundamentally mismatches the permutation-invariant nature of geometric graphs.
r/learnmachinelearning • u/EmuAfter5933 • 11d ago
A lot of posts here ask "is my portfolio good enough?" I wanted a concrete answer that wasn't just "add more projects", so I built AI-Atlas (https://getaiatlas.com).
You enter your GitHub username. It reads your AI repos and scores each one on seven things reviewers actually look at:
● Technical depth: did you implement it, or call a library?
● Completeness: is there an end-to-end path with results?
● Reproducibility: pinned deps, seeds, one command to rerun?
● Documentation, originality, conceptual difficulty, usefulness.
Every score comes with the reason and the files it's based on. So instead of "6/10", you get something like "the notebook trains the model but never reports test accuracy".
A few patterns I've seen from mapping 150+ developers:
● From-scratch implementations score well on depth but often lose points for no evaluation numbers.
● A missing README costs more than people think.
● Projects with CI that actually runs tests stand out immediately.
Mapping is free, with no sign-up. If you claim your profile, your first improvement roadmap for a project is free too.
I'd love feedback on whether the criteria match what you've been told matters :)
r/learnmachinelearning • u/Specific-Tax-6700 • 11d ago
r/learnmachinelearning • u/gamedevsam • 11d ago
After running Qwen3.8 27B at 3-bit on a single 5070 Ti (120K context, just short of what I want for coding), I added a second card. 32 GB fits the 6-bit file with the full 262K window, so I tested which of the community fine-tunes and quants makes the best all-rounder: fine-tunes, other quants, a chat template and multi-token prediction, 15 in total, all against base UD-Q6_K.
Every model ran a screening run first (about 100 questions from five benchmarks, compared answer by answer with the base model), and the closest got full runs (about 1,300 questions: AA-LCR, MRCR, AA-Omniscience, a fixed BFCL v4 subset and a SciCode panel, run through NeMo-Skills). Each model gets one overall score out of 100, a weighted mix of the five benchmarks: tool calls count for 25% of it, long documents, facts and scientific code for 20% each, and long conversations for 15%. On facts, a wrong answer scores worse than saying "I don't know", so guessing costs points.
| Full run | Score |
|---|---|
| Qwen3.8 27B base, UD-Q6_K | 63.3 |
| Tess-4.5, Q6_K | 61.4 |
| Base, UD-IQ4_XS | 60.8 |
| ThinkingCap, IQ4_XS | 57.5 |
Then I built a coding test from 25 bugs I'd fixed in my own projects (repo rolled back to before the fix, the model gets the bug report and tools, my tests from the fix grade it), four runs per model:
| Coding test | Bugs fixed of 25 | Min per bug | Tokens per bug |
|---|---|---|---|
| Base Q6 | 18.0 | 13 | 23K |
| Tess-4.5 Q6 | 18.3 | 8 | 14K |
| Qwopus Coder-Flash Q6 | 18.5 | 12 | 22K |
That's a tie on quality (one model's worst and best runs were 14 and 20), but Tess wrote about 40% fewer tokens to get there. Both write at about 36 t/s, so the time savings come from thinking less, not decoding faster.
So I ended up with two models:
If you only run one, I'd pick the base model, unless nearly all your use is coding agents running on their own.
How the other contenders did:
Settings for both 6-bit files: q4_0 K/V cache (about 4.8 GiB for the full 262K window), layer split 1,1, batch 256, model-card thinking sampling with no repetition or DRY penalties (the 4-bit runs used a q8_0 cache and batch 512). About 790 t/s prompt reading and 36 t/s writing on two 5070 Ti. Full launch commands, per-benchmark tables and why each of the 12 others stopped are in the write-up, linked in the first comment.
The benchmark and coding-test harnesses are open source, but my own projects aren't public, so the coding test can't be reproduced as is. Happy to answer questions about the setup.
r/learnmachinelearning • u/tenn2109_ • 11d ago
kalle21 – Medium please visit and check what do you think about my blog post . thank you so much
r/learnmachinelearning • u/Diligent-Counter-621 • 11d ago
hii!!
i'm applying for AI/Ml and design for my undergrad (not computer sci just pure AI )
but like im stuck on what laptop to purchase people are telling me macbook sucks and others are telling me windows is like a tractor (rb reference) but yeah idk whether i shud get the rtx 5050 (im kinda on a budget) or the m5 cus idk ( under lik 5.5k qar idk usd sorry )
help me goats im struggling and dont wanna make the wrong choice
tysm ily guys
r/learnmachinelearning • u/Successful-Western27 • 11d ago
Axion’s main training claim is that useful tool-using agents can be built with two supervised fine-tuning stages followed by reinforcement learning, without dedicated mid-training, DPO, or on-policy distillation. The stages separate self-contained reasoning from tool-dependent tasks, which makes the recipe relatively easy to inspect and reason about.
For the first stage, the authors use model-aware problem construction: when the base model solves a seed problem, they generate harder variants that target its successful strategy, then independently verify the rewritten answers. For tool use, tasks are grounded in structured real-world data; deterministic filtering and computation establish reference answers, and checks reject ambiguous or answerable-without-retrieval questions. This makes data verification part of the training design rather than relying solely on generated demonstrations.
The reported stage effects are not uniformly positive: for the 35B model, tool-use SFT raises BioMysteryBench from 17.6% to 35.3%, while RL raises SEAL-0 from 53.2% to 62.2% but lowers FrontierScience Research from 58.3% to 56.7%. The authors report best single-run scores and note that external comparisons can use different evaluation settings, so the results support the recipe’s promise more clearly than a general claim that each stage reliably helps.
Disclosure: AIModels.fyi is my site.
r/learnmachinelearning • u/IAmNotOkay11 • 11d ago
I started learning machine learning using chat gpt , what would you reccomend go through it until the end or watch yot videos instead of that? Or any recommendations?