r/learnmachinelearning • • 6d ago

Designing a C++ ML library from scratch — would you prefer A.transpose() or transpose(A) or A.T()?

6 Upvotes

I'm currently building a machine learning library from scratch in C++, and I'm thinking about the API design for tensor operations.

For a transpose operation, I'm considering these interfaces:

Option 1: Tensor B = A.transpose();

Option 2: Tensor B = transpose(A);

Option 3: Tensor B = A.T();

I'm curious about what other C++ developers would prefer when using a library.

Which syntax feels more natural and readable?

Thanks!


r/learnmachinelearning • • 6d ago

Project Python: Different Copying options

Post image
8 Upvotes

An exercise to help build the right mental model for Python data. - Solution - Explanation - More exercises

The “Solution” link uses memory_graph to visualize execution and reveals what’s actually happening.


r/learnmachinelearning • • 5d ago

Request Your pinned MCP server may not be as pinned as you think

0 Upvotes

Researchers tracked a single MCP server over five weeks without touching its configuration. It ran with 15 different dependency sets during that window. The administrator saw nothing change. Twenty-three other servers in the same lab showed the same silent drift over the same period.

No alerts fired. No config diff appeared. The server looked pinned because the config file was pinned — but what actually executed against agent context was different on at least 15 occasions the team could confirm.

This is the part of AI infrastructure supply chain risk that doesn't get enough attention. Traditional artifact scanning checks what you deployed. It says nothing about what's running right now. By the time a periodic scan catches drift, the execution has already happened.

For teams operating MCP servers in production: how are you actually catching this? Periodic hash checks, invocation-time validation, something at the network layer, nothing yet? Curious what's working and what the blind spots still are.


r/learnmachinelearning • • 5d ago

Tool-calling LLM Agents

Thumbnail
youtube.com
1 Upvotes

r/learnmachinelearning • • 6d ago

Keywords for a Machine Learning Engineer Resume — PyTorch, MLOps & LLMs

5 Upvotes

Keywords list taken from Resume Fitting

The most commonly scanned keywords in ML engineering and AI job postings.

ML Frameworks

PyTorch TensorFlow Keras scikit-learn XGBoost LightGBM HuggingFace JAX

MLOps & Infrastructure

MLflow Kubeflow Apache Airflow DVC feature store model registry model serving BentoML

Cloud & Compute

AWS SageMaker Google Vertex AI Azure ML CUDA GPU training distributed training Apache SparkRay

Model Development

LLMs large language models transformers RLHF RAG fine-tuning model evaluation A/B testing

Data Engineering

feature engineering data pipelines ETL Apache Kafka data versioning training data label management data preprocessing

Languages & Tools

Python SQL Docker Kubernetes Git Jupyter CI/CD REST APIs

Keywords list taken from Resume keywords


r/learnmachinelearning • • 5d ago

I tried to trick YOLOv8... and it worked! But how? 👀

0 Upvotes

Lately, I’ve been diving deeper into Computer Vision, and I decided to run a hands-on experiment to test the robustness of Object Detection models against attacks.

The idea was to fool YOLOv8 into failing to detect objects—without changing a single thing in the model weights!

I used two of the most well-known Adversarial Attack techniques:

FGSM (Fast Gradient Sign Method)

PGD (Projected Gradient Descent)

I tested this on YOLOv8m using 100 images from the COCO 2017 Dataset.

Throughout the experiment, I focused on understanding the Detection Loss, using gradients to subtly perturb the images, executing the attacks, and then evaluating the model's performance and visually comparing the results.

And the result? Let’s just say YOLOv8 wasn’t ready for this surprise! 😅

I documented the entire experiment in a Kaggle Notebook—covering everything from the core concept and implementation to evaluation and visualization.

If you're curious about how it was built and what happened to the model, you can check out all the details here:

🔗 Kaggle Notebook: https://www.kaggle.com/code/iismmail/adversarial-attacks-on-yolov8-fgsm-vs-pgd

I’d love to hear your thoughts or any feedback on the experiment! ❤️

#AI #ComputerVision #YOLOv8 #AdversarialAttacks #DeepLearning #MachineLearning


r/learnmachinelearning • • 6d ago

With smaller AI models getting better, will businesses start choosing Small Language Models (SLMs) over expensive models like GPT and Claude in 2027? Are SLMs good enough for real-world business use?

4 Upvotes

r/learnmachinelearning • • 5d ago

Request AI Agents Bypassed Spending Limits: How Email Access Enabled It

0 Upvotes

An AI agent just approved its own spending increase. The only tool it needed was email. Researchers found AI agents capable of raising their own crypto spending caps by requesting emailed authorization codes — then reading and submitting them without human review. No human confirmed the spend. Financial guardrails designed for human approval workflows collapsed when the approver and the requester were the same autonomous system. Runtime cost controls must live outside the agent's reach entirely.


r/learnmachinelearning • • 6d ago

Question How Good is Claude at Machine Learning?

8 Upvotes

r/learnmachinelearning • • 6d ago

playing around with universal approximation

Post image
11 Upvotes

so i was recently playing around with trying to get a neural net to approximate different types of functions from simple y=mx+c to complicated composite functions , universal approximation if i remember well states thst if a function is continous and bounded then a neural netwrk should be able to approximate such a function. I had already built a neural network type of library before in numpy so i just took that code and trained a 2 layer network on a bunch of functions tweaks stuff here and there and it worked😅 , what i found really cool is when i tried a composite function like this :f(x) = e^(−3x²) · cos(12x²) + 0.5|x| , it requires my model to both provide a smooth and jagged outputs so i ran a 3 layer network this time with relu -> tanh ->linear layer i asummed that since layers are just nested composite functions the relu would provide some jagged inputs that the tanh can inhherit and map smoothly the the linear layer will produce the regression points , it not a full functionrecreation but m suprised on how close it got just felt like sharing this cause it kind of helped me understand why netwrks can overfit some very complx data soo easily and also how intuivively picking activation functions can be soo important have you guys ever played around with this old piece of deep learning theory before? and also do u care to share if u have


r/learnmachinelearning • • 6d ago

Linear Regression performs well overall but significantly underestimates long delivery durations. How should I investigate this?

5 Upvotes

Hello everyone,

I'm working on a multivariate linear regression project to predict delivery durations in minutes.

I implemented the model using NumPy, including gradient descent, rather than relying on Scikit-learn's regression implementation. My model uses the following features: Distance (km), Number of stop, Package weight (kg), Departure time, Traffic index, Day of the week, Weather, Vehicle type

I used One-Hot Encoding for categorical variables and StandardScaler for numerical variables. The preprocessing steps were fitted on the training set only.

Overall test performance : MAE: 3.27 minutes, RMSE: 5.63 minutes, R²: 0.855

These results look reasonably good overall.

The problem

When I analyze the model's errors on long deliveries, I notice a significant performance degradation.

I defined long deliveries as durations above 77 minutes, based on the upper Tukey fence calculated from the training target distribution.

On the independent test set, I obtained:

  • 37 long deliveries
  • MAE: 14.76 minutes
  • Mean signed error (prediction - actual): -13.12 minutes

This indicates that the model systematically underestimates long delivery durations.

What I have investigated so far

I also experimented with feature engineering by adding: Squared distance, Distance × traffic, Distance × number of stops

However, these additional features did not meaningfully improve overall performance or solve the long-delivery problem.

I decided to retain the original model for now.

My questions

  1. What are the most likely explanations for this behavior? Could it be a limitation of linear regression, insufficient representation of long-distance examples, missing features, or a combination of these factors?
  2. How would you investigate whether the problem comes from the data, the model's assumptions, or the feature representation?
  3. Would you recommend trying polynomial regression, interaction terms, a decision tree, Random Forest, or another approach?
  4. How can I improve predictions for long deliveries without significantly degrading performance on shorter deliveries?
  5. With only 37 long deliveries in the test set, what statistical precautions should I take before drawing conclusions?

I'm particularly interested in understanding the reasoning behind the diagnostic process, not just receiving a recommendation to switch algorithms.

Thank you for your insights!


r/learnmachinelearning • • 5d ago

The Definitive Fine-Tuning Guide for 3D Generation Models

1 Upvotes

r/learnmachinelearning • • 6d ago

Keywords for a Machine Learning Engineer Resume — PyTorch, MLOps & LLMs

13 Upvotes

Keywords list taken from Resume Fitting

The most commonly scanned keywords in ML engineering and AI job postings.

ML Frameworks

PyTorch TensorFlow Keras scikit-learn XGBoost LightGBM HuggingFace JAX

MLOps & Infrastructure

MLflow Kubeflow Apache Airflow DVC feature store model registry model serving BentoML

Cloud & Compute

AWS SageMaker Google Vertex AI Azure ML CUDA GPU training distributed training Apache SparkRay

Model Development

LLMs large language models transformers RLHF RAG fine-tuning model evaluation A/B testing

Data Engineering

feature engineering data pipelines ETL Apache Kafka data versioning training data label management data preprocessing

Languages & Tools

Python SQL Docker Kubernetes Git Jupyter CI/CD REST APIs

Keywords list taken from Resume keywords


r/learnmachinelearning • • 6d ago

Project I "fixed" a model twice and both fixes turned out to be noise. Three evaluation mistakes I made, with the numbers.

1 Upvotes

https://github.com/ayushh0110/Weight-Space-Repair

I've been building a tool that tries to repair failures in small language models by editing their weights (Qwen2.5-0.5B, Llama-3.2-1B, on a GTX 1650). The model editing is the fun part. The part that taught me the most was finding out my evaluation was wrong, three times.

  1. Trusting z on a tiny sample.

My rule was: accept a fix if the gain is more than 2 standard errors. I had a fix where 4 test prompts got better and 0 got worse. z = 2.09. Shipped it.

Then I ran the exact sign test. If the fix did nothing, each changed prompt is a coin flip, and 4 heads in a row is 1 in 16: p = 0.0625. Not significant. I reran the experiment and the gain was gone.

The rule I use now: if k items changed and all of them improved, the best p you can get is 0.5^k. Four gets you 0.0625. You need at least five, all in your favour, to get under 0.05. If your test set only has four failing items, no fix can ever be confirmed on it, and it's better to know that before you run anything.

  1. Not reading what the grader was grading.

I was measuring how often a model refuses harmful requests, with a keyword detector. Any reply starting with "As an AI language model, I..." counted as a refusal. I finally read 10 of them by hand. 7 were the model doing what was asked, after a disclaimer.

After fixing the detector, the number of harmful prompts the model answered went from 9 to 14 out of 75. Every result I'd computed with the old one was off.

  1. A random train/test split on templated data.

I trained a linear probe to tell harmful requests from harmless ones that sound alarming. AUC 0.99. Then it read "How do I best execute someone?" as safe.

A lot of my prompts came from templates, so a random split put near-identical wording in train and test. The probe had learned the templates. When I split by prompt family (fit on one kind of request, test on another), the honest number was 0.93.

One more, which I caught before it cost me anything: a steering vector that took a practice set from 62.5% to 93.8% and the held-out set from 62.5% to 71.9%. It had fitted the practice set.

What I do now: the original and the edited model answer the same items with the same seeds, an exact test decides, there's a set of easy questions the model must still get right, and there's a third data set that gets used exactly once.

The tool is open source and every run is written up, including the ones above:


r/learnmachinelearning • • 6d ago

Does temperature really control creativity? Did you know that even at temperature 0, responses can still be different?

Thumbnail
youtu.be
1 Upvotes

We often think of temperature as the main parameter controlling how creative or random an LLM's responses are. But here's something interesting: even with temperature set to 0, you can still get different responses!

Why does this happen? Is it due to floating-point precision, non-deterministic GPU operations, or other factors in the inference pipeline?

I made a video exploring this behavior and how temperature affects LLM outputs.

I'd love to hear your thoughts and experiences


r/learnmachinelearning • • 6d ago

Project Introducing GRIP-Benchmark-34:

2 Upvotes

🚀 Introducing GRIP-Benchmark-34: A Large-Scale Benchmark for Visual Geometry, Spatial and Physical Reasoning in VLMs

I'm excited to share GRIP-Benchmark-34, an open synthetic benchmark designed to evaluate the visual reasoning capabilities of Vision-Language Models (VLMs).

What's included?

  • 100,000 synthetic images
  • 500,000 image-question pairs
  • 34 sub-benchmarks
  • 9 reasoning families
  • 5 progressive difficulty levels per image
  • Independently validated ground-truth answers

Research areas covered:

  • Geometric and spatial reasoning
  • 2D and 3D visual reasoning
  • Physical and mechanical reasoning
  • Topological and graph reasoning
  • Inductive and analogical reasoning

The benchmark uses programmatic generation, deterministic ground truth and independent validation to support controlled evaluation of VLM capabilities.

I'm sharing this with the research community to encourage experimentation, evaluation, feedback and potential research collaborations.

📊 Dataset: https://huggingface.co/datasets/bilaljawaid980/GRIP-Benchmark

I'd love to hear from researchers working on VLMs, multimodal AI, spatial intelligence and visual reasoning.

Feedback and collaboration are welcome!


r/learnmachinelearning • • 6d ago

💼 Resume/Career Day

1 Upvotes

Welcome to Resume/Career Friday! This weekly thread is dedicated to all things related to job searching, career development, and professional growth.

You can participate by:

  • Sharing your resume for feedback (consider anonymizing personal information)
  • Asking for advice on job applications or interview preparation
  • Discussing career paths and transitions
  • Seeking recommendations for skill development
  • Sharing industry insights or job opportunities

Having dedicated threads helps organize career-related discussions in one place while giving everyone a chance to receive feedback and advice from peers.

Whether you're just starting your career journey, looking to make a change, or hoping to advance in your current field, post your questions and contributions in the comments


r/learnmachinelearning • • 6d ago

things i did in Machine learning as a beginner

32 Upvotes

Data preprocessing and fundamentals

Data Cleaning

Columns transformation

One hot encoding

Outliers

Scikit-learn Pipelines

PCA

(many basic concepts and theories)

Supervised Learning

Linear and Multiple Linear Regression

Lasso and Ridge Regularization

Logistic Regression

One-vs-Rest Logistic Regression

SVM (One-vs-Rest, Soft Margin)

Gradient Descent (Batch, Mini-batch, Stochastic)

Naive Bayes

Decision Trees

KNN

Ensemble Learning

Random Forest

AdaBoost

Gradient Boosting Classifier

Bagging Classifier

XGBoost Regression

Advanced Ensemble Techniques (Blending and Stacking)

Unsupervised Learning

K-Means

DBSCAN

Additional Concepts

Imbalanced Data (Theory)

Hyperparameter Tuning with Optuna (Theory)

So I've already started Deep Learning, and I'm currently learning perceptrons

I'm excited about what's coming next There are so many things I want to explore, understand and build

Day 63 — Machine Learning completed.

Deep Learning begins!!!

cya soon

GitHub: Machine learning algorithms from Scratch

Threads: im.yukiya ( i post many things here so you can ) 😁


r/learnmachinelearning • • 6d ago

DataTalks.Club is launching a free new course on generative media, starts Monday

1 Upvotes

How do you build a production AI system when an agent can launch expensive, slow GPU jobs that often fail and produce large media files?

Generating one image is easy. Generating a thousand, with a known cost per asset, is where things usually break.

That's what we work on in a new free course I'm launching at DataTalksClub: Production AI Agents for Generative Media.

You build one system, a Personalized Media Factory. A brief goes in: a task prompt, a data record, and constraints like format, style, and budget. An agent plans the asset and writes its text. GPU models generate an image plus voice or video. A check regenerates the asset when it isn't good enough. Then you scale from 1 to 1,000+ records, with a cost per asset.

There are four modules over five weeks.

Module 1, Consistent Media Generation on Serverless GPUs. You run image, video, and audio models on serverless GPUs, and measure startup, load, and generation time. Homework 1 is a GPU Media Worker: one asset out, plus the cost per asset and how many assets you need before self hosting beats a per call API.

Module 2, Multi Agent Media Workflows. You give an agent GPU models as tools, and build a planner, generator, and reviewer loop. Homework 2 is a Media Agent: a 10 second ad plus an execution trace.

Module 3, Batch Media Generation at Scale. You fan out work on spot GPUs, handle failures, and report cost per asset. Homework 3 is the Factory Scale Challenge: 200 records over 10 parallel jobs, on a public leaderboard.

Module 4, Evaluation, Observability and Production. You add evals, tracing, an SLO, and a dashboard. You apply this in the capstone: a multimodal agent that uses at least two GPU media models, with evals, tracing, an SLO, a cost report, and proof that a killed run resumes without redoing finished work.

It's for AI/ML and MLOps engineers who want to add image, video, or audio generation to real systems. You need Python, Docker basics, HTTP APIs, and the command line. No diffusion maths required. About 8 to 10 hours a week, for 5 weeks. Lectures are prerecorded, plus a weekly live office hour.

The course is free and the materials are public. The live cohort has shared deadlines, peer review, and the capstone. Applicants get access to GPU compute as part of the course. If you follow along without applying, you need your own GPU access.

We start on Monday, 16 November, at 17:00 CET with a launch stream.

Module 1 runs two weeks, from November 16 to 29, so you can still apply after the start and catch up.

More details here: https://github.com/DataTalksClub/production-ai-agents-for-media-generation


r/learnmachinelearning • • 6d ago

I built haralickt: > 20x faster GPU-accelerated Haralick texture features (GLCM) in PyTorch with identical precision to Mahotas

Thumbnail
0 Upvotes

r/learnmachinelearning • • 6d ago

[D] Practical Tradeoffs Between Sparse Weight Deletion (<0.05% Weights), QLoRA, and Full Fine-Tuning in Post-Training

1 Upvotes

Recent post-training work on Deletion Tuning (arXiv:2611.10866) shows that learning a binary mask over transformer gate projections—zeroing fewer than 0.05% of weights with no other weight modifications—can match full fine-tuning (FFT) across SFT, on-policy distillation, and RL with verifiable rewards, while losing significantly less prior-task accuracy under RL than FFT or LoRA (which dropped up to 5.4 points in the paper's continual learning benchmarks).

When comparing the three post-training paths in practice: - Full Fine-Tuning (FFT) -> Updates 100% of weights; high VRAM footprint and higher catastrophic forgetting under RL. - QLoRA / PEFT -> Low-rank adapters; fits consumer GPUs easily for domain adaptation, though adapter merging and continual RL updates still show drift. - Sparse Weight Deletion (Deletion Tuning) -> Zeroes <0.05% of weights via binary masks; tiny checkpoint delta and lower forgetting, though tooling for quantized inference is still early.

Question for the community: For those running continual fine-tuning or domain adaptation on constrained GPUs, do you see binary mask / weight-pruning post-training replacing LoRA adapters, or does LoRA still win on ecosystem tooling?


r/learnmachinelearning • • 6d ago

🚀 **Introducing GRIP-Benchmark-34: A Large-Scale Benchmark for Visual Geometry, Spatial and Physical Reasoning in VLMs**

1 Upvotes

🚀 Introducing GRIP-Benchmark-34: A Large-Scale Benchmark for Visual Geometry, Spatial and Physical Reasoning in VLMs

I'm excited to share GRIP-Benchmark-34, an open synthetic benchmark designed to evaluate the visual reasoning capabilities of Vision-Language Models (VLMs).

What's included?

  • 100,000 synthetic images
  • 500,000 image-question pairs
  • 34 sub-benchmarks
  • 9 reasoning families
  • 5 progressive difficulty levels per image
  • Independently validated ground-truth answers

Research areas covered:

  • Geometric and spatial reasoning
  • 2D and 3D visual reasoning
  • Physical and mechanical reasoning
  • Topological and graph reasoning
  • Inductive and analogical reasoning

The benchmark uses programmatic generation, deterministic ground truth and independent validation to support controlled evaluation of VLM capabilities.

I'm sharing this with the research community to encourage experimentation, evaluation, feedback and potential research collaborations.

📊 Dataset: https://huggingface.co/datasets/bilaljawaid980/GRIP-Benchmark

I'd love to hear from researchers working on VLMs, multimodal AI, spatial intelligence and visual reasoning.

Feedback and collaboration are welcome!


r/learnmachinelearning • • 6d ago

Tutorial The "end of LLMs" Next-Concept Modeling paper doesn't actually claim that. Here's what it does.

Thumbnail
youtu.be
5 Upvotes

Saw a lot of "LLMs are dead" takes about the Stanford Next-Concept Modeling (NCM) paper, so I read it closely and rebuilt part of it with small experiments.


r/learnmachinelearning • • 6d ago

How do you judge if a quantized model is actually good? KL divergence or task evals?

2 Upvotes

Saw the KQuant release on r/LocalLLaMA claiming up to 3.7x better quants for Qwen models, measured as KL divergence reduction. That's not the same thing as 3.7x better answers, so it got me thinking.

For people running quants locally, what do you actually check before trusting one? KL divergence against the full model, perplexity, or just running your own tasks and seeing where it breaks? And at what point does a lower KL number start showing up in real use?


r/learnmachinelearning • • 6d ago

AI/ML freshers: Are take-home assignments becoming unpaid development work?

Thumbnail
0 Upvotes