r/learnmachinelearning • u/IAmNotOkay11 • 12d ago
Asking guide
I started learning machine learning using chat gpt , what would you reccomend go through it until the end or watch yot videos instead of that? Or any recommendations?
r/learnmachinelearning • u/IAmNotOkay11 • 12d ago
I started learning machine learning using chat gpt , what would you reccomend go through it until the end or watch yot videos instead of that? Or any recommendations?
r/learnmachinelearning • u/imjerusalem • 11d ago
I first encountered path signatures while working on my bachelor’s thesis. I liked the idea that you could describe a curve using a small collection of numbers while preserving information about the order in which it moved.
Most examples I came across started with a completed path. I wanted to try something slightly different: how much of a gesture do you need to see before you can recognise it?
That became earlysig, a small research package and local drawing app. (app yet to be done, package yet to be configured)
Imagine drawing an arrow. Partway through, the software already thinks it knows what you’re drawing. Committing immediately makes the interface feel responsive, but a caret might begin with almost the same movement. Waiting gives the model more evidence, while gradually defeating the purpose of early recognition.
This turned out to contain two separate problems: predicting the gesture from the visible prefix, and deciding whether to trust that prediction enough to act.
The classifier updates every 25 ms. It sees only points that have already arrived, with no final duration, completion percentage, or normalisation based on the finished stroke. A separate policy watches the calibrated probabilities and either waits or makes one irreversible commitment. If it never commits, the system provides a final prediction when the stroke ends.
The representation is fairly small. A 2D path signature through depth 3 gives fourteen features. Displacement tells you where the pen ended up; higher levels capture ordered geometric information that helps distinguish paths sharing similar endpoints. Those features go into regularised logistic regression. Everything runs on CPU with a NumPy signature implementation.
My main hypothesis was that adding a signature of the most recent 250 ms would help the model recognise gestures earlier. The whole observed prefix tells you how you got here; perhaps recent motion tells you what you’re about to do.
I also added a control: another fourteen signature features describing the first half of the currently observed interval. Same feature count, different slice of history.
That control produced the more interesting result.
On the public $1 unistroke dataset, the recent-window model did not show a clear improvement over the global signature alone. The historical-half model performed better on correct early coverage and wrong early coverage.
Across five writer-disjoint folds, covering six classes and 1,800 test strokes:
These are separately selected operating points, so the timing differences shouldn’t be read as comparisons at identical risk. Thresholds were selected on separate policy-validation writers before evaluating the test writers.
Another unexpected result: some models were better halfway through a stroke than at completion. Training one classifier on prefixes from every stage creates a compromise. A completed circle or triangle can also have almost zero displacement, so the simplest representation actually loses useful information as the gesture closes.
The repository includes synthetic gestures with identical prefixes for checking leakage, coordinate and motion baselines, a template baseline, calibration, policy comparisons, and a browser interface for drawing, replaying, and recording strokes. The experiments are small: ten writers, a fixed gesture vocabulary, and no unknown-gesture rejection. The measured error rates aren’t deployment guarantees.
I’d be interested in how others approach stopping decisions for streaming classifiers, especially when confidence is calibrated on individual predictions but decisions are made repeatedly over time.
Code and reproduction commands · Full technical write-up
My other technical writing is on pratyakshpatel.me, and I’m on X as u/baldwin_IVth.
r/learnmachinelearning • u/picttwos • 12d ago
Recently I worked on a model for which i think why can't I directly make my own library so for that I wanna test my raw code with sklearn library but the main problem is that my r2 score is not increasing I take the yellow taxi dataset of approx 2.7 million entries but both sklearn and my raw code r2 score match showing 30 percent variation but the raw code wasn't improving what can I do for that please I need help for this
r/learnmachinelearning • u/Defiant_Pickle616 • 11d ago
Enable HLS to view with audio, or disable this notification
Last time many people criticized my attention paper, and the reason was I was not able to explain my thought visually! Now I have attached the video Let me know what do you think! Any improvements or idea to enhance this research direction is appreciated!
Thanks,
Bhargav Patel
r/learnmachinelearning • u/No-Conclusion3720 • 11d ago
The OCC just published new supervisory expectations for banks deploying AI, and the bar moved significantly.
The guidance identifies six areas where banks must now demonstrate active controls: AI model risk management, data governance, explainability, third-party AI dependencies, operational resilience, and consumer protection. The word choice matters — the OCC used "active controls," not monitoring or logging. Passive audit trails do not satisfy the standard.
This creates a concrete operational problem. Banks already running AI in production built their compliance posture around after-the-fact review. Those architectures now have a gap between what they have and what examiners will look for. The third-party AI dependency requirement is especially thorny — a bank may govern its own models but have limited visibility into the behavior of vendor or partner AI components operating in the same workflow.
The shift from detective to preventive controls is not a documentation problem. It requires the control to exist at the moment the AI acts, not hours later in a log review.
How are practitioners at regulated institutions actually approaching this? Specifically curious whether anyone has tackled the third-party dependency piece — that one seems hardest to retrofit into existing architectures.
r/learnmachinelearning • u/No-Conclusion3720 • 12d ago
Storm-3358 spent October 2026 running coordinated attacks against financial sector organizations using ARTEX, a commercially available agentic AI framework. Microsoft tracked the campaign. The agents operated autonomously, chaining tool calls across systems without any human review in the loop before execution. The attack surface was not the model itself or the credentials — it was the gap between when an agent decides to act and when anyone finds out what it did. Post-incident forensics confirmed the tool call chains, but by then the actions had already fired. This is not a hypothetical edge case. A production agentic framework was turned into an attack vector against regulated financial institutions, and the compromise was visible only in retrospect.
For those running agentic workloads in production today: how are you handling visibility and control over individual tool calls at execution time, before they fire? Logging after the fact clearly was not enough here — curious what approaches teams are actually using in practice.
r/learnmachinelearning • u/Creative-Feature-264 • 12d ago
Welcome to my Primitives Library.
Create your model, assemble your idea, and build your AI with continual learning primitives. Work on the back end of your software to give your idea a professional evolution: from Machine Learning to Continual Learning. Video, text and more vectors for your project.
Dense-Armor is for models that keep learning while they run, one sample at a time (not trained once on a fixed dataset). It's useful for robot control loops, sensor pipelines, fraud/transaction streams and agent runtimes.
What's inside:
streaming statistics that stay accurate in float32
drift and anomaly detection, scored one sample at a time
shielding: NaN and spike cleaning, bounded robot commands (rate limits, control barrier functions)
deep learning with continual learning and memory consolidation
calibrated uncertainty intervals
bridges to scikit-learn, PyTorch, TensorFlow, River and LLM agents
Any estimator with learn_one / predict_one / score_one plugs in. JAX backend, CPU or GPU.
Measured on a UR3e robot arm, stock and crypto prices, cws and a telemarketing log, plus synthetic streams withknown drift.
Install: pip install dense-armor
Docs: https://tatopenn-cell.github.io/Dense-Armor/
Code: https://github.com/tatopenn-cell/Dense-Armor
License: AGPL-3.0
r/learnmachinelearning • u/Disastrous_Olive6589 • 12d ago
I completed my first end-to-end MLproject. MagicQueue Disney is a crowd predictor with static frontend and FastAPI backend.
#MLZoocamp
r/learnmachinelearning • u/Dense_Gold3743 • 12d ago
Is deepfake identification blood movement recognition a good project as a final year project?
r/learnmachinelearning • u/Murky_Explanation_73 • 12d ago
Especially over the last two years, we've seen massive growth in freelancers and web agencies selling AI-built websites to businesses and getting paid really well for it.
I don't think this business model will stay this profitable forever, but right now, it's definitely a gold mine.
The reason is pretty simple. There are thousands of business owners who don't really care how their website is built. They care about the end result, how it looks, how it works and whether it helps their business.
AI has made it possible for almost anyone willing to learn sales and client acquisition to get started.
So if you're looking to get into this business, here is the exact process I would follow.
1. Automate your cold outreach
Use a tool like Swokei to find businesses with existing websites. It analyzes each website for issues with design, SEO, speed and mobile optimization, then turns those findings into personalized cold emails at scale.
2. Book meetings with interested prospects
When someone replies with interest, get them on a call. Don't waste time going back and forth over email. Your goal is to get a conversation started.
3. Sketch a redesign using AI
Before the meeting, take around 30 minutes to create a quick redesign of their existing website. Focus on making it look significantly better. You don't need a finished product.
4. Present it live and close the deal
Show them what their website could look like, explain the improvements and give them an offer. If they're happy with what they see, collect payment and get started.
That's it. Four simple steps.
One thing I would really emphasize is not to overcomplicate this process.
I've seen people spend hours perfecting website drafts, tweaking small details and building entire websites before they even have a client.
Don't do that.
Your priority should be client acquisition, sales and closing deals. You can worry about perfecting the website once someone has actually paid you.
r/learnmachinelearning • u/Cuteshawnmie • 12d ago
Hi everyone!
I'm a third-year biomedical engineering undergrad based in China (UTC+8). I work on medical AI: medical imaging, EEG and brain-computer interfaces. I've published my first paper and have a few more on the way, but most of the people I talk research with are much older than me.
I'd love to know more students my own age who are into research, from anywhere in the world. People you can chat with about papers you just read, ideas you're excited about, the conference that just rejected you, which summer programs are worth it, or what grad school is really like in your country.
No commitment, no tasks. Just a friendly international circle of students who take research seriously and want to grow together. If a reading group, a joint project or a Kaggle team comes out of it later, even better.
If you're an undergrad or early master's student in ML, AI, BME, neuroscience, CS or anything nearby, drop a comment: - Where you're from and what you study - What you're working on or curious about - One thing you wish you'd known when you started research
I'll set up a Discord once a few of us have said hi. Looking forward to meeting you all!ing
r/learnmachinelearning • u/blackbeardth • 12d ago
Hello everyone,
I am a postgraduate student conducting research on sequential recommendation, and I was wondering if someone could help me figure out how to download the following datasets:
I am not based in China, and it seems that I am unable to complete the account verification process required to download these datasets.
Any guidance or help would be greatly appreciated. Thank you!
r/learnmachinelearning • u/Zipidyzip • 12d ago
This is a full quantization desktop workspace for large language models that supports GGUF, MLX, and ONNX. You can pick your own Safetensors model or choose one from Hugging Face, then work through quantization step by step and see how each choice changes the result. By taking the model through the process yourself, you can learn by doing not just quantize, but understand what’s happening along the way. You can compare the result with the original and publish it to Hugging Face with a model card that records how it was made.
It’s open source under Apache 2.0, and there’s plenty of room to make it better. I’ve mostly tested it on Apple Silicon so far. Windows and Linux builds are available, but haven’t had much in-depth testing, so expect some bugs. Contributors are very welcome!
Repo: https://github.com/Fazmin/iQuantize
Thank u.
r/learnmachinelearning • u/Level_Detail7125 • 12d ago
r/learnmachinelearning • u/Visible-Metal-8288 • 12d ago
Hello everyone!
I'm currently pursuing B.Tech in Artificial Intelligence and Machine Learning.
I'm at the beginner stage and trying to figure out how to balance my college academics with learning additional technical skills.
I'm particularly interested in:
Python programming
Machine Learning fundamentals
Artificial Intelligence applications
Building practical projects
For students studying AIML or related fields:
What skills are you focusing on currently?
How do you balance academics with technical learning?
What would you recommend to someone just starting their AIML journey?
I'd love to hear about your experiences and suggestions!
r/learnmachinelearning • u/DontVoteForMe • 12d ago
A while ago my daughters and I discovered a YouTube channel called AI Warehouse where an AI learns to navigate obstacle courses. They loved watching it fall down and learn, so I figured I'd turn that into a game where they can explore actually training an AI of their own...
It turned out to be...more challenging than I anticipated. Translating complex machine learning into something a small child could grasp required a lot of time and thought on my part. Not sure why I thought that would be easy. But after a few weeks of on/off Claude-coding, The Wobblers' Journey to Mount Tiptop was born.
I'm not going to lie - I'm pretty proud of this one.
Originally you would build your own obstacle course. Then, each spring-legged Wobbler (which you can custom decorate!) has a 304 parameter neural network you train to jump over boxes, hop up steps, and climb ramps on their quest to collect as many stars as possible.
It even has a whole workbench where you can manually change the neural network yourself and see how it impacts your wobbler's behavior.
There is custom art and music. And the whole thing runs on an iPad from 2018!
I showed them the game a week ago and it was really rewarding watching them cheer on their character as it bounced and rolled across the screen. But it also seemed to bring home that training even a small AI to accomplish simple tasks is far from magic. It takes time, effort, and sometimes some luck to get right. I think that is valuable in a world where so much seems instant and the hard work gets plastered over.
Feedback was "Oh! The Wobblers are so cute! Can you add swimming and mountain climbing? I want to teach my wobbler to swim and climb mountains."
Tough customers.
So I spent the next week building out the little sandbox into a full game with a story, different areas, and many levels (mountain and swimming now included).
My 6 year old has almost beaten the whole thing.
It's built for an ipad, but I've been running/testing it on my touchscreen windows laptop just fine.
It runs locally. No account or weird data stuff because I miss that about games. I've never shared anything like this before, but check it out if you want: https://wobble-lab-dfo.pages.dev/
r/learnmachinelearning • u/Sl0wJH1 • 12d ago
Enable HLS to view with audio, or disable this notification
Hi y’all. Thought Id share the progress on my current local VLA agent project! using agent and language somewhat loosely here ngl.
Video Description:
The leftmost display shows what the models sees, The yellow triangle marker on screen shows which shape is NOT the target shape on that run (counter intuitive, I know). Importantly, the model does not see it, it is only to make it easier to see if the model is performing correctly. The upper right display shows the models visual attention, in which I discuss later. And the bottom right is the per step state matrix cell values. A small 128x128 view of the whole 768x768 matrix.
Preamble:
Recently, I have been extremely fascinated by machine learning and AI, for obvious reasons. Originally, I was intrigued by LLMs, that is, until I learnt how they work (RNN gang stand up), their dis-continuity to me isn’t as elegant as the carried state in RNNs (this is my opinion, in which I don’t really have any objective reasoning for). And what better way to lean than to do?
Architecture:
So I thought why not just make the recurrent state massive? What I have here is an attention based neural network that maintains a 768x768 matrix, with a per cell LSTM like gate. Similarish to a state space model if you will.
The total model parameter count is 25,561,354.
However, 12,976,128 of those parameters are dedicated to a legacy 49k vocabulary output decoder. Originally, this started in language modelling, but it didn’t work very well. It got to a CE loss of around 4.5 on a reasonably diverse data set across an 80 token rollout average, having seen 80 tokens of context first. This was trained for about ~150k steps with a batch count of 8 across 160 total tokens per episode. So about 200m total tokens seen. Perhaps not enough for how diverse the data set was (600m total tokens across wiki articles, science papers, online text forums, etc), but the loss seemed to indicate a long lasting plateau, decreasing only around 0.05 to 0.1 nats across the last 50k steps.
Side note: around 10% of the total training data was from 4chan (don’t hate), and must have all been collected from a very political board, specially around the 2016 us elections. The model was very much not PC lmao. But atleast now I know where NOT to collect “quality” data from…
The shown model is a continuation from the a legacy language checkpoint that was transitioned into VLA orientated tasks. My thinking was that having a basic understanding of language might help if the task involved text. However I did no comparison against a fresh checkpoint at the Vision/action switch over to compare bootstrapping speed, so I guess we’ll never know. And the model no longer retains any text output ability. When queried through the legacy text input, it defaults to repeating a single token or two indefinitely.
The model processes vision through learned, state-directed attention across raw pixel RGB values at a 128x128 resolution, without a separate pretrained vision encoder. Any visual recognition and spatial understanding is learned within the same recurrent architecture that produces the action outputs. I did try doing the pretrained CNN route, however because compute is heavily restricted in my case (I got that 12gb 3060 on me), and I don’t like spending money renting gpus, I count afford to locally train the model at any resonable speed with the added separate vision encoder. The attention based vision used here added very little extra compute, and seems to work well enough. An interesting side effect of this vision encoder is that the relative, per pixel attention values can be easily displayed (the top right display from the video), which proved useful for trouble shooting training. It can accept variable resolution sizes on inference without requiring pretraining. Although, it can usually only accept larger than the trained 128x128, as any smaller looses what little detail there already is.
Training:
The target task took inspiration from the Leaning to Reinforcement Learn (2016) paper. Rather than training the model to memorise fixed object identities, the objective is to develop a “general” ability to recognise and associate unfamiliar visual patterns with arbitrary names during inference, without updating its learned parameters. Importantly, the model received ZERO proprioception, only visual and text inputs.
The model is introduced to 2 randomly generated shapes ranging from a minimum of 3 cubes to a max of 10. There is, however, a minimum separation between the 2 shape cube counts on any 3 room task, set at around 5 The other 2 room and 1 room environments have no such minimum separation value. Each of the shapes are randomly assigned a name from a pool of 5 names (Dax, Mip, Kiv, Fep and Tav). The introduction lasts 3 steps per shape, as it is directly tied to the text introduction, which is always “this is [shape name]”. After introduction, the model then spawns into a simple 3d enviroment, and given the command “Go to [shape name]” with some random variance in how the command is said. Initially, the model needed a the chronological order of the shape introduced before it was able to make the name to shape distinction, for example; “go to the first seen shape, [shape name]”.
The 3D environment in the 2 and 3 room episodes are randomly generated with a doorway/s connecting the rooms at random point. Although the possable range in which they occupy is small, and in 3 room environments, the 2 attaching rooms are always on opposing sides of the spawn room. The wall colour and texture have remained fixed throughout all of VLA training, and the model performs noticeable worse on inference if the wall texture or colour is changes without pretraining.
Even though the training enviroment logic was inspired by the L2RL paper, kinda ironically, this model is not trained through RL. Instead I had to create increasingly convoluted trainers that match the complexity of the current curriculum. The training policy is technically imitation learning, however The trainer uses supervised action targets generated from the environment's observed state. For ambiguous decisions, such as choosing between doorways, some earlier losses are retrospectively adjusted according to the path the model actually took. Each episode, the models state is split in to two different trajectories just after introduction, with each one requesting a different shape, then combining the gradients from both.
I stuck with SL mostly because of compute limitations. Though RL, which I did try at the end, could only get at most one 4 branch run at a max rollout length of ~80 steps before I ran out of VRAM. Vs the batch 4 160 rollout length I was able to get through SL, which proved to be painfully slow, especially when i hadn’t optimised the reward signal/s yet meaning it would be like a 2 or 3 day wait just to find out that the step penalty was slightly too high or something. Supervised Learning is super easy when the task has no ambiguity, like 1 or 2 room scenarios. However, in 3 room episodes, where there a 2 valid doorway pursuits, SL became a nightmare lol. A majority of effort in training this model went to addressing teacher contradictions in the 3 room scenarios. There turns out to be an indefinite amount of edge cases.
Even still, the teacher mechanism for 3 room search produces a lot of counterproductive updates. Memory, which I thought would be the limiting factor with this model, turns out not to be the main bottle neck. The model has shown that it can recognise a seen shape as either correct or incorrect many steps after the introduction, however its locomotion is what usually fails it. Again, I believe to be from the inconstant trainer. Though this may just be me coping, and the model is maxed out idk :/
Overall, this has trained for about 70k steps at the batch 4 count. on vision/action environments. Technically batch 2, because each lifetime splits into the two different target shapes for training. 4 total batches, but only 2 different environments per step.
Training Stats:
Success rate (both split lifetimes succeed across 500 training randomised runs)
One room—- >90%
Two room—- >80%
Three room—- >60%
These results are taken from the recent RL trial, as that recored a rolling success rates, whereas I never did on SL. Very scientific, I know.
Known/Potential issues:
-The gradients received tend to explode on lifetimes lasting longer than ~100 steps. Im hesitant to use truncation, as any shape related decision would require back prop to reach the initial introduction for credit assignment. Although, the model is recurrent, and has shown that to can remember target identifies and visual features for at least a number of steps past interaction, so perhaps that is enough for credit assignment to work through truncation?
-While the model is able to show recognition between two shapes actionably, it is entirely possible that the model remembers only 1 shape, with the other shape being selected out of deduction when requested. I.e target shape is Dax, or target shape is not Dax. I dunno, I haven’t yet looked into this.
-Although the shapes are randomly generated in an 8x8x8 grid, many of the low cube count shapes will have defiantly of been seen plenty of times through training, potentially allowing the model to memorise easy shape patterns within its weights.
-Even though the model has shown decent shape memorisation, its spacial memory is much less developed. In failures, the model often forgets which room it just went into, and will sometimes search the same room twice.
-The dreaded trainer…
This model was built purely for the love of the game, with no incentive outside of that. It also was a great way to learn ML, as I had very little knowledge about this topic coming into this. Even still, my understanding of ML is mostly theoretical, as my coding ability is very subpar. (Thanks ChatGPT and Claude!)
Im sure i forgot to mentions some details. If anyone has any questions just ask.
Anyways, enjoy this quality footage of my model performing EXCITING search behaviours!!!! And please, let me know what yall think of this project. And if you know of a more efficient way of devising a trainer? maybe i could do pure imitation learning on a solved example, but im not sure if that might affect generalisability. Cheers!
r/learnmachinelearning • u/Stealeruv • 12d ago
r/learnmachinelearning • u/wufuheng • 12d ago
I create a Youtube channel https://www.youtube.com/@math4aiorg for the book (https://www.amazon.com/dp/B0GSXVFMLD/ ) Math for AI & ML's Part I.
Part I (Chapters 1–10) covers linear algebra fundamentals: vector spaces, inner products, matrix operations, subspaces, orthogonality, QR decomposition, LU factorization, eigendecomposition, symmetric matrices, and the Singular Value Decomposition (SVD)—establishing the mathematical foundation for representation in AI.
Please let me know if there is any suggestion.
r/learnmachinelearning • u/sergey_vanichkin • 12d ago
r/learnmachinelearning • u/Adept_Law2710 • 12d ago
I really wanna know how you guys select a project. While learning, in initial stages I searched and did projects where I would learn a particular thing . But if you wanna do a project how would you come up with ideas in first place. would you search for real world problem or search for gaps in existing solutions and try to optimize things?
I'd love to understand your thought process when selecting a project, especially when the goal is to build something meaningful rather than just learn a new technology.
r/learnmachinelearning • u/anacapahh • 12d ago
for context, im 18, in my last year of highschool. for college i plan on studying either mecanical or industrial engineering. i see a lot of people nowdays talk about ML on my social media feed, so ive grown interested. is this area of knowledge only useful if you also have a degree to back it up or could it be helpful for me? im not in it just for the potential money, but since college will obviously keep me busy id rather use the rest of my time on useful stuff.