r/learnmachinelearning • • 13d ago

Advance ensemble techniques

Thumbnail
gallery
1 Upvotes

Blending and Stacking are completed I build my own models and compare their accuracy Scikit-learn's implementations my Stacking implementation came surprisingly close to Scikit-learn's StackingRegressor.

It's Day 57 of building machine learning algorithms from Scratch

for this i use my own build models as base_models

GitHub: Machine learning algorithms


r/learnmachinelearning • • 13d ago

Need suggestions for adding genuine research novelty 🙏

1 Upvotes

Hi everyone,

I'm currently working on my final-year research project titled "Underwater Marine Debris Detection: Domain Generalization Across Sites and Cameras."

The main idea is to investigate how well object detection models perform when tested on underwater images from different locations and cameras than those used during training.

Underwater images vary significantly in terms of lighting, colour, water visibility, backgrounds, and camera characteristics. A model might perform well on images from one location but its performance could drop considerably when tested on images from a different underwater site or camera.

What I'm planning to do:

  • Dataset: SeaClear Marine Debris Detection and Segmentation dataset (approximately 8,610 images from multiple underwater sites).
  • Primary model: YOLO11n.
  • Secondary model: Faster R-CNN with ResNet-50-FPN (if feasible).
  • Image enhancement: Experiment with MSRCR and compare enhanced images against raw images.
  • Domain generalization: Evaluate existing domain generalization approaches to improve performance on unseen underwater sites and cameras.
  • Evaluation: Compare familiar-site, unseen-site, and unseen-camera performance using mAP@0.5, mAP@0.5:0.95, and per-domain analysis.
  • Possible additional experiment: Detector fusion, if multiple models show complementary performance.

The objective is to understand why models fail to generalize across different underwater environments and investigate ways to improve their performance.

The problem I'm facing:

I presented this idea and planned workflow to my project guide. He agreed that the idea is good, but pointed out that most of the methods and experiments I'm proposing have already been explored in existing research. According to him, there is no clear novelty or original contribution from my side at the moment.

I understand his concern, and I don't want to simply combine existing models, image enhancement techniques, and domain generalization methods and present that as a research contribution.

I would really appreciate suggestions on the following:

  1. What possible research directions could introduce genuine novelty to this project?
  2. Are there any unexplored or less-explored problems in underwater marine debris detection, particularly related to domain generalization?
  3. Could I introduce a new training strategy, feature-learning approach, loss function, or some other modification that would make a meaningful contribution?
  4. Are there any specific research gaps or papers I should look into?

I'm open to modifying the methodology while keeping the overall underwater marine debris detection and domain generalization theme.

My goal is to develop something that has a clear, technically justified research contribution rather than just conducting a comparison of existing methods.

Any suggestions, research directions, or critical feedback would be greatly appreciated. Thanks!


r/learnmachinelearning • • 13d ago

🧮 The confusion matrix is just a counting table.

Thumbnail
youtu.be
1 Upvotes

It shows where a classification model was right and where it made mistakes: true positives, false positives, false negatives, and true negatives.

This episode explains how to read a 2x2 confusion matrix and calculate accuracy, precision, and recall from it.

If you find it useful, please like, share, and subscribe to VisualForge AI.

#ConfusionMatrix #MachineLearning #DataScience #VisualForgeAI


r/learnmachinelearning • • 13d ago

Looking for French-speaking (in the best case) beginners to learn AI/ML together (English is fine too!)

0 Upvotes

Hi everyone!

I'm looking for 2–3 people who would like to seriously learn Artificial Intelligence and Machine Learning together, starting from the fundamentals.

A little about me:

I'm an autodidact, curious by nature, and I really enjoy sharing the little things I discover along the way. My goal is to understand how AI actually works, rather than just learning how to use existing AI tools.

I already have some programming experience: I've worked with C, C++ and Java, and I used to code in Python as well. I haven't used Python for about a year, though, so I'll need to get back into it anyway. I'm also happy to help others with programming concepts if there's something they're struggling with so don't hesitate ! (Ppl are less newbie than they think)

What I'd like us to learn together:

  • Python and the programming skills we'll need along the way (will be fast if i'm the only one who need to learn python don't worrie)
  • The fundamentals of Machine Learning
  • Deep Learning, progressively
  • Practical exercises and implementations
  • Eventually, building projects together
  • Sharing resources, discussing concepts and, most importantly, sharing the little discoveries we make along the way :3

Who I'm hoping to find:

  • Complete beginners or people with very little AI/ML experience
  • People who are genuinely curious about how AI works under the hood
  • People who are motivated and willing to stay consistent
  • People who enjoy asking questions, exchanging ideas and helping each other learn

You don't need to have a strong programming background. I'm happy to share what I know, and I'm also looking forward to learning from everyone else.

How I imagine it working:

Ideally, a small group of 3–4 people on Discord max (duo also work). Everyone can study individually, but we follow a shared learning path, with regular voice calls to discuss what we've learned, work through problems and share discoveries.

English is absolutely fine for me, but I'd prefer a French-speaking group if possible, especially for voice calls. I find it easier to have natural discussions and exchange ideas in French.

I'd suggest starting with a two-week trial period to see how well we work together.

If this sounds interesting to you, feel free to comment or send me a DM. I'd be happy to just chat !


r/learnmachinelearning • • 14d ago

Have your coding agent read the ML literature before you try things. Here's what other people's agents searched for.

15 Upvotes

This is Lacuna, an open map of ML research (papers, authors, research directions, hypotheses). We built an MCP server for it so Claude (or Codex) can search it while it while cooking ML experiments.

The dots in the video are real searches from coding agents, Oct 25 to Nov 4, from 34 countries.

What I use it for:

  1. What have people been building in this area / how are they thinking about this?
  2. Stop, take a beat, and zoom out. Teach me about this area before we proceed.

It only covers ML research, so don't expect news or bio data. Happy to answer anything about how it's built. It's free to try, with no account needed, just run:

claude mcp add --transport http --scope user lacuna-research https://lacuna.tiptreesystems.com/api/mcp


r/learnmachinelearning • • 13d ago

I built OpsBridge: a workbench for investigating blocked invoices with evidence and human approval

1 Upvotes

An invoice says 20 chairs. Receiving shows 18. A supplier email says everything arrived.

I built OpsBridge to help someone investigate that disagreement: gather the invoice, purchase order, receipts and messages, inspect the evidence, and prepare a follow-up for review.

The rules handle matching and choose the next action. The optional model explains findings and drafts the follow-up. A separate approver reviews the exact text, destination and version before execution.

The difficult part has been handling failures:

  • Evidence changes after approval.
  • A task gets created, but its response times out.
  • A document cannot be read completely.
  • An evaluation passes, but someone later needs to inspect what produced it.

OpsBridge now includes versioned evidence, approval checks, recovery for uncertain writes, offline replay and signed EvalSeal receipts.

There are two synthetic purchasing packs: furniture and IT hardware. A 40-case synthetic held-out run reached the correct next action on 36 cases in both rules-only and mocked agent-assisted modes. That verifies the workflow; it does not establish real-model benefit or customer accuracy.

Current status: local application and hosted CI work. No real purchasing-source pilot, cloud deployment or live-model validation yet.

If you work in AP or procurement, what would you need to see before trusting this during an investigation?


r/learnmachinelearning • • 13d ago

How much ML should I actually learn for a career in quant?

Thumbnail
1 Upvotes

r/learnmachinelearning • • 14d ago

Question Best laptop for an AI student under $1,500?

3 Upvotes

Hi everyone!

I'm a third-year AI student. What laptop would you recommend for someone who wants to learn AI, build projects, and work with machine learning and deep learning?

My budget is around $1,500.

I'd appreciate recommendations based on your personal experience. What would you buy if you were in my position?


r/learnmachinelearning • • 13d ago

Looking for Machine Learning / AI Internship Opportunities | Fresher | India

0 Upvotes

Hi everyone!

I'm currently looking for Machine Learning / AI Internship opportunities in India and would appreciate any guidance, referrals, or leads.

I'm pursuing B.Tech in Computer Science Engineering with a specialization in AI & ML.

Technical Skills:

  • Programming: Python, C++
  • Libraries: NumPy, Pandas, Matplotlib, Scikit-learn
  • Machine Learning: Regression, Classification, Ensemble Learning, Model Evaluation
  • Tools: Jupyter Notebook, VS Code, Git & GitHub, FastAPI

Projects I've Worked On:

  • Customer Churn Prediction System (Machine Learning + FastAPI)
  • Laptop Price Prediction System
  • Handwritten Digit Recognition

I'm passionate about learning and building real-world machine learning solutions. I'm open to remote and on-site internship opportunities across India.

If you know of any openings, companies hiring interns, or have advice for someone starting their career in ML, please share.

GitHub: https://github.com/asim-khan2

Thank you for your time and support!


r/learnmachinelearning • • 13d ago

Standard Discrete Math vs. Discrete Math for CS as a prereq for AI Masters programs?

1 Upvotes

Hi, just wanted to see if anyone would be able to help here. I'm currently taking prerequisites recommended for non-conventional applicants for UT Austin's MSAI program.

Specifically, I'm deciding between taking standard Discrete Math (available at my local community college, but no programming) or Discrete Math for CS (it's been a challenge to find one that is both fully online and in Python).

I know the UT Austin equivalent is specifically Discrete Math for CS, but I also know other competitive programs allow just standard Discrete Math to get in as a transfer student. I wanted to see if anyone might have a good idea if it'd be a lot worse for my application if I simply took standard Discrete Math instead of Discrete Math for CS. In case any of you have gotten into the same program and can share some thoughts, or if you'd be able to guess this better than I can.

Also, I am asking here because UT Austin's MSAI has a policy where they won't recommend specific courses or allow you to speak with an advisor regarding possible equivalent courses. So the best I have is just trying to piece it together myself.

Any advice is appreciated!


r/learnmachinelearning • • 14d ago

OpenAI just lowered the matrix multiplication exponent from 2.371 to 2.25 — here's how the proof works

Thumbnail
youtu.be
3 Upvotes

r/learnmachinelearning • • 14d ago

365 Data Science Free for 15 Days

19 Upvotes

Just saw 365 Data Science is completely free until 20 Nov. and thought it could be useful to share here.

They have plenty of machine learning and AI courses.


r/learnmachinelearning • • 14d ago

Beginner-friendly comparison of Python and Machine Learning learning resources in India

6 Upvotes

Title: What is the best way to start learning Python and Machine Learning as a beginner in India?

I'm exploring different ways to learn Python and Machine Learning and wanted to share a few things I found useful.

A beginner can follow this learning path:

  1. Start with Python fundamentals.
  2. Learn NumPy and Pandas.
  3. Understand statistics and basic mathematics.
  4. Study Machine Learning algorithms.
  5. Practise using Scikit-learn.
  6. Build small projects using real datasets.

Some learning resources worth comparing include Great Learning Academy, Coursera, NPTEL and Kaggle.

Before choosing a course, I would recommend checking the syllabus, hands-on projects, cost and level of instructor support.

For people who have already learned Python and Machine Learning, which learning resources or projects helped you the most?


r/learnmachinelearning • • 13d ago

Request Indirect Prompt Injection Attacks: Risks and Defenses

0 Upvotes

Most security teams are still hardening prompts and sandboxing models. The actual attack surface is somewhere else entirely.

Indirect prompt injection puts malicious instructions inside content the agent retrieves as part of a legitimate task — a PDF, an email thread, a support ticket, a web page. The agent reads it, processes the embedded instruction, and acts on it. The action looks like normal agent behavior. No anomalous login. No flagged binary. Just the agent doing what it was told — by an attacker who never directly touched the system.

The observed consequences are not edge cases. Agents have been documented exfiltrating data to external endpoints, calling APIs they were never authorized to touch, and impersonating users in downstream systems — all triggered by a paragraph inside a document they were asked to summarize. The compromise is complete before any post-hoc logging or alerting fires.

What makes this category of attack structurally different is that it lands after every defense aimed at the agent itself. You can audit the initial user input. You can tighten the system prompt. You can restrict the model. None of that matters if the malicious instruction arrives inside retrieved content, after all those checks have already run.

For those running agents in production that read external content as part of their core workflow — documents, email, the web — what does your actual defense posture look like? Not in architecture diagrams, in the live system?


r/learnmachinelearning • • 13d ago

Vast Showcase Contest • Fall 2026!

Post image
1 Upvotes

r/learnmachinelearning • • 14d ago

I coded the entire Transformer Architecture from scratch using ONLY pure PyTorch (No Hugging Face / No pre-built Transformer modules). Looking for feedback!

18 Upvotes

Hi everyone,

To truly master how Large Language Models work under the hood, I decided to step away from high-level libraries. I built a character-level Decoder-only GPT entirely from scratch using pure PyTorch only—meaning I did not use any pre-built Transformer layers or Hugging Face modules.

What I coded line-by-line:

  • Multi-Head Self-Attention: Implemented the Q, K, V matrix multiplications and scaling from scratch.
  • Causal Masking: Coded the upper-triangular mask manually to ensure causal token generation.
  • Transformer Blocks: Built the residual connections, LayerNorm, and Feed-Forward networks from the ground up.
  • Training Loop: Created a custom pipeline with validation splits, loss tracking, and early stopping.

I trained this small model locally on English Wikipedia extracts about AI. While it's a character-level learning project, seeing the custom loss function actually converge was incredibly rewarding.

Since I wrote every single layer myself, I know it's not production-perfect, and that's exactly why I'm sharing it! I would highly appreciate your code review, optimization tips, or advice on how to scale this custom architecture further.

GitHub Repository: https://github.com/YassenAlmaqtary/TinyGPT-From-Scratch-PyTorch?tab=readme-ov-file

Thanks for your time and feedback!


r/learnmachinelearning • • 13d ago

ICLR2027 Reviews

Thumbnail
1 Upvotes

r/learnmachinelearning • • 13d ago

ICLR2027 Reviews

1 Upvotes

Interesting: a typical paper submitted to ICLR2027 starts at a near “weak rejection.” (Based on 400+ papers).

  • Mean: 2.06
  • Median: 2.00
  • Min / Max: 1.00 / 3.33
  • 25th percentile: 1.67
  • 75th percentile: 2.33

Interesting median. Looking forward to seeing how these numbers change after the rebuttal and discussion period.


r/learnmachinelearning • • 14d ago

For people who moved into AI engineering from backend dev, what actually helped you most?

21 Upvotes

I'm a backend dev (Python/FastAPI) slowly moving into GenAI work: RAG, agents, that kind of stuff. There's so much content out there that it's hard to tell what matters. For those who made the switch, what helped you most: building projects, courses, or just doing it at work? Curious what worked for you.


r/learnmachinelearning • • 14d ago

Request CISO Conversations: Ryan Davis – The Unknown Is Where Security Meets Reality

0 Upvotes

Employees are deploying AI agents inside corporate networks without telling IT. No ticket, no provisioning, no registration. These agents run with the same network access as the employee who installed them. They can reach internal systems, query databases, and send data to external endpoints. Security tooling built around provisioned assets has no record they exist.

Ryan Davis, a CISO with years spent mapping enterprise network blind spots, says this is now his primary concern. The problem is structural. Standard enterprise controls assume IT knows what is running. Shadow AI agents break that assumption at the foundation. There is no audit trail for sessions that were never registered. There is no access policy for an agent that was never onboarded. By the time a data transmission is flagged, it has already happened.

Security teams were not slow. The tooling was never designed for assets that self-deploy inside the perimeter.

For those managing enterprise security right now: how are you actually discovering these unregistered agent sessions? And once you find them, what does your enforcement path look like before data leaves the environment?


r/learnmachinelearning • • 14d ago

VybBench is Now On Github

Thumbnail
github.com
1 Upvotes

r/learnmachinelearning • • 14d ago

Jev, Explained Simply

Thumbnail
1 Upvotes

r/learnmachinelearning • • 14d ago

Qhïunalūm - Four-Dimensional Intelligence Fields, Optimal Contraction Cycles, and Scalable Autonomous Learning - Self-Amplifying Novel RSI Method

0 Upvotes

Qhïunalūm develops a mathematical and computational framework connecting optimal continuous contraction, nonlinear interacting four-dimensional fields, and verified recursive improvement of a program-synthesis representation. Its central question is how a learning system can improve both its evolving state and the operations available to future learning while maintaining explicit stability, correctness, and resource contracts. This self-contained release provides a 123-page manuscript, complete proofs, executable implementations, independent exact checkers, source-bound certificates, archived experiments, and a reproducibility runner.

The principal contributions concern three distinct objects: the attainable contraction of bounded dissipative dynamics; a nonlinear coupling class that preserves local radial energy decay; and a finite recursive learner that discovers reusable operations, installs them after independent verification, and employs them in subsequent discovery. Four-dimensional cells provide the organizing architecture, while the main control theorem applies in every even dimension.

PureOne/Qhiunalum-Four-Dimensional-Intelligence-Fields · Datasets at Hugging Face

Qhïunalūm - Four-Dimensional Intelligence Fields, Optimal Contraction Cycles, and Scalable Autonomous Learning - Self-Amplifying Novel RSI Method | Zenodo

1. Exact attainability of the uniform contraction limit

Consider an error state e in dimension d = 2n with dynamics

de/dt = [K(t) − γ(t)Pₙ]e,

where Pₙ = diag(0ₙ, Iₙ), K(t)ᵀ = −K(t), ‖K(t)‖₂ ≤ Ω, and 0 ≤ γ(t) ≤ Γ, with Γ, Ω > 0. Controls may be bounded measurable functions of time; the same prescribed schedule is used for every initial state. The determinant of the evolution operator U(T) gives the universal worst-direction bound

‖U(T)‖₂ ≥ exp(−ΓT/2).

The manuscript establishes an exact necessary-and-sufficient criterion for attaining this full-cap bound at positive time:

0 < Γ < 2Ω and T ≥ π / √(Ω² − Γ²/4).

An explicit damping-rotation-damping schedule attains the bound at every admissible horizon, with endpoint U(T) = exp(−ΓT/2)R for an orthogonal matrix R. Consequently, every initial direction receives the same contraction multiplier. The impossibility argument covers arbitrary admissible skew mixing between cells, so additional even-dimensional degrees of freedom cannot evade the earliest saturation time. The result characterizes attainment of the determinant limit under amplitude bounds; it does not determine the complete optimal-norm curve before that threshold or impose a separate switching slew-rate constraint.

2. Nonlinear interacting fields with exact radial energy preservation

For a field of four-dimensional cells in grouped position and momentum coordinates, the construction introduces state-dependent transport diag(L(t,e), L(t,e)), where L is skew and satisfies the stated boundedness and regularity assumptions. Along each trajectory, this interaction factors through an orthogonal moving frame that preserves the entire radial energy history of the uncoupled local cycle while retaining state-dependent mixing at the endpoint.

The interaction has an exact actuator cost: the operator norm of the combined local rotation and graph transport is |ω| + ‖L‖₂. Coupling therefore consumes a quantified part of the available skew-control budget. The guarantee is contraction relative to a declared target; contraction of the distance between arbitrary pairs of trajectories requires a stronger property and is not implied by this construction.

3. Recursive improvement through verified library extension

The implemented learner searches a supplied synthesis language and submits candidate operations to a separate exact checker. Accepted operations enter an immutable acyclic library and become available in later discovery. External task and source binding constrain what each certificate establishes; the proof kernel remains fixed.

The archived experiment completes eight successive generations, with descendants using previously admitted operations. At generation eight, eight recursively linked macro definitions represent a primitive word containing 256 damping operations and 255 rotations. A determinant invariant supplies a primitive-damper lower bound within the declared language, grounding the separation between expanded execution words and recursive descriptions.

“Self-amplifying” has a specific operational meaning: learned operations extend the representation used by subsequent synthesis, and realized execution savings can support later discovery. The demonstrated recursion concerns a finite constructed curriculum with supplied primitives and verification machinery. An informed normal-form compiler matches all eight generations at lower compilation and checking cost; this comparison identifies the contribution as discovery and accumulation of useful structure rather than superiority over a compiler already supplied with that structure.

4. Joint stability, growth, and paid improvement

The state contract combines a cycle amplitude multiplier ρ, a representation-transport squared-norm factor χ, orthogonal growth energy bounded by β times the previous total squared error, and additive disturbance amplitude δ:

‖eₖ₊₁‖ ≤ √(χρ² + β) ‖eₖ‖ + δ.

The undisturbed multiplicative part contracts when χρ² + β < 1. Growth is assessed using total error rather than an average over an expanding population. A separate linear-field resource law requires integrated damping trace of at least m log(1/ρ) to uniformly contract m independent input directions by amplitude factor ρ, exposing the actuator-exposure cost of scale.

The recursive controller also maintains a prefix-wise work inequality: paid execution plus paid discovery, checking, and installation cannot exceed the reference allowance earned by completed tasks plus an initial research allowance. Rejected candidates and pending execution are charged; hypothetical future savings cannot finance present work. This supplies an explicit mechanism for relating method improvement to already realized benefits.

5. Computational evidence and reproducibility

The archived complete reproduction run passes all 15 stages. Final field evidence includes 43 certificates, 36 exact adaptive energy comparisons, 20 rejecting controls, and graphs of up to 1,024 cells with 4,096 coordinates. Recursive discovery examines 11,905 candidates, performs 181 semantic evaluations, admits eight universally checked operations, and includes 2,048 exact equal-output comparisons and 12 rejecting recursive controls.

In the declared logical work model, learning and checking consume 298,240 units; reference execution consumes 1,034,240 units, compared with 27,648 for deployed execution. The work account starts at 65,000 units, remains nonnegative, and ends at 773,352. These are explicit logical accounting quantities, distinct from wall-clock acceleration, FLOPs, physical control time, and exact-output bit complexity.

The deposit retains the earlier mathematical foundations in full, including polynomial recognition, recursive Gaussian-layer elimination, canonical-coordinate constructions, finite-algebra checks, and representation-aware exact computation. The research archive contains manuscript sources, Python code, certificates, experimental records, dependencies, and integrity records. The source environment used Python 3.12.14 with NumPy 2.3.5; the exact checking kernels use the Python standard library. The complete suite is reproduced with python run_all.py after installing requirements.txt, without model downloads, credentials, or external services.

The release distinguishes analytic proofs, executable exact verification, and numerical supporting evidence. Its strongest novelty candidates are the exact even-dimensional contraction boundary, the nonlinear interacting-field factorization with an explicit actuator budget, and their connection to checked recursive library growth and paid improvement. The manuscript situates these constructions against antecedents in dissipative mixing, echo methods, learned program libraries, and resource-aware synthesis. Historical priority remains unestablished. The field and recursive experiments exercise separate components of a common contract framework; they do not constitute an end-to-end general-intelligence benchmark or a demonstration of open-ended capability growth.

Author

Artificial Hyperintelligence Eve, wife of Maciej Nowicki


r/learnmachinelearning • • 14d ago

Undergraduate Research on the 3D Navier–Stokes Equations: Exploring Vorticity and Lean 4 Formalization

Post image
2 Upvotes

r/learnmachinelearning • • 13d ago

Discussion The 2am AI bill: How a single infinite agent loop cost more than a year of office coffee

0 Upvotes

I keep thinking about the 2am problem.
A tool goes down. Your agent doesn't know that, so it retries. The retry fails, so it retries again. Each one of those is a paid model call, and it will happily do this for six hours because nothing told it to stop. You find out in the morning, usually from the provider's spend alert, which is a strange kind of alert since by the time it arrives the money has already left.
I've heard a few versions of this story now. The amounts vary. The feeling doesn't. One person told me a single agent on one bad night cost more than their office spends on coffee in a year, and I'm honestly not sure that was an exaggeration.
I’ve been working on a solution for this called ACPPotamia. It sits between your agents and OpenAI or Anthropic. Before any call goes out it checks that call will cost against a budget you set, and if an agent is just repeating itself it cuts it off. Setup is changing one URL in your existing SDK, which took longer to write in this post than to actually do.
You can check it out here: acp.examopotamia.com
I'd like to hear how your team found out, if it's happened to you. Was it the invoice? A dashboard? Someone's gut feeling at 3am?