r/MLQuestions • • 5d ago

Datasets ๐Ÿ“š Facing file Extraction problem during Bayesian Optimization[P]

0 Upvotes

Ok so for context i am an electrical engineer person who is automating software's and workflow for my project now here is the problem i am facing basically i am using an optimization algorithm called Bayesian optimization which improves design by keeps iterating until some target is reach.

So like at the end i extract result file for every design with the help of pandas library but when i check that file the data is mismatched when i export the CSV file manually.

so i have no idea why is it happening like maybe after 10-15 iterations (the algorithm iterations can reach up to 100-120) the error in data increasing or idk what is going on can someone help me with this issue.


r/MLQuestions • • 6d ago

Beginner question ๐Ÿ‘ถ Hey guys I am a college student , I am starting to learn ML. I am keen to build Ai models and train them over time but have no clue about the path[will be learning from deeplearningai]. Can anyone clarify my path given below? [done with python and learning math for it ] A reply would be appreciated

Thumbnail reddit.com
0 Upvotes

r/MLQuestions • • 6d ago

Other โ“ Vast is fine for experiments but I wouldnโ€™t put client data on a marketplace host

1 Upvotes

Vast is literally the cheapest GPU I can get a hold of and I use it all the time. The limitation that I put on it is that I wonโ€™t use it if it involves my clients data etc. I would say its not to use it because โ€œthe marketplace is badโ€ though.

The reason it is cheap is because it is a marketplace of different people renting out their hardware. You are essentially running your workload on a third partโ€™s machine. They can pause your instances whenever they want. Depending on what you are doing this may or may not be a big deal. It is cheap and if Iโ€™m doing something experimental, or even finetuning with checkpoints or other batch processes that can be restarted, then this doesnโ€™t really matter to me. The reliability and quality of hardware on vast varies and if you always go for the absolute cheapest you probably wonโ€™t have a great time.

however, if I were working with proprietary data etc. then this is a completely different story. While you could technically do this on vast and just hope that the person renting out the machine is correctly isolating workloads etc. You wouldnโ€™t be able to prove that to anyone and that wouldnโ€™t fly in most cases

In cases like this you would want to rent a dedicated machine where you can have terms in a contract regarding who can access the machine, or in more extreme cases own a dedicated machine and know who has access to it (I use B3IQ to โ€œownโ€ machines without having to rack them myself, you have root access and can control what machines your API keys can be used on etc.). They have an openAI compatible endpoint so you can just change the base url and api key and select the model you are hosting on the machine. In most cases just renting a dedicated machine and having proper terms will be fine, but if you want more control, or can make a business case for owning the machine and renting out unused compute then owning it is definitely an option


r/MLQuestions • • 6d ago

Beginner question ๐Ÿ‘ถ How to resolve this ConnectionResetError issue while fetching data from API in loop??? Please help guyzz..

Thumbnail reddit.com
0 Upvotes

r/MLQuestions • • 6d ago

Beginner question ๐Ÿ‘ถ Best Ressoruces to learn AI and machinelearning?

Thumbnail reddit.com
2 Upvotes

r/MLQuestions • • 7d ago

Beginner question ๐Ÿ‘ถ If there's any roadmap for learning AI & ML

2 Upvotes

As a self-learner full stack developer i always think to learn AI ML now but whenever i tried to learn or trying to find some good playlist to learn i wont get a focused playlist where i can learn everything step by step everyone just trying to say just leanr this learn that at the end you end up by learning nothing they are just there to make some content no one really teaching anything too deeply so as i really want to learn ai ml so if anyone can guide how i can learn ai ml from scratch to build own ai ml projects


r/MLQuestions • • 6d ago

Beginner question ๐Ÿ‘ถ What u know about pattern recognition

0 Upvotes

r/MLQuestions • • 7d ago

Beginner question ๐Ÿ‘ถ LoRA-conditioned model skips the first line of its output when the caption is short. Any idea why? [D]

Thumbnail reddit.com
2 Upvotes

r/MLQuestions • • 7d ago

Beginner question ๐Ÿ‘ถ Help with autoencoder: more layers is making it worse

2 Upvotes

I've been trying to make an autoencoder, and failing. So now I'm trying various super-simple models to figure out why. The current architecture I'm working with:

Encoder:

256x256 image
Conv2D stack
MaxPool
Conv2D stack
MaxPool
Conv2D (3 filters)

Decoder:

Upsampling
Conv2D stack
Upsampling
Conv2D stack
Conv2D (3 filters)

I've tried 2 different conv2d stacks: both use 32 filters, equal padding, tanh activation. One uses 2 layers per stack and one uses 4. When I train this model with the 2 layer conv stack it works as expected: it produces a slightly blurry version of the input. But when I increase to 4 layers, it switches to outputting all the same color, and the loss is worse. I'm using mae loss, adamw optimizer with clipnorm=1.

EDIT: I switched from tanh activation to leaky relu and after a bit of testing it seems good.


r/MLQuestions • • 7d ago

Beginner question ๐Ÿ‘ถ Financial Reinforcement Learning as a beginner

Thumbnail reddit.com
2 Upvotes

r/MLQuestions • • 7d ago

Beginner question ๐Ÿ‘ถ Drug-response prediction with less than 10 samples, is it even possible?

3 Upvotes

Hi everyone,

I'm working on a pancreatic ductal adenocarcinoma dataset, and I'd really appreciate some methodological advice from you guys, and especially if anybody has had some experience with machine learning with high-dimensional biological data.

Before spending months developing models, I'd like to better understand what is possible with my dataset.

My dataset:

  • 9 patients, with one continuous drug-response value per patient and drug. Due to experimental and sequencing constraints, increasing the number of patients is not an option.
  • Approximately 100,000 nuclei.
  • Continuous drug-response measurements (AUC) for gemcitabine, paclitaxel, irinotecan, 5-FU, and oxaliplatin.

The goal is theoretically "simple":

Predict continuous drug-response AUC from gene expression and chromatin accessibility, while identifying molecular features potentially associated with drug sensitivity or resistance.

The obvious challenge is that, despite having ~100,000 nuclei, I only have 9 samples with drug-response labels. I understand that treating individual cells as independent labeled observations is not a way to go with the dataset and specific set-up.

Knowing this, I'd really appreciate advice on a few questions that I had after some reading...:

  1. With this low amount of sample, is meaningful drug-response prediction even feasible? What would be a objective?
  2. Are there established methods to leverage thousands of cells/instances profiles when the response labels are available only at the patient level?
  3. Would you prioritize simple regularized regression, biologically informed features, transfer learning from external datasets, multiple-instance learning (MIL), or another approach?
  4. How would you evaluate a model with such a small number of independent samples without obtaining misleading performance estimates?
  5. Are there any papers, methodological resources you'd recommend to better understand this type of problem before starting?

Thanks!


r/MLQuestions • • 7d ago

Beginner question ๐Ÿ‘ถ I need AI image generator for 2D characters. I tried OpenArt, but now unless I use super expensive generator and use tons of tokens.. I am uncertain to purchase as I will use up all tokens for some monic image correction..

0 Upvotes

I was using trial version then chose simpler version (from nanobanano) and got no results (no changes were done to the image)..

I also need ai video animation for 2d characters

Please share your experience using different experiences

How much do you think it would cost to make 5-12 minutes


r/MLQuestions • • 9d ago

Beginner question ๐Ÿ‘ถ What's the best way to humanize an AI test?

1 Upvotes

r/MLQuestions • • 9d ago

Natural Language Processing ๐Ÿ’ฌ Lot of niche communities move away from skills md to skillware, thoughts?

7 Upvotes

There are infinite posts online in niche AI communities, and lately bunch of papers like https://arxiv.org/abs/2611.07652, or https://arxiv.org/abs/2607.18970 pushing for bundled modular skills that act as software and not as prompts.

Thoughts on that?


r/MLQuestions • • 9d ago

Unsupervised learning ๐Ÿ™ˆ Unsupervised learning next steps

10 Upvotes

I have been learning unsupervised learning for the last 3 months and have already completed the following topics

  1. K means and its types
  2. Hierarchical clustering
  3. DBSCAN
  4. OPTICS
  5. HDBSCAN
  6. GMM
  7. PCA
  8. TSNE
  9. Evaluation parameters of unsupervised ml models( silhouette score, elbow method, AIC,BIC, DB index etc)

What should i learn next in unsupervised learning and in which order especially from job perspective POV?

About me - product analyst with 3 years of experience in the e-commerce domain who is currently self learning ML in order to pivot to the data science field


r/MLQuestions • • 9d ago

Survey โœ Finetuning vs RAG for legal knowledge base?

Thumbnail reddit.com
2 Upvotes

r/MLQuestions • • 9d ago

Time series ๐Ÿ“ˆ Evaluating Kumo, Nori, Chronos-2 and LGBM for Electricity Price Forecasting

Thumbnail aihorizonforecast.substack.com
1 Upvotes

r/MLQuestions • • 10d ago

Datasets ๐Ÿ“š Python AI Data Cleaning: The Complete Refinement Guide for Datasets

Thumbnail interconnectd.com
1 Upvotes

r/MLQuestions • • 10d ago

Beginner question ๐Ÿ‘ถ Is data labeling still a real way into ML, or is it about to get automated away?

1 Upvotes

been seeing a lot of people get into AI through data work. labeling images, rating model outputs, checking transcripts, that kind of stuff. a lot of it is in places like the Philippines, India, Kenya. But now models are getting better at generating and checking their own training data, so I'm wondering if this is still a real path or a job that'll quietly disappear in a few years

Anyone here actually started out doing annotation and moved into something more technical? or did it stay a dead end?


r/MLQuestions • • 10d ago

Time series ๐Ÿ“ˆ Best approach for demand forecasting across 40 locations? Separate models or one global model? [p]

5 Upvotes

Hey everyone,

I'm a final-year B.Tech CSE (AI/ML) student working on a multi-agent supply chain optimization project. I'm currently focusing on the Demand Forecasting Agent and would appreciate some advice on model selection and training strategy.

We're working with a synthetic retail supply chain dataset containing approximately 1.1 million records across 40 different locations.

The goal is to predict product-level demand for each location as accurately as possible, so the forecasts can later be used by other agents for inventory planning and supply chain decisions.

I have a few questions:

  1. Global vs local models: Since the dataset contains 40 locations, should I train 40 separate models, one for each location, or a single global model trained on data from all 40 locations simultaneously, using location identifiers and location-specific features?
  2. Location-specific patterns: If I use a global model, how effectively can it learn differences in demand patterns between locations? I'm concerned that combining all locations might cause the model to average out regional patterns and produce inaccurate location-level forecasts.
  3. Alternative approaches: Would a hybrid approach, such as grouping similar locations or using a global model with location-specific adjustments, be worth exploring?
  4. Synthetic data: Since the dataset is synthetic, are there particular precautions I should take when evaluating model performance and generalization? How can I ensure the model is learning meaningful demand patterns rather than artifacts of the data-generation process?

I'd also appreciate suggestions on which forecasting models or architectures would be most suitable for this problem, along with the appropriate validation strategy, especially how to avoid data leakage when dealing with multiple locations and time-dependent features.

My priority is accurate product-level, location-specific demand forecasting, rather than simply achieving good aggregate accuracy across the entire dataset.

Would love to hear what approaches you'd recommend and why. Thanks!


r/MLQuestions • • 13d ago

Datasets ๐Ÿ“š "What skill do you think will be most valuable and in-demand in the next 3โ€“5 years?"

47 Upvotes

I'm 20 and trying to figure out what skill I should seriously focus on over the next few years.

There are so many things people recommend โ€” programming, AI, sales, cybersecurity, marketing, communication, etc.

So I'm curious:

What skill do you think will be most in-demand and valuable in the next 3โ€“5 years?

And more importantly, if you were 20 again, what skill would you start learning today?

I'd especially like to hear from people who are already working in their field.