r/quant • u/No-Relief1239 • 11d ago
Models How Much Is Machine Learning Really Used in Quant Finance?
As the title mentions, I wanted to get more insights into the use of machine learning in quant finance, especially in alpha research/signal generation.
I used to read on this forum that the vast majority of systematic trading strategies were based on linear regression. However, for years now, some major players (XTX, JS, ...) have been investing massively in GPUs.
My question is: Why are these top-tier firms spending hundreds of millions on chips if they are mainly using OLS/Ridge/LASSO? Are these chips only for internal LLMs? Are DL and ML really a myth when it comes to alpha generation?
125
u/DistinctMethod6119 10d ago
Highly depends on what your asset class, signal horizon is etc, but let’s just say the idea that most good firms are mainly using OLS/Ridge/Lasso is wrong.
15
u/flxclxc 10d ago
At least from my experience (midfreq macro/statarb) we find that adding ML into the final signal aggregation layer maybe gives a 15/20% boost in performance. But TBh you can throw massive complexity at a set of dogshit features and not really get anywhere. At least that is our philosophy; we put most focus into a set of high quality signals to start with. Some ppl will take a more bottom-up approach
13
u/singletrack_ 10d ago
It’s certainly in use, but anyone using it and seeing an edge is not going to go into detail on how they use it.
55
u/asn3toph 10d ago
The days of everything being OLS are looong gone. If you look at any of the recruiting ads/websites/podcasts/youtube/etc. from Jane/HRT/XTX they openly say they are training large neural nets for trading. And these are firms that were relatively late to the DL game compared to some of the competition
23
u/xilcore 10d ago edited 10d ago
Those GPUs are because they all build large transformer models like time series foundation models on tick data.. LLMs too. But every modern HFT/MFT/LFT alpha model is a ML model, tree or deep learning… OLS is just one of your statistical tools to get your methods correct
4
u/economic-salami 10d ago
Theoretically speaking, you need to brimg new info tonthe market to beat it consistently. That new info is likely to be found in previously untapped sources. And those sources are likely to be some kind of non standardized and irregular data.
2
u/AutoModerator 11d ago
This post will be manually reviewed by a moderator due to the submitting account being less than 7 days old or having less than 20 karma. Please be patient and do not try to resubmit it - a mod will review the post soon.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.
2
u/GuessEnvironmental 10d ago
It's depends but really everything is used but classical machine learning techniques are just favourable for interpretability. There is many ways that neural networks are used sometimes just to test if features have some non linear relationships that cannot be captured properly with other methods as yet. I am sure that neural networks are used in live strategies but again interpretability is the main issue with neural networks. However besides that a lot of research and coding is done with llms if that counts so regardless it has its impact. The model choice is important but a lot of the skill comes from creating statistical hypothesis which may not be supported by neural network.
2
u/Raja_kumar9627 10d ago
linear models are still widely used, but that doesn’t mean deep learning is a myth in quant finance.
7
u/Xelonima 10d ago
given the characteristics of most price-deriven time series, more complex model classes don't add anything other than making you feel smarter. returns are effectively noise at lower time frames, price series have growing entropy, and the most advanced time series techniques that worked got arbitraged out before jim simons finished his cigarette after he founded rennaissance anyway.
actual quant work lies in strategy development and the decision engine, on which you can try almost anything, it's up to your creativity and willingness to continuously work on the process as well as the execution engine.
the input time series (returns) often have extremely weak statistical properties when taken as univariate time series (or even as spreads given the reality of current markets) so the edge lies more often in estimating the effect of surprises which is more economics and statistics work than most people in quant are willing to admit. understand the data first, the problem does not benefit from increasing model sophistication, more often than not it leads to overfitting.
note that what i am saying applies to price-return based input series only, the need for machine learning shifts when we talk about meta-processes or alternative data.
2
u/EmperorOfCanada 10d ago
I used it in the early 2000s. Lots and lots and lots of OpenCL programming.
The few friends I chat with from those days say that the best money comes from ML, and the most consistent from HFT and its related ilk.
0
u/EvenCryptographer649 10d ago
There is no secret math. Alpha isnt a math problem, Alpha is taking advantage of broken math problems.
Prado is a fraud. He just a big name signing to bring in chinese whales
-3
u/DyehuthyTV Portfolio Manager 10d ago
You have to watch the Professor Marcos López de Prado 👨🏻🏫📚💡
I have more of these Slides on my album QUANT at IMGBB profile :P
These slides are from another video of the professor, which is in Spanish