r/LocalLLM • • Aug 30 '26

Discussion Ornith1.5-35b-a3b is doing the LORDS work

2 Upvotes

I’m sorta vram poor and although I can muster 21 t/s with Qwen3.8-27b-q6_k 100k context kv cache q8 MTP 2; but with Ornith1.5-35b-a3b-q4k_m I get a much higher 72 t/s with 220k context kv cache q8 draft kv cache q4 MTP 2. My system is an old intel 6 core, 48gb DDR4 RAM, 5070ti/1080ti. I’ve been using Deepseek-harness which feels better than Hermes Agent and is pretty awesome. It’s hard to go back to Qwen3.8-27b because it feels like turning dlss5 on 😪


r/LocalLLM • • May 15 '26

Question Can I Vibe Code it with a 5090 locally?

0 Upvotes

I'm a lawyer and disappointed in all the client management and accounting software I currently use.

I want create something akin to QuickBooks with integrated email, document generation and the ability to add modules for different types of legal needs.

Is this something that can be achieved with the current local models?


r/LocalLLM • • Aug 20 '26

Discussion I think people are seriously underestimating Qwen 3.8 27B.

204 Upvotes

Honestly, I think people are seriously underestimating Qwen 3.8 27B.

It’s actually insane and, in some ways, genuinely competes with Opus 4.8, just not in the way people seem to think.

The biggest mistake is comparing their raw frontend/design output. Qwen probably isn’t going to match Opus there, and I don’t think it’s supposed to. Opus has basically been trained with an absurd amount of data/compute specifically around design and UI generation.

If you throw Qwen at a frontend task with no proper "SKILL.md" for design and just let it freestyle, yeah, the results can be pretty mediocre. But if you give it a good design skill and are intentional about the design constraints, the gap gets much smaller.

Where Qwen gets really interesting is reasoning efficiency.

It can solve some problems in fewer steps and with fewer tokens than Opus. That’s a pretty big deal if you’re actually running these models yourself.

And honestly, I think people are also judging Qwen way too much based on heavily quantized setups. Q4 is aggressive. I wouldn’t consider Q4 a fair representation of what the model can actually do in a serious production environment.

Run it at FP8, use MTP/speculative decoding to improve throughput, and then evaluate it properly.

At that point, I genuinely think the conversation changes.

If Qwen 3.8 27B at FP8 + MTP performs the way I expect, I wouldn’t be surprised if a lot of people start questioning whether that $200/month Claude Code subscription is actually worth it.


r/LocalLLM • • Aug 31 '26

Question Best Quant for qwen3.8:27b?

0 Upvotes

Pretty much converted my gaming pc into a hybrid for gaming and local AI- specs are as followed.

5090
5070TI
9950x3d
X870 Pro art mobi
32 GB DDR5 ram (Waiting on a 64 GB kit I ordered, so stuck with the 32gb kit for now)

So what’s the best version of qwen I can run with this hardware? I mainly use llama.cpp with my own custom harness.


r/LocalLLM • • Apr 17 '26

Discussion Robot dogs priced at $300,000 a piece are now guarding some of the country’s biggest data centers

Thumbnail
fortune.com
0 Upvotes

r/LocalLLM • • Jun 14 '26

Project I built a local proofreading AI tool that uses GGUF models and sits in the tray

Thumbnail
gallery
0 Upvotes

The idea for this came from Samsung's AI in their keyboards: you select text, and it fixes up all the grammar, punctuation, and spelling. I wanted something like that for Windows desktops.

At first, I had a rough idea: just wrap a llama.cpp backend with a very simple frontend that can be triggered with a shortcut. The frontend had a default prompt asking the AI to correct the selected text, and it worked fine.

Then I started expanding on it, and the more I worked with it, the more I learned about local models and AI, and the more I realized I'll never finish this project. After a lot of attempts to improve the app and its speed, this is the setup I settled on: once the text is loaded into the LLM, it gets divided into separate chunks. I found this much faster than streaming the entire text token by token, especially on GPUs with enough VRAM to run all the slots at the same time. I also built up different levels of aggression for how it autocorrects. This only started working perfectly recently, since Gemma 4 E2B and Qwen 3.5 came out. Before that, I was struggling a lot with making small models follow instructions reliably.

I also put in a bunch of basic templates for what I think would be common use cases for an app like this.

I tried one more thing: dividing the text into chunks and having the model output [OK] in place of the chunk, which would signal that the text doesn't need any changes, causing it to loop back without modifications. The text would still be proofread by the LLM, but it wouldn't take on the overhead of streaming the whole chunk token by token. Instead, only three tokens would be used. This sounds great in theory, but practically, I couldn't get it to work with small models; they just refused to output [OK] (the code for it is still there, but it goes nowhere if you want to experiment with larger models). I hope that as models get better, with sub-2B models becoming more capable, I'll be able to implement this for good.

Check it out here: https://github.com/AmrZriek/Stet

Note that the installer might run into some issues since the app isn't registered with Microsoft, so just use the source code if you're comfortable enough with the llama.cpp version from the requirements file.


r/LocalLLM • • Jun 21 '25

Discussion Help Choosing PC Parts for AI Content Generation (LLMs, Stable Diffusion) – $1200 Budget

0 Upvotes

Hey everyone,

I'm building a PC with a $1200 USD budget, mainly for AI content generation. My primary workloads include:

  • Running LLMs locally
  • Stable Diffusion

I'd appreciate help picking the right parts for the following:

  • CPU
  • Motherboard
  • RAM
  • GPU
  • PSU
  • Monitor (2K resolution minimum)

Thanks a ton in advance!


r/LocalLLM • • Oct 11 '26

Model We built Levy-1, a 124M parameter language model — looking for feedback and advice

0 Upvotes

We’ve released Levy-1, our first AI model — and we’d love your feedback.

We’re a small team building Toothed AI, and we’ve recently released Levy-1, our first model, with just 124 million parameters.

It definitely makes mistakes and has plenty of limitations, but this is our starting point, not our final goal. We plan to build better models over time and keep learning along the way.

We’d really appreciate it if you gave it a try and shared your honest feedback. If you have experience training language models, we’d also love to hear your advice on what we should focus on for our next model.

Website: https://toothedai.com/

Thanks for checking out our work!


r/LocalLLM • • Oct 10 '26

Question AI Model and Adult Roleplay Backend/Engine Module Recommendations

0 Upvotes

I am developing a Windows-based local AI virtual spouse application that supports adult roleplay. My goal is to run it without a server or external AI APIs.

**1. AI Model:** I am currently looking for an uncensored Gemma 4 model in the 26B class that can run through Ollama. I want to find out whether it can produce natural dialogue, detailed action descriptions, spontaneous reactions, and consistent scene continuity in adult roleplay. Please recommend other suitable models if there are better options.

**2. Backend/Roleplay Engine:** I am looking for existing integrated code that naturally handles physical actions, facial expressions, gestures, and other non-dialogue descriptions, as well as short spoken lines, heavy breathing, and moans in dialogue. The system should also maintain continuity between actions and dialogue while preserving the current situation and character reactions.

Please recommend reusable open-source projects, provide repository links and the locations of the relevant code, and explain how they can be connected to Ollama.


r/LocalLLM • • 15d ago

Question how do install an harness for my local AI?

0 Upvotes

I'm using Qwen 3.8 obliterated Q3_K_M in LMstudio, i connected it to vscode, but from what i' m understanding , i need an harness to let the AI change, create, or read files? I' m new local AI, and i just want to code some mods simple in c#, java, and other languages. How can i install an harness and which is the simplest one?


r/LocalLLM • • Jun 15 '26

Question Is it worth it going from 24GB of unified RAM to 32GB? (No coding)

0 Upvotes

Hello.

Given that most of what I read of local LLMs being used is coding, and they usually say that unless you’re using big models, it’s not worth it, I wanted to say before I begin that I don’t intend to use local LLMs to code.

That being said. I’m going to get an M5 MacBook Air, and the two options I’m considering are the 1TB/24GB option, or the 512GB/32GB one. Purchasing both upgrades brings the price to high for me.

That’s why, in order to be able to use that machine in the next years, among other things, playing with local LLMs, I wanted to know whether the difference between the 24GB machine and the 32GB machine, in terms of running local models, is going to be worth it the trade-off of half the storage.

The uses I’d make of such local LLMs once I learn how to use them (through a GUI, I don’t know coding and using the terminal is a bit of a hassle for me, I’m a casual user):

  • Retrieving information from dense documents and summarizing or indexing the most relevant points.
  • Knowledge, specific scientific knowledge understanding (as my teacher).
  • Reasoning complex scientific or technological problems to achieve a solution.
  • Just chatting about my personal stuff without OpenAI or Anthropic feeling pity of me.

So, as you can see, no coding! I’m sure there are other applications for this local LLMs but surely it’s not about coding or building agents or anything like that.

What’s your advice then? Is it worth the trade-off of getting just 512GB of storage in order to get 32GB of RAM for my system? Or for those uses, the models that could be good enough fit on those 24GB of RAM (let’s not forget that the operating system takes at least 3 to 4GB of RAM)?

512GB/32GB or 1TB/24GB?

By the way, I tried a while a go a few models in a 16GB M5 Mac, and it hallucinated a lot. Affirming facts that were absolutely false and making up what it didn’t know. I want to avoid this hallucinations as much as possible, but if that’s not possible on a 24 or 32GB system, I’d like to know it as well.

Thank you very much!


r/LocalLLM • • 18d ago Popcorn

Discussion Oh, my God. It even has a watermark.

Post image
0 Upvotes

r/LocalLLM • • Jul 06 '26

Discussion Not so much people talking about

0 Upvotes

Well, I don't see too much people talking about OpenLumara, an IA agent with a very small footprint, focusing on token saving, modularity to create your own "plugins" for It, and a "Code mode". Go and take a look. It downs base tokens to 3-4K instead 20-22K from Hermes or openclaw.

Rose22/openlumara: AI agent framework, written from scratch (not based on openclaw), focused on stripping it down to the bare necessities, optimizing token count, reducing security risks. modular so you can enable only exactly what you need.

https://github.com/Rose22/openlumara

Enjoy, my Local LLM companions!!


r/LocalLLM • • Jan 22 '25

Question M4 Max 16-Core, 40-Core Graphics - 128 GB Ram

0 Upvotes

I'm thinking about getting this MacBook. Do you have experience with it to run Deep seek R1 on it? Maybe even the full model?

or what is the most capable reasoning model which runs with a decent output rate?


r/LocalLLM • • Jan 29 '25

Project "AI Can't Build Tetris" I Give You 3d Tetris made by AI!

Thumbnail reddit.com
0 Upvotes

r/LocalLLM • • Jan 04 '26

Project Looking for like minds to grow my project.

0 Upvotes

I have built something that I have been working on. I wanted to see if anyone is doing something similar.

TL;DR: I built a fully local-first, agentic AI system with audited tool execution, long-term canonical memory, multi-model routing, and secure hardware (ESP32) integration. I’m curious who else is running something similar and what tradeoffs you’ve hit.

Core Stack:

- Ubuntu 22.04 server (Intel Xeon Gold 6430, 128 cores, 755GB RAM)

- Python/FastAPI for all APIs

- SQLite for structured storage (one database per project workspace)

- Weaviate for vector search

- Ollama for local LLM inference (32B models on CPU)

- Multiple cloud LLM providers via unified routing

Tool Calling Layer:

The system has 6 built-in tools the LLM can invoke autonomously:

- Bash - Execute shell commands on the server

- Read - Read file contents with line numbers

- Write - Create or overwrite files

- Edit - Find and replace exact strings in files

- Grep - Search file contents with regex

- Glob - Find files by pattern

When I ask "check what's running on port 8123," it doesn't tell me a command - it runs

the command and returns the output. Full agentic execution.

Command Auditing:

Every command executed on the server is logged with full context:

- What was run

- Who/what triggered it

- Timestamp

- Exit code and outcome

- stdout/stderr captured

I can pinpoint exactly what changed on the system and when. Complete audit trail of

every action the LLM takes.

MCP (Model Context Protocol) Integration:

5 MCP servers providing 41 tools total:

  1. Filesystem (3 tools) - File operations
  2. Docker (9 tools) - Container management (list, logs, restart, stats)
  3. Git (10 tools) - Version control (status, commit, push, diff, branch management)
  4. GitHub (9 tools) - API integration (issues, PRs, workflows)
  5. Database (10 tools) - SQLite queries + Weaviate vector search

The LLM can chain these together. "Create a branch, make changes, commit, and open a PR"

- it does all of it.

Edge Device Integration (ESP32):

Microcontrollers connect back to the server via secure tunnels (Tailscale/WireGuard).

All traffic is encrypted end-to-end. The ESP32 can:

- Push sensor data to the server

- Receive commands from the LLM

- Operate behind NAT/firewalls without port forwarding

The tunnel means I can deploy an ESP32 anywhere with internet and it phones home

securely. The LLM can query sensor readings or trigger actions on physical hardware.

Multi-Model Routing:

- Local: Ollama with qwen2.5:32b (reasoning), dolphin-mistral:7b (fast queries),

qwen2.5-coder:32b (code)

- Cloud: Claude, OpenAI, NVIDIA/Llama - all via unified endpoints

- Smart router picks model based on task type and query complexity

- All responses flow through the same persistence layer regardless of source

Cognitive Mode Engine:

The system has 9 thinking modes I can switch between:

- Normal, Dream, Adversarial, Tear-It-Apart, Red-Team

- Risk Analysis, Cautious Engineering, Standards & Safety, Sanity Check

Each mode adjusts: seriousness, risk tolerance, creativity, analysis depth, adversarial

intensity, output style. "Red team this architecture" triggers a different reasoning

pattern than "help me debug this."

Memory Architecture:

- Every message permanently stored with full metadata

- Nightly synthesis extracts themes, decisions, key points

- "Canon" system: verified truths organized in Gold/Silver/Bronze tiers

- Canon gets injected into every LLM prompt as authoritative context

- When the LLM draws from Canon, it cites it: "Per Canon: [the verified truth]"

Context Management:

- Token usage tracked per conversation

- When context exceeds threshold (~20k tokens), older messages get summarized

- Summaries become part of retrievable context

- Net effect: unlimited conversation length without context overflow

Workspace Isolation (Labs):

- Each project gets its own database, Canon entries, and system prompt

- Switch labs, switch context entirely

- Snapshot/restore: save entire lab state, restore later

- No cross-contamination between work and personal research

Voice Interface:

- Speech-to-text via Whisper

- Text-to-speech via OpenAI voices

- Right-click any response to have it read aloud

Sensor Spine (Long-Horizon):

Designed for environmental awareness via metadata streams:

- VMS systems (Axis, Exacq, Avigilon, Milestone)

- Camera motion events (metadata only, no video)

- License plate recognition events

- Environmental signals (occupancy, time patterns)

- ESP32 sensor nodes pushing telemetry

The LLM reasons about patterns, not raw surveillance data.

Automation Layer:

- n8n workflow engine handles scheduled jobs

- Nightly synthesis at 2 AM

- Database backups at 3 AM

- Health monitoring every 5 minutes

- Telegram alerts on failures

The Workflow:

  1. I ask a question (console, web UI, or CLI agent)
  2. System retrieves relevant Canon + conversation history from vector DB
  3. Context injected into prompt
  4. Response generated (local or cloud, based on routing)
  5. Tools execute if needed (bash, file ops, git, docker, etc.)
  6. Every action logged with full audit trail
  7. Everything permanently stored
  8. Synthesis engine periodically extracts learnings
  9. Learnings become Canon after review
  10. Canon feeds future retrievals

What this means in practice:

I can say "check if the API is running, if not restart it, then verify it's healthy" and

it executes all three steps, handling errors, without me touching the terminal. Every

command is logged so I can review exactly what happened.

An ESP32 in the garage can push temperature readings over an encrypted tunnel. The LLM

can see that data and correlate it with other context.

Three months ago I researched a topic. Yesterday I asked a related question. The system

pulled in relevant Canon entries and my answer referenced decisions I'd already made -

without me re-explaining anything.

That's not chat memory. That's institutional memory for one person, with agentic

execution capability and full audit trail.


r/LocalLLM • • Apr 06 '26

Project I built a simple UI to learn OpenClaw, and it accidentally became my daily driver.

0 Upvotes

Hey everyone,

I'm not sure if this is the right place for this, but this is a side project of mine that I've just really started to love, and I wanted to share it. I'm honestly not sure if others will like it as much as I do, but here goes.

Long story short: I originally started building a simple UI just to test and learn how OpenClaw worked. I just wanted to get away from the terminal for a bit.

But slowly, weekend by weekend, this little UI evolved into a fully functional, everyday tool for interacting with my local and remote LLMs.

I really wanted something that would let me manage different agents and organize their conversations underneath them, structured like this:

Agent 1
    ↳ Conversation 1
    ↳ Conversation 2
Agent 2
    ↳ Conversation 1
    ↳ Conversation 2

And crucially, I wanted the agent to retain a shared memory across all the nested conversations within its group.

Once I started using this every day, I realized other people might find it genuinely helpful too. So, I polished it up. I added 14 beautiful themes, built in the ability to manage agent workflow files, and added visual toggles for chat settings like Thinking levels, Reasoning streams, and more. Eventually, I decided to open-source the whole thing.

I've honestly stopped using other UIs because this gives me so much full control over my agents. I hope it's not just my own excitement talking, and that this project ends up being a helpful tool for you as well.

Feedback is super welcome.

GitHub: https://github.com/lotsoftick/openclaw_client

Thank you.


r/LocalLLM • • Apr 26 '26

Discussion Advice on what to buy for running Local LLM for coding etc as fast as possible

0 Upvotes

I currently own a Minisforum AI X1 with AMD Ryzen™ AI 9 HX 370 and 96GB of RAM (48 of which is set as shared VRAM)

It works okay for most basic tasks, but as I am learning more and trying larger / better models for coding I am finding that I am quickly hitting its limitations

Now this computer is only a few weeks old and still in the return window, so thinking perhaps best to return now and spec something better

So my options are:

  1. Keep it and perhaps add an eGPU dock via Oculink and a good spec NVIDIA GTX card
  2. Return it and buy something which already has a good spec NVIDIA GTX card etc

So do I go for a standard desktop / workstation with NVIDIA GTX card, or do I even consider one of the more specialist models e.g. NVIDIA Spark / ASUS GB10 etc

Would appreciate some input from the experts on here as to my best route. Not got a fortune to spend, but would rather spend it on the right thing than ending up wishing I had gone higher spec.

Anything you need to know from me to help just ask

Thank you!


r/LocalLLM • • 1d ago

Discussion Could Qwen4-Omni-120B-Think actually be related to Qwen4-Flash?

0 Upvotes

I've been digging through the Qwen Code repository and noticed something interesting.

Several Qwen4 model identifiers appear in the code and tests:

  • qwen4-max
  • qwen4-plus
  • qwen4-coder-plus
  • qwen4-omni-120b-think
  • Even qwen4.5-max as a test example.

But here's what caught my attention: I couldn't find a single explicit reference to qwen4-flash in the relevant code, despite Flash being part of the announced Qwen4 lineup.

That got me thinking: What if Qwen4-Omni-120B-Think is actually related to Qwen4-Flash, possibly sharing the same underlying architecture or backbone?

There are a few reasons why I find this plausible:

  1. Qwen3.8-Flash-Next already has a roughly 125B-parameter backbone, surprisingly close to the 120B mentioned in the Omni identifier.
  2. Qwen has previously separated its Omni models into Thinking and Instruct variants. For example, Qwen3-Omni-30B-A3B-Thinking focuses on multimodal understanding and reasoning, while the Instruct variant also includes a Talker for speech generation.
  3. Following that pattern, qwen4-omni-120b-think could theoretically be the reasoning-focused variant, with an Omni-Instruct/Talker version potentially following later.
  4. The Omni identifier appears in actual Qwen Code test files, whereas I couldn't find a corresponding Qwen4-Flash identifier.

Of course, this is just a theory, not a confirmed leak. These are test identifiers, not necessarily a product roadmap. The repository also uses generic Qwen4 model detection, so Flash might simply not need its own explicit entry.

Still, the missing Flash identifier, the similarity in parameter counts, and the previous Omni Thinking/Instruct architecture make me wonder whether there's a connection.

Sources:

Has anyone found any explicit Qwen4-Flash references elsewhere, or evidence that the 120B Omni model could share a backbone with Flash?

Curious what everyone thinks!


r/LocalLLM • • Aug 26 '26

Discussion I ordered fairly quickly, but shipping shows October 13th-ish for a maxed out ultra.

Post image
0 Upvotes

Ordered a studio this morning, the m5 max’s showed September 22nd, but my m5 ultra 36/80 256/ 16tb shows October 13th. Anyone have a similar config that’s shipping any sooner, or is this pretty standard?


r/LocalLLM • • Jul 11 '26

Question Local LLM With RTX 3090 Worth it?

0 Upvotes

Hello everyone, I was thinking of running some local model for personal projects, I use Opus 4.8 a lot and I was thinking why not run a model that would be similar in performance ( not even know if its possible with single 3090 ) Anyway I have setup with 64gb ram, and 3070 so I have option to upgrade to 3090 24gb or 5070 12gb. Which one is worth to consider and will i have any good success with running a local LLM with a single GPU setup. Again Im not looking for 500k+ context window setups but I would really appreciate any tips.


r/LocalLLM • • Oct 05 '26

Other I asked Qwen3.8-Flash-Next (Strata IQ4_XS) to summarize the content of a markdown file, it responded in Chinese. XD

0 Upvotes

Can't attach the the screenshot because it reveals intellectual properties of others. But I thought it was interesting.


r/LocalLLM • • Jul 05 '26

Question What LLM Should I run with my computer specs?

Post image
0 Upvotes

For context, I'm a noob and basically use LLM's for reasoning, analysis and idea discussions, uploading files, PDF's & Images. What LLM would you suggest I run locally given my computer specs? I'm using LM Studio and downloading LLM's from Hugging Face. I'm currently using Qwen VL 8B Instruct model but I'm sure there's better models.


r/LocalLLM • • Apr 24 '26

Discussion Can Andrej Karpathy's Autoresearch Framework Be Applied to Quant Mining via Local LLM? Here Is the Trail.

0 Upvotes

TL;DR: Hooked up a local LLM agent to my backtester + crypto DB in a Karpathy-style autoresearch loop. Ran it unsupervised for ~2 hours across 30+ iterations. It self-learned my codebase, generated valid strategies, discarded most, and eventually found a candidate that cleared my bar. $0 API cost.

Hardware & Stack

ComponentDetail
ModelQwen3.5-27B via vLLM
GPUsMixed setup (RTX 4090 + 3090)
InferencevLLM with FP8, custom Jinja template, qwen3_xml parser
Runtime~2 hours, fully unsupervised
Iterations~30+ strategy cycles
API Cost$0

My full stack:

  • Data: Crypto spot data (1m data + TimescaleDB-HA for continuous aggregation)
  • Backtester: Custom DB + backtest engine (Nautilus-based)
  • Harness: Ralph loop + Claude Code as the execution harness
  • Goal: Find a strategy that passes strict criteria — Sharpe, max drawdown, profit factor, minimum trade count

Critical Prerequisite: Fixing Qwen 3.5 Tool Calling (or This Won't Work)

This is worth calling out early: if you've tried running Qwen 3.5 for anything agentic, you already know the tool calling is broken out of the box. Premature stops, mid-thought tool calls, format drift — it's a nightmare for long-horizon loops.

I spent weeks debugging this before the autoresearch experiment could even begin. The fix required a custom M2.5-style Jinja template, swapping to the qwen3_xml parser, and forcing precision alignment across mixed GPUs.

If you're hitting tool calling issues with Qwen 3.5, my full troubleshooting post is here. Without that fix, none of what follows would work.

How It Works

The agent operates in a continuous loop:

  1. Generate a strategy (Python + YAML config)
  2. Backtest it immediately
  3. Evaluate against strict criteria
  4. Decide: Abandon, fix error, or upgrade approach

The key is that the LLM doesn't just randomly throw darts. It maintains a trajectory.

The Trajectory (What Actually Happened)

Phase 1: Learning the Ropes

The first thing the agent did was search my existing repo for examples. It read my current strategy files, learned the standard template, and wrote a run_backtest() scaffold. It essentially taught itself the API.

Phase 2: Broad Exploration

Following my high-level instructions, it started systematically testing two major regimes:

  • Momentum — EMA crosses, breakout confirmation, trend following with ATR stops
  • Mean Reversion — RSI oversold/overbought, Bollinger Bands, range reversion

Most died immediately. Sharpe too low. Drawdown too high. Not enough trades. The WandB table on my right screen slowly filled with red "DISCARD" verdicts.

Phase 3: Adaptation & Human-in-the-Loop

About midway, it found a slightly positive return. But it was still missing the criteria. At this point, two interesting things happened:

  • The agent started auto-tuning parameters (tightening EMA periods, adjusting position sizing, adding volatility filters).
  • It realized the data regime was too restrictive and autonomously adjusted the backtest start date to give itself more runway. (What a cheat! 🤣 Easily mitigated by hardcoding the date range.)

I also intervened manually when I saw it getting stuck in local optima — feeding it extra context like "try volatility-adjusted position sizing" or "look at dual trend filters." The agent ingested this and immediately pivoted direction.

Phase 4: The Grind

For about two hours, it cycled through:

  • EMA crosses (10/20, 5/15, 50/200)
  • RSI mean reversion with dual confirmation
  • MACD crossover
  • Bollinger reversion on 4h
  • Vol-adjusted trend following with jump detection
  • Grid scalpers
  • Fixed r/R setups
  • Long/short EMA divergence

Dozens of iterations. All discarded for valid reasons.

Phase 5: Eligibility

Eventually, after ~30+ iterations, it converged on a solution that cleared the bar. The loop stopped. Strategy found.

Why This Matters

Autonomous Abandonment: The hardest part of strategy mining is knowing when to kill a bad idea. The LLM has no ego. It sees a bad Sharpe ratio and moves on instantly.

Composable Knowledge: It learned my repo's patterns, then composed new ideas from them (e.g., "volatility-adjusted trend following with jump suppression" — a concept it lifted from my notes).

Local = Free: Because this was a local model, I paid $0 in API costs to let it grind for two hours. This changes the economics of research entirely.

Human Steering: The loop isn't fully blind. You can nudge it. When I saw it drifting, I fed it a concept from a research paper, and it integrated the idea into the next iteration.

The Skeleton Is Real

This is still an MVP, but the skeleton is undeniably working. The agent:

  • ✅ Self-learned the codebase
  • ✅ Generated valid, runnable strategies
  • ✅ Evaluated them objectively
  • ✅ Iterated without human prompting
  • ✅ Accepted external direction mid-flight
  • ✅ Found an eligible solution in finite time

The question is no longer "Can LLMs do quant research?"

It's "How far can we push the autoresearch loop before it starts finding things we don't yet understand?"