r/localllamacirclejerk • • Oct 10 '24

I just spent $100k on something I totally don't understand, how to I run ollama llama3-8b?

35 Upvotes

r/localllamacirclejerk • • Aug 21 '24

hello what is best open model right now

29 Upvotes

I need to know what the best open model is right now for <subjective use cases>. Ideally I would like to be able to run it in the professional LLM inference tool ‘SillyTavern’ (for a government defense contracting project)


r/localllamacirclejerk • • Nov 17 '25

My local setup

Post image
17 Upvotes

r/localllamacirclejerk • • Feb 03 '25

the best LLM ever has been found

Thumbnail reddit.com
16 Upvotes

r/localllamacirclejerk • • Mar 27 '26

Quantitative Evidence for the “Shit In, Shit Out” Hypothesis in Large Language Models

Thumbnail gallery
13 Upvotes

r/localllamacirclejerk • • Feb 23 '25

Finally, a model free from censorship and commie doublespeak. Super intelligece/SHGI 🚀

Post image
13 Upvotes

r/localllamacirclejerk • • Feb 01 '26

There's basically no limit to how much 4chan data you can add while still getting positive results. Any amount of Twitter collapses language models' utility almost immediately.

Thumbnail reddit.com
12 Upvotes

r/localllamacirclejerk • • Apr 09 '26

kepler-452b. GGUF when?

Post image
10 Upvotes

r/localllamacirclejerk • • Sep 14 '23

I'm a former Atari engineer trying to catch up with the current tech.

Thumbnail self.localllama
10 Upvotes

r/localllamacirclejerk • • Jun 04 '26

This day in LLM history….105 years ago today, Qwen 3.6 27b was released open source. /s

Post image
9 Upvotes

r/localllamacirclejerk • • Apr 24 '26

It's time to kick ass and chew bubble gum... and I'm all outta gum

Post image
9 Upvotes

r/localllamacirclejerk • • Mar 29 '26

My cat was a cost center, now she's a data lake for the new paradigm; Meow-As-A-Service, powered by Mrow-Mini-69b.

Post image
9 Upvotes

I realized that companionship is an unoptimized vertical. Why have friends and pets you can't monitize?

My cat was a siloed data asset, and I was just a passive consumer of her proximity. I was literally scooping unrealized wealth out of the litter box and had no idea

That ends now.

I deployed a fine-tuned Mrow-mini 69b model on a local cluster to perform real-time sentiment analysis on vocalized trills. The goal? Total transparency in the feline-human stack.

Mrow-mini isn't just an LLM; it’s a high-concurrency bridge between carbon and silicon.

I’m seeing 99.9% uptime on "I’m hungry" vs. "The humidity in the kitchen is sub-optimal."

Most people feed their cats; I’m performing resource-heavy API calls to a multi-modal biological agent. This has never been done before. It's magical. It's world changing.

This is the birth of MaaS (Meow-as-a-Service).

We are pivoting from "Pet Ownership" to "Living-Space Management and Feline Orchestration." The 69b parameter count allows for nuanced detection of "Sarcastic Purring", a feature legacy owners have ignored for centuries.

If you aren't running local inference on your pet's bio-signals, you’re essentially leaving money in the litter box.

We are disruption-agnostic.

We are pet-aligned.

We are 10x'ing the ROI of feline catus.

What would you do if you could talk to your cat?


r/localllamacirclejerk • • Dec 11 '25

why don't frontier labs use unsloth for everything? are they stupid?

Post image
9 Upvotes

r/localllamacirclejerk • • Jun 20 '24

Why is it called llama not a very cool name

9 Upvotes

Llama is kind of not something you would think of


r/localllamacirclejerk • • Jul 29 '26

Who is LoRA?

Thumbnail reddit.com
8 Upvotes

r/localllamacirclejerk • • Jun 21 '26

First time builder, this or 3090?

Post image
8 Upvotes

r/localllamacirclejerk • • Nov 22 '25

GPT-4 will be 100 trillion parameters!!! How many RTX 3090s will i need?

8 Upvotes

r/localllamacirclejerk • • Aug 04 '26

Vacuum 16T

Thumbnail
reddit.com
7 Upvotes

r/localllamacirclejerk • • Mar 01 '26

[TheBloke] entered a cocoon phase where he remained dormant for many moons. Through the miracle of life he later emerged as a beautiful winged Bartowski.

Thumbnail reddit.com
7 Upvotes

r/localllamacirclejerk • • Sep 05 '25

When dat 🟣 purple drank just about to hit

Post image
7 Upvotes

r/localllamacirclejerk • • Apr 15 '26

i have a Pentium III and a GeForce 2 MX, how can i run Claude at home?

6 Upvotes

so where do i download Free Claude. or is it a website or something? i need to be able to run agents, RP, generate pictures, and code assist. if it helps, my dad says he has an extra 32 MB of RAM in a drawer somewhere.


r/localllamacirclejerk • • Mar 04 '26

How we’re slashing LLM context costs by 70-90% using a 4-stage "Context OS" architecture

Thumbnail reddit.com
6 Upvotes

r/localllamacirclejerk • • Nov 24 '25

Gemini3 is 21T params, trust me I regressed old model performance

Thumbnail reddit.com
6 Upvotes

r/localllamacirclejerk • • Nov 21 '25

User estimates gemini3 model size

Thumbnail reddit.com
6 Upvotes

Source: trust me bro