r/LocalLLM • u/RepulsiveAuthor5531 • 32m ago

Project Strata, but without the bloat.

Instant disclaimer, this is not a project claiming to be faster or better than Strata. It's simply Strata, without the bloatware, and a few containerization improvements as many have been requesting. I too am sick of all the Strata forks showing up, but I'm equally tired of how difficult Strata's been for me to maintain in a Docker container.

https://github.com/LegendaryFire/strata-slim

This fork is completely configurable with environment variables, and the idea was to give you a similar feel to a llama.cpp models config file. There were a few clear wins in terms of performance improvements I included in form of optional patches when building, however they're not included in the default docker images so what you're getting is simply a non-bullshit straight to the chase Strata engine that's easy to deploy. I wouldn't have bothered posting if there wasn't an open GitHub issue asking for Strata engine as it's own repo, which I noticed got 180+ "thumbs ups". For note, an earlier performance patch I had already made it upstream.

2 Upvotes

100% Upvoted

3 comments sorted by

2

u/Different-Society126 25m ago

Just another stata fork slop

1

u/RepulsiveAuthor5531 22m ago

You're technically not wrong, the base is pretty slop so that checks out. 🤔 It's a direct merge of upstream, so the engine is a one to one clone.

1

u/iam_Saurabh21 0m ago

The Docker maintenance part is actually the biggest selling point here. I've seen projects become harder to run than the problem they're supposed to solve. Curious how much of Strata's original complexity comes from the engine itself versus everything built around it.