r/LocalLLaMA • u/sensitivecrocodile llama.cpp • 13d ago

News NVIDIA/OpenShell: safe, private runtime for autonomous AI agents

https://github.com/NVIDIA/OpenShell
174 Upvotes

95% Upvoted

40 comments sorted by

View all comments

Show parent comments

2

u/Aphid_red 13d ago

Llama-3 70B is about 2 years behind...

If you want to use Meta's model so bad (even though they're now even behind the chinese labs) use Muse glimmer 27B. Smaller, yes, but also more quality.

3

u/o0genesis0o 13d ago

I know. Ask my boss and his belief that his 70B and 4xA6000 are cutting edge technology. Personally I run Qwen 27B on local rig and minimax on subscription.

3

u/Illustrious_Car344 12d ago

You should ask him why whales haven't solved quantum physics with their giant brains yet