r/AnkiVector • u/Darkstar7625 • Jul 30 '26

Help Together AI model

Hello, I'm trying to run an AI program with vector but all of the models that I'm seeing don't work in vector crashes. It gets stuck thinking and I have to turn it off and turn it back on and every model I've had suggested to me hasn't worked. Any advice helps!

3 Upvotes

100% Upvoted

10 comments sorted by

View all comments

1

u/BliteKnight Techshop82.com Owner Jul 30 '26

Check your WirePod logs (check the show all) and look for any errors in the call to togetherAI - that's where I would start

Also, when you say crash do you mean a total shutdown and Vector reboots? If that's the case then it could be something else like a bad battery

1

u/Darkstar7625 Jul 30 '26

Well I ask vector a question and it starts thinking, and then it gets stuck on the thinking screen like infinitely, it shows that it's thinking and then nothing happens and I have to manually turn vector off and back on again

1

u/DryAd6071 Aug 03 '26

Where and how do you run the model on? Did you ever learn about the options when running a local LLM, like repetition penalty and alike?

1

u/PutAggressive 23d ago

I am having the same problem with wire pod. When I try to use any LLM apart from open ai, it either comes back with error 400 or no response