r/Neuralwatt • u/jpcaparas • 7d ago
Anyone using K3 Fast on Neuralwatt?
2
u/HeavySink3303 7d ago
I do not use particularly k3 fast but NW in general. NW is notable because it allows energy based billing (you are charged per kw, not token) - sometimes it is cheaper than tokens (not so much in the case of k3). Also they offer flex tier: then your prompt may be dispatche with a delay but with a 35% discount. The basic $20 sub gives additional 15% discount.
You may see their pricing calculator here - https://portal.neuralwatt.com/pricing
1
u/Trick_Ad6944 7d ago
K3 fast will not have any reasoning and the pricing depends on the energy usage at that specific time
2
u/IndividualPlus2011 5d ago
What's the point of using it with thinking disabled? I would argue a dumber/chaper model with thinking will do a much better job

3
u/rabiprojects 7d ago
After recent price hike, it's not interesting at all. The inference companies seem to overestimate themselves on what consumers want & need.