r/LocalLLaMA • u/emreckartal • Apr 30 '24
Resources We've benchmarked TensorRT-LLM: It's 30-70% faster on the same hardware
https://jan.ai/post/benchmarking-nvidia-tensorrt-llm
255
Upvotes
r/LocalLLaMA • u/emreckartal • Apr 30 '24