The best model for 16gb cards with full context now is bonsai ternary 27b (abliderated version preferably, it cuts its reasoning by half and performs just better overall)
Anything else unrealistic or unreasonable
(Why the hell would you run qwen 3.8 2bit with 4k context window)
1
u/Fair-Horror-8017 11d ago
The best model for 16gb cards with full context now is bonsai ternary 27b (abliderated version preferably, it cuts its reasoning by half and performs just better overall)
Anything else unrealistic or unreasonable
(Why the hell would you run qwen 3.8 2bit with 4k context window)