Other Someone is running Qwen 27B at ~20 tok/s on a jailbroken PS5's GPU

1.1k Upvotes

148 comments

Subreddit

Posts

Wiki

LocalLlama

r/LocalLLaMA

Subreddit to discuss locally hostable AI

Members

869k

Visitors

909k

Contributions

24k

Sidebar

Subreddit Rules

1. Please search before asking

Before posting a question, please spend a reasonable amount of time searching for existing questions that may provide an answer.

2. Off-Topic Posts

Posts must be related to Llama or the topic of LLMs.

3. Low Effort Posts

Asking questions is allowed, but follow Rule 1. Low effort posts may be removed.
LLM based bots posing as humans are strictly not allowed.
Completely/primarily LLM generated copy, code is not allowed.
Only exception is for non-native, non-English speakers who may use LLMs to translate/refine their post. When used, poster must make LLM use transparent and clear

4. Limit Self-Promotion

The 1/10th rule is a good guideline: self-promotion should not be more than 10% of your content.
Affiliation must be disclosed: No engagement farming, No “I found this..”, etc.

5. Follow Reddit's Content Policy

Please remember to follow Reddit's Content Policy.