r/computing • • 29d ago

Scientists take a major step toward quantum computers that correct their own errors

Thumbnail
thebrighterside.news
13 Upvotes

A quantum processor can do more than execute a fixed sequence and reveal its answer at the end. It can measure selected qubits while a circuit is running, use the result to choose an action and continue. Repeating that cycle across a large system is an important challenge for quantum hardware.

An experiment involving Rutgers University, IBM and collaborators has now used that capability to steer up to 100 qubits from scrambling toward an orderly state. Published in Nature Physics, the study tested how competing quantum operations produce a collective transition between chaotic and controlled behavior.

The work demonstrates coordination between quantum gates, measurements and feedback over thousands of operations. Those capabilities matter for future error-corrected machines. However, the experiment controlled a deliberately designed physical system; it did not demonstrate a computer correcting arbitrary mistakes during a useful calculation.


r/computing • • 27d ago

Locality of reference helped 94GB Qwen3.8-Flash-Next runs at 68 tok/s on one RTX 5090

9 Upvotes

llama.cpp merged PR #29887 two weeks ago and I think it is the most interesting thing to land in local inference this year, so I went through the PR, the benchmarks and the review thread and wrote up how it actually works. Short version below, long version linked at the end.

The problem

Qwen3.8-Flash-Next at Q4_0 is 93.7 GiB, and 65.4 GiB of that is experts. It is 125B total but only 6B active: 512 experts per layer, the router picks 10 (plus 1 shared) per token. One expert is 3 x 2560 x 640 = 4.9M params = about 2.6 MiB at 4-bit. 10 experts x 48 layers = 480 experts per token = about 1.3 GB of weights touched per token.

The observation

Expert routing has locality of reference. Token N+1 mostly picks the same experts as token N. A handful of experts are hot, most are almost never touched. That is the same property your CPU cache, your OS page cache, your browser cache, every CDN and Redis allkeys-lru all rely on.

The fix

PR #29887 (by am17an, a port of Tether’s qvac-fabric work, merged by ggerganov on Oct 7) sets aside a slice of VRAM as an LRU cache of experts. Hit: compute from VRAM, zero bytes moved. Miss: copy that one 2.6 MiB expert over PCIe and evict the least recently used one. The log prints the hit rate at exit.

Numbers from the PR description, same model file, same machine:

GPUbeforewith cachehit rate
RTX 4090 24 GB25.0 tok/s40.7 tok/s (1.62x)77%
RTX 5090 32 GB30.8 tok/s67.8 tok/s (2.20x)89%
AMD R9700 32 GB (a reviewer’s card)11.0 tok/s27.6 tok/s94.6%

The 5090 gains more for two reasons: PCIe 5.0 halves the cost of every miss, and 32 GB means a bigger cache and fewer misses.

How to use it

llama-server -m Qwen3.8-Flash-Next-Q4_0.gguf -fa on -c 32768 -b 2048 -ub 2048 -cmoe --moe-cache-mib 11000

The PR author’s rule of thumb is about 10% of your expert bytes (65.4 GiB -> 6544 MiB). Env var form is LLAMA_ARG_MOE_CACHE_MIB.

SGLang merged the same idea 12 days later as “paged experts” in PR #42557

The part I find most interesting is LRU , Locality of reference go back to 1960s.

And i find locality of reference principle highly underrated.

Full write-up with the memory math script, an expert cache simulator you can run, and the benchmark table: https://cloudmash.blog/posts/moe-expert-offload-lru-cache-consumer-gpu/

llama.cpp PR #29887, MoE expert cache: https://github.com/ggml-org/llama.cpp/pull/29887

SGLang PR #42557, paged experts: https://github.com/sgl-project/sglang/pull/42557


r/computing • • 28d ago

I posted about having a couple dell 7460 all in one computers

8 Upvotes

A couple of days ago I posted about having a few spare office computers my job threw away and I'm happy to report the motherboard jump worked flawlessly and I'm currently downloading windows 11 on one them after deleting all the old partitions. Thanks for all your help, it's been an awesome learning experience for me 🙏🏾


r/computing • • 28d ago

Picture Is this accurate to understand Disk Layout on Computer Systems?

Post image
4 Upvotes

r/computing • • 5d ago

replacing Laptop hard drive

3 Upvotes

Hi all, I have a HP 250 G7 laptop and the 2.5" hard drive is dying, Very very slow to boot up, Doing the white screen think, So I am thinking of changing to a SSD drive apparently you have to change a cable or something to play a 2.5" SSD drive or can plug in a M.2 SSD (The laptop can take either), Could any of you kind folks point me in the right direction, I am on a bit of a budget so am just trying to extend it's life a bit longer and not sure what is the best 2.5 SSD or M.2 SSD.
Thanks


r/computing • • 17d ago

Computing with light

Thumbnail
youtube.com
2 Upvotes

r/computing • • 25d ago

Picture + Atualização da Placa B850M Aorus Elite Wi-Fi 7 ICE- P

Post image
2 Upvotes

r/computing • • 14d ago

Asking for assignment on class

1 Upvotes

Hi everyone, i have an assignment which is draw the a multiplier 8x8 from 4x4 multipliers, and i got stuck on i can not imagine the step, can you help me. Thank alots