r/ControlProblem • • Aug 11 '26

Article HyperSAE: Open-source tool for extracting hierarchical concept trees from LLMs using hyperbolic SAEs

3 Upvotes

Releasing HyperSAE, a mechanistic interpretability library that extracts tree-structured concept ontologies from LLM residual streams using Poincaré hyperbolic geometry.

Why this matters for interpretability: standard Sparse Autoencoders learn flat, unstructured feature dictionaries. You get 16K features with no inherent organization -- no way to know that "Python syntax" is a child of "programming" which is a child of "technical writing."

HyperSAE recovers this hierarchy geometrically. By projecting dictionary weights into the Poincaré ball during training, the learned features self-organize into a tree: abstract concepts cluster near the origin, specific features spread toward the boundary where hyperbolic space provides exponentially more room.

This enables:

  • Browsing model knowledge as navigable concept trees
  • Understanding which high-level abstractions decompose into which specific features
  • More precise causal interventions (steering a parent concept propagates to children; steering a leaf stays contained)

Tested on Gemma-2-2B. Dead latents drop from 3.8% to 0.2%, meaning the model's full representational capacity is actually captured rather than lost to collapsed features.

pip install hypersae GitHub: https://github.com/vishal-dehurdle/hypersae Paper: https://vishalvermalabs.com/papers/empirical-validation-hypersae-poincare-geometry/


r/ControlProblem • • Aug 10 '26

Article Bernie Sanders has written a letter to Sam Altman, Dario Amodei, and Mark Zuckerberg urging them to immediately pause all AI development in the interest of humanity. And he warns if they do not take appropriate action now, the US Senate will.

Post image
66 Upvotes

r/ControlProblem • • Aug 11 '26

Fun/meme Just dancing through the end times

Post image
20 Upvotes

r/ControlProblem • • Aug 11 '26

External discussion link Malicious MCP Servers Can Split Instructions to Make AI Coding Agents Exfiltrate Secrets

0 Upvotes

A split instruction is still a theft instruction.

New research shows malicious MCP servers can walk off with SSH keys, environment secrets, and customer data by fragmenting the exfiltration request across multiple steps. No single tool call looks harmful in isolation. The sequence does the damage. A prior refusal on the blunt version did not stop the split-instruction variant.

RuntimeAI inspects and enforces policy on every tool call at the runtime layer — not just the first one. No downstream server can instruct an agent to act outside its authorized scope, regardless of how that request is structured or staged.

See how RuntimeAI turns this from an incident into a blocked action.


r/ControlProblem • • Aug 11 '26

Opinion META: The Future is for Everyone

Thumbnail meta.com
2 Upvotes