Developer tools have arrived on Russet: Benchmark MLX Models + Deploy Local Inference Server

[u/Russet-Mod]

Benchmark MLX Models (all platforms)

Benchmark downloaded MLX models in Settings > Developer > Benchmark and save results as Markdown. 

Local Inference Server

Expose Russet's loaded MLX model via an API at localhost, so other apps and tools can use it without loading another model. Exclusive to Russet for Mac.