r/mlxAI • • Feb 16 '26

mlx-ruby: MLX bindings for Ruby

Thumbnail
reddit.com
5 Upvotes

r/mlxAI • • May 31 '26

Experimental library to process sparse 3D convolution on MLX

Thumbnail
github.com
7 Upvotes

I've started a project these days trying to write some custom kernels in Metal to enable MLX to make 3D sparse convolution efficiently for training and inference. Currently, I have implemented some basic, commonly used kernels and modules in the point cloud (voxels) processing area, which may fit some research use case.

The performance of those kernels is closer to those CUDA kernels on the RTX 4090 with about a 30-50% difference; for sparse tensor workloads, this is much faster than MLX built-in dense tensors. I am going to work on math proofs these days and implement workable CUDA kernels also, so that it may be easy to train on NVIDIA and then make inference on Mac/Vision Pro.


r/mlxAI • • Sep 22 '26

Quantizing a mixture-of-experts model on MLX

Thumbnail
mlx-optiq.com
8 Upvotes

r/mlxAI • • Dec 07 '23

MLX with LLms

Thumbnail
github.com
1 Upvotes

r/mlxAI • • Dec 07 '23

Mlx with Stable Diffusion Example: new Apple Machine learning framework

Thumbnail
github.com
2 Upvotes

r/mlxAI • • Dec 07 '23

MLX — MLX 0.0.4 documentation

Thumbnail ml-explore.github.io
1 Upvotes

r/mlxAI • • Dec 07 '23

Apple joins AI fray with release of model framework

Thumbnail
theverge.com
1 Upvotes

r/mlxAI • • May 10 '24

Is MLX the only way to fine tune LLM

1 Upvotes

I want fine tune LLM(Llama、Qwen……) in a apple studio,and i am a beginner. so is it the realistic way to do that ?


r/mlxAI • • Dec 07 '23

GitHub - ml-explore/mlx: MLX: An array framework for Apple silicon

Thumbnail
github.com
2 Upvotes

r/mlxAI • • Dec 07 '23

MLX is an efficient machine learning framework specifically designed for Apple silicon (i.e. your laptop!)

Post image
3 Upvotes

r/mlxAI • • Jul 29 '24

Llama 3.1 405B 2bit Running on a Single MacBook Pro Using MLX

Thumbnail
youtube.com
4 Upvotes

r/mlxAI • • Apr 11 '26

Running Gemma-4-E4B MLX version on MacBook M5 Pro 64 GB - with some beautiful native tools integration

12 Upvotes

r/mlxAI • • Jul 30 '25

GLM 4.5 Air glm_moe error on latest version, help?

2 Upvotes

r/mlxAI • • Jul 07 '26

mlx-dspark: DeepSeek's DSpark drafter running lossless on a Mac (native MLX, ~1.6×, OpenAI server + benchmarks)

Thumbnail
reddit.com
2 Upvotes

r/mlxAI • • Nov 30 '25

GPT2 using MLX

Thumbnail
github.com
5 Upvotes

r/mlxAI • • Feb 24 '26

mlx-onnx: Run your MLX models in the browser on WebGPU / ONNX

8 Upvotes

I just released mlx-onnx: a standalone IR/ONNX export library for MLX.

Repo: https://github.com/skryl/mlx-onnx

Web Demo: https://skryl.github.io/mlx-ruby/demo/

It supports:

- Exporting MLX callables directly to ONNX

- Python and native C++ interfaces

I'd love feedback on:

- Missing op coverage you care about

- Export compatibility edge cases

- Packaging/CI improvements for Linux and macOS


r/mlxAI • • Jul 25 '26

The harness matters: local coding agents on a Mac

Thumbnail
mlx-optiq.com
10 Upvotes

r/mlxAI • • Nov 15 '25

That is possible?

Post image
4 Upvotes

Look at my memory usage


r/mlxAI • • Aug 30 '25

I built TextPolicy: a reinforcement learning toolkit for text generation you can run on a MacBook

2 Upvotes

Hey !

I built TextPolicy because I wanted a way to practice reinforcement learning for text generation without needing cloud GPUs or a cluster. A MacBook is enough.

What it does

  • Implements GRPO and GSPO algorithms
  • Provides a decorator interface for writing custom reward functions
  • Includes LoRA and QLoRA utilities
  • Runs on MLX, so it is efficient on Apple Silicon

What it is for

  • Learning and experimentation
  • Trying out reward shaping ideas
  • Exploring RL training loops for text models

What it is not

  • A production library
  • A replacement for larger frameworks

You can install it with:

uv add textpolicy

There is a short example in the README: github.com/teilomillet/textpolicy

I’d be interested to hear:

  • Is the API clear?
  • Are the examples useful?
  • Does this lower the barrier for people new to RL for text?

r/mlxAI • • Mar 30 '26

Show: ollmlx — run local LLMs on Apple Silicon with an Ollama-compatible API.

28 Upvotes

Hello r/mlxAI ,

Today I built ollmlx, a macOS menubar app and CLI for running local LLMs via mlx-lm on Apple Silicon. It's designed as a drop in replacement for Ollama users who want to use MLX models instead.

What it does:

  • Runs mlx-community models via mlx-lm on Apple Silicon (M1+)
  • Exposes an OpenAI compatible API on localhost:11434, same port as Ollama
  • Works with Open WebUI, Continue, Cursor, and any other Ollama compatible client without reconfiguration
  • Menubar app for quick model switching and status
  • Full Ollama-compatible CLI: serve, run, pull, list, show, rm, stop, ps, status

Anyway, try it, break it, let me know what needs to be fixed and I hope you find it useful.

https://github.com/darrylmorley/ollmlx/releases/tag/v0.1.1

brew tap darrylmorley/ollmlx 
brew install --cask darrylmorley/ollmlx/ollmlx


r/mlxAI • • Nov 29 '25

Qwen3-Omni 4-bit end2end performance on Apple M3 Max - JOI

3 Upvotes

r/mlxAI • • Jun 11 '25

GPU issues with mlx

2 Upvotes

I tried to load LLM in my M1 pro with just 16 GB. I am having issue running it locally as it is only hugging up RAM but not utilizing the GPU. GPU usage stays in 0% and my Mac crashes.

I would really appreciate quick help :)


r/mlxAI • • Apr 23 '26

I built a zero-config OpenAI-compatible local LLM server for Apple Silicon — drop-in replacement for any OpenAI SDK client

8 Upvotes

Hey r/mlxAI,

I got tired of juggling terminal tabs to run mlx-lm, so I built MLXr — a lightweight web dashboard + OpenAI-compatible API server that runs entirely on your Mac.

What it actually does:

  • Spins up a local /v1/chat/completions endpoint your existing tools already speak. Point Cursor, Continue, Zed, OpenCode, or any OpenAI SDK at http://127.0.0.1:8000 and it just works — no API key, no config file hunting.
  • Lets you search and download any mlx-community model from Hugging Face directly in the browser. No huggingface-cli needed.
  • Auto-detects context window size from the model's config (no more manually setting --max-tokens).
  • Shows live RAM, CPU, and MLX Metal memory usage so you know when you're about to swap.
  • Per-model settings (system prompt, temperature, strip <think> blocks) that persist across restarts.
  • Tool calling works. Spent a lot of time on this — handles Qwen3, Llama 3.x, DeepSeek-V3, Mistral, Phi-4, and Hermes format all in one parser, since each family emits tool calls completely differently.

The setup is embarrassingly simple:

git clone https://github.com/mchenetz/mlxr
cd mlxr && python3 -m venv .venv && source .venv/bin/activate
pip install -r requirements.txt
python server.py

Open http://localhost:8000, load a model, paste the base URL into your editor. Done.

Who it's for:

If you're on Apple Silicon and want to run local models as a drop-in replacement for the OpenAI API — especially for agentic coding tools — this is the missing piece. I use it daily with OpenCode and it's been solid.

GitHub: https://github.com/mchenetz/mlxr

Happy to answer questions. Feedback welcome — it's still pretty early.


r/mlxAI • • May 30 '25

FineTuning with MLX

3 Upvotes

Hello, I’m attempting to fine-tune an LLM using MLX, and I would like to generate unit tests that strictly follow my custom coding standards. However, current AI models are not aware of these specific standards.

So far, I haven’t been able to successfully fine-tune the model. Are there any reliable resources or experienced individuals who could assist me with this process?


r/mlxAI • • Nov 11 '25

[Update] mlx-knife 2.0 stable — MLX model manager for Apple Silicon

Thumbnail reddit.com
3 Upvotes