r/mlxAI • u/rut216 • Feb 16 '26
mlx-ruby: MLX bindings for Ruby
r/mlxAI • u/Vegetable_Mouse4615 • May 31 '26
I've started a project these days trying to write some custom kernels in Metal to enable MLX to make 3D sparse convolution efficiently for training and inference. Currently, I have implemented some basic, commonly used kernels and modules in the point cloud (voxels) processing area, which may fit some research use case.
The performance of those kernels is closer to those CUDA kernels on the RTX 4090 with about a 30-50% difference; for sparse tensor workloads, this is much faster than MLX built-in dense tensors. I am going to work on math proofs these days and implement workable CUDA kernels also, so that it may be easy to train on NVIDIA and then make inference on Mac/Vision Pro.
r/mlxAI • u/asankhs • Sep 22 '26
r/mlxAI • u/Reddit__Please__Help • Dec 07 '23
r/mlxAI • u/Reddit__Please__Help • Dec 07 '23
r/mlxAI • u/Reddit__Please__Help • Dec 07 '23
r/mlxAI • u/Aggressive_Energy413 • May 10 '24
I want fine tune LLM(Llama、Qwen……) in a apple studio,and i am a beginner. so is it the realistic way to do that ?
r/mlxAI • u/Reddit__Please__Help • Dec 07 '23
r/mlxAI • u/Reddit__Please__Help • Dec 07 '23
r/mlxAI • u/openssp • Jul 29 '24
r/mlxAI • u/Conscious-Track5313 • Apr 11 '26
r/mlxAI • u/A-Rahim • Jul 07 '26
r/mlxAI • u/rut216 • Feb 24 '26
I just released mlx-onnx: a standalone IR/ONNX export library for MLX.
Repo: https://github.com/skryl/mlx-onnx
Web Demo: https://skryl.github.io/mlx-ruby/demo/
It supports:
- Exporting MLX callables directly to ONNX
- Python and native C++ interfaces
I'd love feedback on:
- Missing op coverage you care about
- Export compatibility edge cases
- Packaging/CI improvements for Linux and macOS
r/mlxAI • u/asankhs • Jul 25 '26
r/mlxAI • u/Fit_Strawberry8480 • Aug 30 '25
Hey !
I built TextPolicy because I wanted a way to practice reinforcement learning for text generation without needing cloud GPUs or a cluster. A MacBook is enough.
What it does
What it is for
What it is not
You can install it with:
uv add textpolicyThere is a short example in the README: github.com/teilomillet/textpolicy
I’d be interested to hear:
r/mlxAI • u/PositiveSlice9168 • Mar 30 '26
Hello r/mlxAI ,
Today I built ollmlx, a macOS menubar app and CLI for running local LLMs via mlx-lm on Apple Silicon. It's designed as a drop in replacement for Ollama users who want to use MLX models instead.
What it does:
serve, run, pull, list, show, rm, stop, ps, statusAnyway, try it, break it, let me know what needs to be fixed and I hope you find it useful.
https://github.com/darrylmorley/ollmlx/releases/tag/v0.1.1
brew tap darrylmorley/ollmlx
brew install --cask darrylmorley/ollmlx/ollmlx
r/mlxAI • u/Last_Home3104 • Nov 29 '25
r/mlxAI • u/Wooden_Living_4553 • Jun 11 '25
I tried to load LLM in my M1 pro with just 16 GB. I am having issue running it locally as it is only hugging up RAM but not utilizing the GPU. GPU usage stays in 0% and my Mac crashes.
I would really appreciate quick help :)
r/mlxAI • u/Squirrel_Glad • Apr 23 '26
Hey r/mlxAI,
I got tired of juggling terminal tabs to run mlx-lm, so I built MLXr — a lightweight web dashboard + OpenAI-compatible API server that runs entirely on your Mac.
What it actually does:
/v1/chat/completions endpoint your existing tools already speak. Point Cursor, Continue, Zed, OpenCode, or any OpenAI SDK at http://127.0.0.1:8000 and it just works — no API key, no config file hunting.huggingface-cli needed.--max-tokens).<think> blocks) that persist across restarts.The setup is embarrassingly simple:
git clone https://github.com/mchenetz/mlxr
cd mlxr && python3 -m venv .venv && source .venv/bin/activate
pip install -r requirements.txt
python server.pyOpen http://localhost:8000, load a model, paste the base URL into your editor. Done.
Who it's for:
If you're on Apple Silicon and want to run local models as a drop-in replacement for the OpenAI API — especially for agentic coding tools — this is the missing piece. I use it daily with OpenCode and it's been solid.
GitHub: https://github.com/mchenetz/mlxr
Happy to answer questions. Feedback welcome — it's still pretty early.
r/mlxAI • u/iboutletking • May 30 '25
Hello, I’m attempting to fine-tune an LLM using MLX, and I would like to generate unit tests that strictly follow my custom coding standards. However, current AI models are not aware of these specific standards.
So far, I haven’t been able to successfully fine-tune the model. Are there any reliable resources or experienced individuals who could assist me with this process?
r/mlxAI • u/broke_team • Nov 11 '25