Local MLX tuned models through OpenAI compatible LLM, image generation and audio inference on Apple Silicon — Rust + PyO3 + MLX
What is the Ar9av/mlx-lm-server GitHub project? Description: "Local MLX tuned models through OpenAI compatible LLM, image generation and audio inference on Apple Silicon — Rust + PyO3 + MLX". Written in Rust. Explain what it does, its main use cases, key features, and who would benefit from using it.
Question is copied to clipboard — paste it after the AI opens.
Clone via HTTPS
Clone via SSH
Download ZIP
Download master.zipReport bugs or request features on the mlx-lm-server issue tracker:
Open GitHub Issues