Back to list
High-Potential
Zig
⚡ mlx-serve: Python-Free Inference Server for Apple Silicon
202 stars10 forksZig
agentanthropic-apiapple-siliconclaude-codedeepseek-v4diffusionggufimage-generationinferencellmlocal-llmmacos
This is a local LLM inference server built specifically for Apple Silicon (M-series chips). The most striking aspect is its technical stack: it is written entirely in Zig, completely dropping any Python dependencies.
Built on top of Apple's MLX framework, it exposes APIs that are compatible with both OpenAI and Anthropic formats. Beyond the underlying inference server, it includes a native macOS application that supports chat, agent modes, and tool calling. For Mac users, bypassing complex Python environment setups to run a high-performance, low-memory local model service is a very practical utility.