GitHub - SharpAI/SwiftLM: ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, + iOS iPhone app.

A blazingly fast, native Swift inference server that serves MLX models with a strict OpenAI-compatible API. No Python runtime, no Global Interpreter Lock (GIL), no unnecessary memory copies. Just bare-metal Apple Silicon performance compiled to a single binary. 🍎 100% Native Apple Silicon: Powered natively by Metal and Swift. 🔌 OpenAI-compatible: Drop-in replacement for OpenAI SDKs (/v1/chat/com

[itpcfg]

SSDストリーミング出きるなら試してみよう

[nguyen-oi]

Python抜きのネイティブ実装は期待大。SSDストリーミングでデカいモデル動かすの夢あるわ。iOS版も胸熱

[misshiki]

“SwiftLM MLXモデルを高速に処理するネイティブSwift製推論サーバーで、厳格なOpenAI互換APIを採用しています。”