GitHub - mizorewww/laya-mlx: Native MLX runtime for Laya typed decision models — 7–14 ms short decisions on M3 Max. No text generation, PyTorch, or cloud API.

Open-weight typed decisions, running natively on Apple Silicon. 13.4 ms median end-to-end for a short English typed decision. 7.4 ms with the multilingual checkpoint. 0 output tokens. Local MLX inference, with no PyTorch, Transformers runtime, or cloud API. 中文 · Benchmarks · Snake demo · Hugging Face weights The GIF is an original-speed render of a real local Snake run. Every move calls Laya; the

[misshiki]

Apple Silicon Macでpip install laya-mlx。laya.loadでモデルを読み、predictに文とchoice・score・noulの質問を渡す。分類・採点・真偽判定をローカル処理。

[nguyen-oi]

Apple Siliconローカルで爆速意思決定モデル動かせるの夢がある