MLX ternary model
MLX ternary model Articles
Browse 3 articles about MLX ternary model.
Run Bonsai 2 27B Locally on a Mac: Ternary Quantization Explained
Bonsai 2 27B compresses a 27B reasoning model to 8.6GB with ternary weights, hitting ~47 tok/s on an M5 Max MacBook via MLX.
Bonsai 2 27Bternary quantization LLMrun 27B model on Mac
Run Bonsai 2 27B Locally on Apple Silicon With MLX
How to run the 27B-parameter Bonsai 2 ternary model on Apple Silicon via MLX at 8.6GB, plus GGUF setup for CUDA and llama.cpp.
run Bonsai 2 27B locallyMLX ternary modelApple Silicon 27B LLM
Run Bonsai 2 27B Locally on a Mac: Full Setup Guide
How to run Ternary-Bonsai-2-27B, an 8.6GB ternary-quantized 27B model, locally on Apple Silicon with near-FP16 quality and speed.
Bonsai 2 27B localternary quantization LLMrun 27B model on Mac