Bonsai 27B (1-bit LLM): The First 27B-Class Model to Run on a Phone
SMRTR summary
Bonsai 27B is a new AI model that fits on an iPhone 17 Pro by compressing a 27-billion-parameter model down to just 3.9GB, using 1-bit weights. Despite its tiny size, it retains 90% of full performance, enabling real agentic tasks, tool use, and vision processing entirely on-device without cloud dependency.
SMRTR provides this summary for quick context. The original article belongs to Hacker News.
Read the original article