PrismML Releases Bonsai 27B for iPhone, iPad and Mac as Apple Evaluates Its AI
Updated
Updated · 9to5Mac · Jul 14
PrismML Releases Bonsai 27B for iPhone, iPad and Mac as Apple Evaluates Its AI
3 articles · Updated · 9to5Mac · Jul 14
Summary
Bonsai 27B is now available under an Apache 2.0 license, with PrismML saying the model runs natively on iPhone, iPad and Mac and offering a limited-time developer preview API.
At about 4 GB in its 1-bit form, the model is pitched as small enough for on-device use where a 12 GB iPhone exposes only about 6 GB of usable memory to apps.
PrismML says Bonsai 27B reaches up to 163 tok/s in 1-bit and 134 tok/s in ternary on an RTX 5090, versus 87 tok/s and 58 tok/s on an M5 Max.
CEO Babak Hassibi told CNBC that Apple and other companies are evaluating the startup's models for speed, energy efficiency and on-device performance, though he described the talks as very early.
The release follows earlier reports that PrismML had been meeting Apple about possible uses for its technology, underscoring Apple's broader push for more capable on-device AI.
PrismML promises faster on-device AI, but will this new power come at the cost of our iPhone's all-day battery life?
With Google invested in PrismML, is Apple's interest a strategic partnership or a move to block a key rival's advantage?
As on-device AI becomes powerful, will our reliance on massive cloud data centers for intelligence actually shrink or just change form?
Qwen 3.6 (27B) Runs On-Device: PrismML Shrinks 54GB LLM to 4GB for iPhone 17 Pro, Ushering in a New Era of Mobile AI
Overview
On July 14, 2026, Alibaba's Qwen 3.6 large language model became fully operational on the iPhone 17 Pro, marking a major leap for mobile AI. This was made possible by PrismML, which open-sourced a highly compressed version of the model, shrinking it from 54 GB to under 4 GB. Thanks to PrismML's expertise in model compression and their Bonsai model family, all 27 billion parameters now run locally and simultaneously on the device. This breakthrough moves advanced AI from the cloud directly into users' pockets, enabling powerful, private, and efficient on-device intelligence.