Apple is in very early talks with PrismML about using model-compression technology to run far larger AI systems directly on iPhones, part of its push to upgrade Siri and broaden on-device AI.
PrismML says it shrank Alibaba's 27 billion-parameter Qwen model from about 54 GB to under 4 GB, making it runnable on an iPhone 15 or newer.
The startup claims 10-15x lower memory use, 6-8x faster processing and 3-6x lower energy consumption, with only a few percentage points of performance loss and factual recall hit harder than reasoning or coding.
Apple is evaluating speed, energy efficiency and real-world on-device performance because local AI could improve response times, keep sensitive data on the device and enable some features without internet access.
Analysts say the approach could support photography, video and health tools, but its battery-life, reliability and large-scale performance claims still need validation across millions of devices.
PrismML promises faster on-device AI, but will this new power come at the cost of our iPhone's all-day battery life?
With Google invested in PrismML, is Apple's interest a strategic partnership or a move to block a key rival's advantage?
As on-device AI becomes powerful, will our reliance on massive cloud data centers for intelligence actually shrink or just change form?
Qwen 3.6 (27B) Runs On-Device: PrismML Shrinks 54GB LLM to 4GB for iPhone 17 Pro, Ushering in a New Era of Mobile AI
Overview
On July 14, 2026, Alibaba's Qwen 3.6 large language model became fully operational on the iPhone 17 Pro, marking a major leap for mobile AI. This was made possible by PrismML, which open-sourced a highly compressed version of the model, shrinking it from 54 GB to under 4 GB. Thanks to PrismML's expertise in model compression and their Bonsai model family, all 27 billion parameters now run locally and simultaneously on the device. This breakthrough moves advanced AI from the cloud directly into users' pockets, enabling powerful, private, and efficient on-device intelligence.