A Reddit user split a 27B model between a MacBook and an iPhone and reported 29-44% faster prompt processing. Here is how that works, why prefill matters, and whether small businesses should run AI locally.
Published October 6, 2026. Details are as described by the original poster; we have not reproduced the benchmark.
Yes, for some AI workloads. Reddit user StayLameBro offloaded part of a Qwen 3.8 27B model from a 24 GB M4 Pro MacBook to an iPhone 17 Pro Max and reported 29-44% faster prefill (the prompt-processing stage). The phone adds memory and compute, so a model that barely fits on the laptop runs with more headroom.
The Reddit thread: r/LocalLLaMA: “I made my iPhone a second GPU for my 24 GB M4 Pro MacBook” (about 920 upvotes and 200 comments).
A language model is a stack of layers. Normally all of them sit in one device's memory. In pipeline-split inference, the first device runs the first chunk of layers, sends the intermediate result to the second device, which runs the rest. Each device only needs memory for its own share.
The hard part is the connection. Every token has to cross it, so a slow link can erase the gain. That is why the speedup showed up mainly in prefill, where large batches of work move at once.
| Stage | What happens | Bottleneck | Who feels it |
|---|---|---|---|
| Prefill | The model reads your whole prompt and documents | Raw compute | Anyone pasting long documents or code |
| Generation | The model writes the answer token by token | Memory bandwidth | Everyone, on every reply |
Apple has been adding matrix acceleration to recent chips, and reviewers have measured large prefill gains on newer Apple silicon (MacStories). Using the phone's chip for extra prefill compute fits that trend.
| Option | Cost | Speed | Difficulty |
|---|---|---|---|
| Quantize the model (smaller numbers) | Free | Faster, slight quality loss | Easy |
| Use a smaller model | Free | Fast | Easy |
| Split across your own devices | Free if you own them | Depends on the link | Hard |
| Buy more memory | High, and rising (memory prices are climbing) | Best local option | Easy |
| Use a cloud API | Pay per use | Fast | Easy |
Local AI is right when data truly cannot leave your machines, or when you run the same simple task at very high volume. For most small businesses it is the wrong first step: the work is in connecting AI to email, CRM and phone systems, not in squeezing a model onto a laptop.
A practical rule: start with a hosted model inside a workflow with approvals, measure what it does on your real tasks, and only move steps to local models once you know which ones are worth it.
Dooza builds AI agents that connect to your existing tools (1,000+ app integrations) and picks the right model for each step, hosted or private, so you get the result without managing hardware.
Dooza is an AI-native company that builds AI products and services for small businesses, from the Dooza Workforce app to the Dooza Agents platform. A Dooza engineer scopes your pilot on a free 30-minute call, and every product starts with a refundable pilot: 100% refund within 14 days. Book a free pilot call or see pricing.
Experimentally, yes. A Reddit user split a 27B model between an M4 Pro MacBook and an iPhone 17 Pro Max and reported 29-44% faster prefill. It requires custom tooling and is not a consumer feature.
Prefill is the stage where the model processes your whole prompt before writing the first word. It is limited by compute, so it benefits from extra chips; generation is limited by memory bandwidth.
Roughly 14 to 17 GB at 4-bit quantization plus room for context, which is why 24 GB machines are tight and 32 GB or more is more comfortable.
Only when data cannot leave your machines or volume is very high. Most small businesses get more value from hosted models inside workflows connected to their tools.
Automate your business with AI employees that work 24/7. Start with a refundable pilot: 100% refund within 14 days.
Small, specialized inference engines built for one model or one GPU are beating general runtimes on speed. A r/LocalLLaMA debate drew 165 comments. Here is what is going on and why specialization wins in AI.
PewDiePie says OpenAI banned him twice while he trained Ajax, a 9B local model, on outputs from OpenAI models. Here is what distillation means, why AI labs ban it, and the platform risk lesson for businesses.
Start with a refundable pilot — 100% refund within 14 days. A Dooza engineer scopes it with you on a free 30-minute call. Pricing depends on the product; see pricing.
Refundable pilot · 100% refund within 14 days · No contracts