Build or Skip

on-device LLM apps

We said MAYBE on August 4, 2026. Not settled — due August 4, 2027.

Read this with the caveat. We tested the engine that produced this verdict against 292 launches whose outcomes we already knew, and could not show it predicted which survived. Some of its data sources were also dead at the time of scoring. The verdict stays up, dated and unedited, because a record you can quietly revise is not a record — but it is worth less than it looked when it was written.

The evidence adds up to a real but middling opportunity: genuine cross-channel interest and proven paying competitors, offset by heavy platform risk and an entrenched leader. It's a plausible build for a technically strong solo founder who picks a sharp consumer wedge, not a slam-dunk market.

Was there demand

6out of 10

Multiple channels show real but modest interest: social chatter is present but low-upvote, keywords are growing, and several shipping competitors (some charging) prove commercial demand. It's clear interest, not loud unmet demand.

Could a builder win it

6out of 10

Incumbents are mostly indie/small (PocketPal, Private LLM) rather than network-effect giants, and a specific wedge (cross-platform or a focused consumer use-case) exists. But it's a hard-engineering, app-store-dependent space with a market leader raising acquisition cost.

The case against this verdict

On-device LLM is a fast-moving technical field where the actual moat is model-optimization engineering that OS vendors (Apple Intelligence, Google MediaPipe) are absorbing into the platform for free — a solo dev risks building a thin wrapper that gets obsoleted by the next iOS/Android release. The social signal is also weaker than it looks: sub-100-upvote posts and a top HN score of 20 point to enthusiast novelty, not durable paying demand.

Who was already there

  • Private LLMAppears to be iOS/Apple-focused only; limited cross-platform support; unclear monetization model; sparse marketing presence
  • AnythingLLMGeneralist positioning (not mobile-focused); desktop/web-centric; lacks native mobile UI optimization; productivity angle competes with many tools
  • Google MediaPipe LLM Inference APIDeveloper tool, not consumer product; Android-only (as of search); requires integration work; competing with Google's own services creates friction
  • PocketPal (referenced as top-ranked)Market leader implies higher user acquisition cost; likely has technical debt; app store dependency; saturated iPhone market

Other verdicts

What is worth more than this page. The register records what became of 6,266 real launches. No engine has to be right for that to be true.