
OrchardGrid
On-Device AI as API
0 ratings
Free
About
OrchardGrid is the app that turns your Apple devices into sharable AI servers.
Apple's built-in AI runs on the Neural Engine — it cannot be shipped to traditional cloud GPUs. OrchardGrid turns that into a feature: install the app on any Mac, iPhone, or iPad and your device joins a programmable pool that exposes chat, image generation, text analysis, vision, speech recognition, and sound classification through a single HTTPS API.
Two ways to share:
• Share Locally — your device listens on port 8888. Any client on the same network can call it instantly.
• Share to Cloud — sign in once and reach your own devices from anywhere via the OrchardGrid relay. The relay forwards task IDs only; prompts and responses never touch our servers.
Flip either toggle (or both) in the menu bar app, then call any /v1/* endpoint from your favorite tool — the format is the industry standard, so existing code works unchanged.
Every inference runs on the Apple Silicon you already own. No external GPU bills. No data centers in the path. No prompts or responses logged anywhere.
Show more
What's New in OrchardGrid
1.21.2
April 16, 2026
• New community pool (optional): share idle capacity with other signed-in users, and tap the shared pool when your own devices are offline • Live "served this session" counter in the Devices card — see in real time when other users are calling your device • Web dashboard: the Sharing column now shows a green pulse the moment your device handles a community request • API compatibility polish — streaming token counts are now opt-in, and structured JSON responses arrive clean • New built-in Chat page on the web dashboard: talk to your own devices straight from the browser
More

