Local LLM Server Pro

Turn Apple Intelligence into a local API for your scripts and apps. Local LLM Server Pro exposes Apple's on-device language model through selected OpenAI and Ollama-compatible endpoints. Inference stays on your device. PRO: A ONE-TIME PURCHASE No ads and no daily generation request quota. Pro does not expand Apple's model context window or guarantee background service. The free version is ad-supported and allows 100 generation requests per day. START WITH ONE RESPONSE Enable Apple Intelligence and wait for the model to be ready. Start the server, open the in-app playground, and ask a short question. Then use the curl, Python or JavaScript examples in Server Information to connect your client. A step-by-step setup guide is available from the support link. SUPPORTED WORKFLOWS • OpenAI Chat Completions with a custom /v1 base URL, streaming, structured output and tool-call responses. • Selected Ollama chat, generate and model-list endpoints. • Text embeddings using Apple's contextual embedding provider. • Same-device localhost access, or local-network access with an optional API key. • Server logs, request statistics and Shortcuts for server controls. KNOW THE LIMITS This app uses Apple's supported on-device model. It does not import GGUF or Hugging Face models, download arbitrary Ollama models, or provide OpenAI's Responses API. Use model IDs returned by the server, such as base. Compatibility depends on the endpoints your client uses. Requests can contain up to 1 MiB of JSON. This HTTP byte limit is separate from the model's token context. Shorten large conversations or tool definitions; use max_tokens to bound replies. KEEP THE SERVER VISIBLE Keep the app in the foreground while serving. On iPad, use Split View with your client alongside it. Requests may pause when the app is backgrounded or the screen locks. The optional background reminder is advisory, not suspension detection. REQUIREMENTS Apple Intelligence-capable hardware with iOS/iPadOS 26 or later, or macOS 26 or later on a compatible Apple silicon Mac. Apple Intelligence must be enabled, supported in your language and region, and its on-device model ready. Setup may require a model download. Setup and troubleshooting: https://www.kevintang.xyz/apps/Local-LLM-Server-Pro/support.html