Local LLM Server Pro vs amux

Turn Apple Intelligence into a local API for your scripts and apps. Local LLM Server Pro exposes Apple's on-device language model through selected OpenAI and Ollama-compatible endpoints. Inference stays on your device. PRO: A ONE-TIME PURCHASE No ads and no daily generation request quota. Pro does not expand Apple's model context window or guarantee background service. The free version is ad-supported and allows 100 generation requests per day. START WITH ONE RESPONSE Enable Apple Intelligence and wait for the model to be ready. Start the server, open the in-app playground, and ask a short question. Then use the curl, Python or JavaScript examples in Server Information to connect your client. A step-by-step setup guide is available from the support link. SUPPORTED WORKFLOWS • OpenAI Chat Completions with a custom /v1 base URL, streaming, structured output and tool-call responses. • Selected Ollama chat, generate and model-list endpoints. • Text embeddings using Apple's contextual embedding provider. • Same-device localhost access, or local-network access with an optional API key. • Server logs, request statistics and Shortcuts for server controls. KNOW THE LIMITS This app uses Apple's supported on-device model. It does not import GGUF or Hugging Face models, download arbitrary Ollama models, or provide OpenAI's Responses API. Use model IDs returned by the server, such as base. Compatibility depends on the endpoints your client uses. Requests can contain up to 1 MiB of JSON. This HTTP byte limit is separate from the model's token context. Shorten large conversations or tool definitions; use max_tokens to bound replies. KEEP THE SERVER VISIBLE Keep the app in the foreground while serving. On iPad, use Split View with your client alongside it. Requests may pause when the app is backgrounded or the screen locks. The optional background reminder is advisory, not suspension detection. REQUIREMENTS Apple Intelligence-capable hardware with iOS/iPadOS 26 or later, or macOS 26 or later on a compatible Apple silicon Mac. Apple Intelligence must be enabled, supported in your language and region, and its on-device model ready. Setup may require a model download. Setup and troubleshooting: https://www.kevintang.xyz/apps/Local-LLM-Server-Pro/support.html

Keep your AI coding agents running while you're away from your desk. amux is the remote control for your AI engineering fleet. Monitor live Claude Code, Codex, and Gemini sessions, approve pending actions, inspect terminal output, coordinate work across agents, and recover from problems directly from your iPhone. Think of it like GitHub Mobile for AI agents: the work happens on your laptop or server, amux puts the control panel in your pocket. WHAT YOU CAN DO FROM YOUR PHONE - Check overnight runs before getting out of bed - Approve permission prompts before agents stall - See exactly why an agent stopped (peek into live terminal output) - Assign a new task to an idle session - Send a steering instruction to redirect an agent mid-run - Monitor your whole fleet at once: status, active tasks, token usage - Manage the kanban board: see what's done, doing, and stuck - Keep coding while traveling BRING YOUR OWN SERVER amux is open source. Run the single-file Python server on your Mac, Linux box, or cloud VM, then connect this app over Tailscale, your LAN, or amux Cloud. Your code and agents never leave your infrastructure. BUILT FOR PARALLEL WORK Instead of babysitting one AI assistant, run a whole fleet. One agent per feature, per bug, per module, all supervised from a single dashboard. Self-healing keeps sessions alive: amux auto-compacts context, restarts on corruption, unblocks stuck prompts, and handles rate limits fleet-wide so your agents keep shipping overnight. TWO ACCESS MODES Native iOS app (this app): SwiftUI with optimized touch targets and full peek panel. Connects to your amux server over Wi-Fi, Tailscale, or the amux cloud tunnel. Progressive Web App: Open your amux dashboard URL in Safari and install to home screen for a full-screen experience without the App Store. REQUIREMENTS - amux server running on Mac or Linux (free, open source: github.com/mixpeek/amux) - Claude Code, OpenAI Codex CLI, or Gemini CLI installed on your server - Wi-Fi, Tailscale, or amux tunnel for remote access Learn more at amux.io