Local LLM Server vs LM Pocket

Transform your iPhone, iPad, or Mac into a private, local LLM AI server. This powerful utility allows you to run Large Language Models (LLMs) powered by Apple Intelligence directly on your device, providing an OpenAI-compatible API and Ollama compatible API for your development and testing needs. Run a local AI LLM server on your Apple Intelligence enabled device to give private, local edge AI abilities to your applications. Note: This app requires iOS 26.0/macOS 26.0 or above to run Apple Intelligence models. Free version: 100 free requests per day, resetting at midnight. Local LLM Server Pro (separate paid app) has no limit, no ads, and no tracking. **Key Features:** * **Local Server Hosting:** Run a fully functional LLM server right from your pocket. No internet connection is required. * **OpenAI-Compatible API:** Seamlessly integrate with existing tools and clients that support standard chat completion endpoints (OpenAI and Ollama API). * **Real-Time Monitoring:** Keep track of your server's information with a live status dashboard showing IP address, active port, and logs. * **Live Logs:** View real-time server logs to debug requests and monitor performance instantly. * **Developer Friendly:** Includes built-in curl command example to quickly test your server. Whether you are an AI researcher, a developer building private apps, or an enthusiast exploring local intelligence, this app provides the local LLM AI infrastructure you need using the devices you already have. This app is not affiliated with nor is endorsed by Apple. Use responsibly and in accordance with Apple's terms of service.

Discover, download, and run open-source AI models directly on your device. No cloud. No subscription. No data leaves your device. LM Pocket brings the power of local AI models to your device. Browse thousands of GGUF models on Hugging Face, download them over WiFi, and chat with them entirely on-device. COMPLETELY PRIVATE Every conversation stays on your device. No server, no API key, no account required. Your prompts and responses never leave the device. DISCOVER MODELS Browse Hugging Face Hub for quantized GGUF models. Filter by size, quantization level, and popularity. See compatibility badges that tell you which models will run well on your device before downloading. CHAT WITH AI Stream token-by-token responses with full Markdown rendering. Manage multiple conversations. Adjust temperature, top-p, top-k, context length, and more. Supports ChatML, Llama, Mistral, Phi, Gemma, and other prompt formats automatically. LOCAL API SERVER Run an OpenAI-compatible HTTP server on your device. Expose /v1/chat/completions, /v1/models, and /v1/embeddings endpoints on your local network. Connect any app that supports the OpenAI API format. MANAGE YOUR LIBRARY Track installed models with storage usage. Import GGUF files from the Files app. Load and unload models with one tap. Monitor real-time performance: tokens per second, memory usage, and thermal state. BUILT FOR POWER USERS - GPU acceleration for fast inference - Background downloads with pause and resume - Hardware-aware model recommendations - Chat template auto-detection - Conversation export as JSON or Markdown - JSON mode with grammar-constrained output - Embeddings generation 100% FREE No subscriptions, no in-app purchases, no ads. Open-source AI should be accessible to everyone. SUPPORTED MODELS Run any GGUF-quantized model: Llama, Mistral, Phi, Gemma, CodeLlama, DeepSeek, Qwen, and thousands more from Hugging Face Hub. Model performance depends on device RAM and model size. Terms of Service: https://www.apple.com/legal/internet-services/itunes/dev/stdeula/