Local LLM Server vs LLM Bench

Transform your iPhone, iPad, or Mac into a private, local LLM AI server. This powerful utility allows you to run Large Language Models (LLMs) powered by Apple Intelligence directly on your device, providing an OpenAI-compatible API and Ollama compatible API for your development and testing needs. Run a local AI LLM server on your Apple Intelligence enabled device to give private, local edge AI abilities to your applications. Note: This app requires iOS 26.0/macOS 26.0 or above to run Apple Intelligence models. Free version: 100 free requests per day, resetting at midnight. Local LLM Server Pro (separate paid app) has no limit, no ads, and no tracking. **Key Features:** * **Local Server Hosting:** Run a fully functional LLM server right from your pocket. No internet connection is required. * **OpenAI-Compatible API:** Seamlessly integrate with existing tools and clients that support standard chat completion endpoints (OpenAI and Ollama API). * **Real-Time Monitoring:** Keep track of your server's information with a live status dashboard showing IP address, active port, and logs. * **Live Logs:** View real-time server logs to debug requests and monitor performance instantly. * **Developer Friendly:** Includes built-in curl command example to quickly test your server. Whether you are an AI researcher, a developer building private apps, or an enthusiast exploring local intelligence, this app provides the local LLM AI infrastructure you need using the devices you already have. This app is not affiliated with nor is endorsed by Apple. Use responsibly and in accordance with Apple's terms of service.

LLM Bench is an iOS test bench for developers comparing on-device LLM behavior under real device constraints. Run the same prompt against selected local model targets and compare the evidence before choosing what belongs in your app. LLM Bench focuses on practical signals: load time, first output time, generation time, output speed, memory, thermal state, model readiness, raw output text, failures, and saved run history. Use LLM Bench to: - Compare GPU-capable local model runs on iPhone and iPad. - Run repeatable prompts against selected model targets. - Inspect model output, timing, memory, and thermal state in one place. - Save benchmark runs for later review. - Export benchmark evidence as CSV. - Add models from Hugging Face URLs, direct file URLs, or local imports when the artifact format is supported. LLM Bench is built for technical builders who want a compact measurement tool, not a leaderboard or generic AI chat app. It helps you answer the practical question: which local model behaves well enough on this device for this use case? The free tier includes one completed benchmark run. Subscribing unlocks ongoing benchmarking, saved comparison work, and export workflows. Premium is available as an auto-renewing subscription (monthly or yearly), or a one-time Lifetime purchase. Payment is charged to your Apple ID at purchase; subscriptions renew automatically unless canceled at least 24 hours before the period ends. Manage or cancel anytime in your App Store account settings. Privacy Policy: https://thedandano.github.io/michilotl-studios-docs/apps/llm-bench/privacy/ Terms of Use (EULA): https://www.apple.com/legal/internet-services/itunes/dev/stdeula/