Local LLM Server

Local LLM Server

Ollama & OpenAI API Compatible

3 ratings
1 review
Free
With Ads

Details

  • Released
  • Updated
  • January 5, 2026
  • July 14, 2026

Features

Local LLM Server screenshot #1 for iPhone
Local LLM Server screenshot #2 for iPhone
Local LLM Server screenshot #3 for iPhone
Local LLM Server screenshot #4 for iPhone
🖼️Get Icon
Icons↘︎

About

Turn your Apple device into a private, local AI server. It hosts Large Language Models (LLMs) and offers an OpenAI-compatible API for development and testing. Run AI capabilities directly on your device without an internet connection.

Local LLM server hosting
OpenAI-compatible API
Ollama compatible API
Real-time monitoring dashboard
Live server logs
Built-in curl command example
Show original description
+1

What's New in Local LLM Server

1.4

July 14, 2026

• Chat playground — open your server's address in any browser and start chatting, zero setup • API key & network controls — optional Bearer-token auth, plus localhost-only or LAN binding • Embeddings API — /v1/embeddings and Ollama-style /api/embed, computed fully on-device • Structured outputs & tool calling — OpenAI-style JSON-schema responses and function calls • Real token usage counts in every response • Server Info dashboard — live uptime/request/token stats, QR-code connect, copy-paste curl/Python/JS snippets • Siri & Shortcuts — Start, Stop, and Status App Intents • Keep Screen Awake option and an optional alert if the server gets suspended • Fixed CORS headers so browser apps can call the API cross-origin

More

User reviews

Please provide a comprehensive list of compatible devices

I shouldn’t have to download this only to find my device is actually *not* supported, regardless of what the AppStore says.

Response from developer

Thank you for the review and I'm sorry to hear about the issues you've been having. I will be updating the marketing to show exactly which devices are supported. The device needs to be able to run Apple Intelligence. What device are you on? You may need to enable Apple Intelligence in your Settings. Settings > Apple Intelligence & Siri. This app relies on Apple Intelligence and needs it to be enabled to function.

Developer apps

FAQ

What is Local LLM Server?

Local LLM Server transforms your iPhone, iPad, or Mac into a private, local AI server. It allows you to run Large Language Models (LLMs) directly on your device, offering an OpenAI-compatible API for your development needs.

Does Local LLM Server require an internet connection?

No, a key feature of Local LLM Server is its ability to host a fully functional LLM server right from your pocket without requiring an internet connection.

What devices does Local LLM Server support?

Local LLM Server is currently supported on iPhone. It requires iOS 26.0 or above to run Apple Intelligence models.

How can I test the Local LLM Server?

Local LLM Server is developer-friendly and includes a built-in curl command example to quickly test your server and its API endpoints.

What is the age rating for Local LLM Server?

Local LLM Server has an age rating of 4+.

When was Local LLM Server last updated?

Local LLM Server was last updated on February 13, 2026, with the latest version being 1.2.

Does Local LLM Server have ads?

Yes, Local LLM Server contains advertisements.

Is Local LLM Server free to use?

Yes, Local LLM Server is available for free, but it does contain advertisements.