
Local Inference OnDevice Agent
Offline AI chat. No cloud.
About
This app provides an AI chat experience that runs entirely on your device, ensuring your conversations remain private and offline. It offers various AI models, integrates with device tools, and allows for custom API key usage.
What's New in Local Inference OnDevice Agent
1.1.1
August 17, 2026
Stability and fixes. • Much lighter on memory. On phones with less RAM the app was loading the model at the largest possible context window, which left the system paging it in and out and could make the phone feel like it had frozen. It now sizes the model to what your device can actually hold — around 200 MB less memory in use, and far less swapping. • The app now genuinely frees the model when you switch away, instead of holding it in the background. • Photos work properly. You can send a picture without typing a caption, retrying a photo question keeps the photo, and attaching one no longer silently turns tools off. • Tools tell you why they failed instead of just saying "failed", and tools that need the internet are hidden when you're offline rather than timing out. • Chats can be renamed — press and hold a chat in the list. • Answers you stop early can now be copied and read aloud. • A reply interrupted by the app closing is no longer lost; you can retry it. • The top bar now blends into the background instead of sitting on it as a flat slab. • Web search results are no longer matched to the wrong page. • Attached images are cleaned up properly instead of taking up space forever.
MoreFAQ
What is Local Inference OnDevice Agent?
Local Inference OnDevice Agent is a productivity app that runs AI models entirely on your device. It allows for private, offline AI chat without any data collection or cloud reliance.
Does Local Inference OnDevice Agent collect my data?
No, Local Inference OnDevice Agent is designed with privacy as a core feature. All AI processing happens on your device, and zero data is collected, ensuring your conversations remain private.
Can I use Local Inference OnDevice Agent offline?
Yes, the app works fully offline after an initial one-time model download. This means you can use its AI chat capabilities anywhere, without an internet connection.
What AI models does Local Inference OnDevice Agent support?
It supports 16 curated models from 0.5B to 8B, including Qwen3, Llama, Gemma, DeepSeek R1, Phi, and SmolVLM. Only models that fit your device's memory are offered.
Does Local Inference OnDevice Agent have ads?
No, Local Inference OnDevice Agent is ad-free. It is a free application with no advertisements to interrupt your experience.
What devices is Local Inference OnDevice Agent available on?
Local Inference OnDevice Agent is available for iPhone and iPad. It is designed to run efficiently on these Apple mobile devices.
How often is Local Inference OnDevice Agent updated?
The latest version is 1.1.0, and it was last updated on August 5, 2026. Updates typically bring new features, model support, and performance improvements.
What is the age rating for Local Inference OnDevice Agent?
Local Inference OnDevice Agent has an age rating of 17+. This is due to the nature of AI models and their potential outputs, which may be more suitable for mature users.


