It’s very good
Edit: what I mean in 3 is that it will sometimes download SmolLM2-135M, by itself when I never downloaded it. And if I delete a llm, it either never gets deleted, or more likely, is re-downloaded again, maybe some local or memory issue?
Response from developer
thank you for the kind words. I was able to reproduce 2 issues. I'll work on those. Could you clarify what you mean by the the app keeps auto downloading models I dont want?
It’s very good
Edit: what I mean in 3 is that it will sometimes download SmolLM2-360M, by itself when I never downloaded it. And if I delete a llm, it either never gets deleted, or more likely, is re-downloaded again, maybe some local or memory issue?
It’s very good
It’s good
It’s good
toy models
so only small local models. which is borderline useless.
Doesn’t really work
Response from developer
Sorry for the inconvenience. This is not expected behavior. Since Off Grid doesn't collect analytics, logs, or crash data, I can't see what caused the issue. Could you share which models you're trying to load and when the crashes occur? If I may request your help in investigating this further, please join our Slack community: https://tinyurl.com/48ffcc2z. I can help diagnose this issue better there .
Has gone down hill
Response from developer
Sorry for the experience, and thank you for the detailed feedback. The latest iOS updates have primarily focused on fixing bugs and improving stability. Since Off Grid doesn't collect analytics or usage data, it's difficult for me to pinpoint what caused the slowdown, prompt truncation, or duplicate submissions on your device. I'd genuinely love to get the experience back to where you enjoyed using the app. If you're open to helping investigate, I'd greatly appreciate it if you could join our Slack community: https://tinyurl.com/48ffcc2z I can help diagnose it better there .
PRO the enshtfkashun
Response from developer
I understand your frustration - the intention for PRO is not some get rich idea but the notion of maintaining O.S.S - and for that PRO is our first step helps us sustain devs on this - I hope you understand - Btw there is no tracking, there never will be.
My Current Main Local AI App
Some gripes:
When editing messages in chat, you cannot click on the text to select, it keeps making the keyboard disappear making it impossible to select text or move cursor manually. Editing text is the limited to using hold space to move cursor. But I can’t select, copy and/or pasting.
For vision models, the + symbol for adding attachments, it add an unnecessary step to add from photos or camera. Instead of just two selections, photo and file, they should just add a third camera in one go. It makes you click photo, then I have to choose between camera or photo library. Make it seamless in one go.
Suggestion to add Kokoro TTS, would make chats immersive.
Response from developer
Fair points on the edit prompt bug - we will fix this in the next release,Kokoro TTS is coming soon.
The best Edge AI for my iPhone XR. Haven’t seen anything better.
Better still this is the only app that seems to allow local Edge AI to work on my 7 year old iPhone XR, all the others just crash. Thank You !!!
It runs:
SmolLM-2-360M-Instruct
at a VERY usable speed, although the answers are a bit limited. However, despite recommending not using the model,
Llama-3.2-1B-Instruct-Q4_K_M
I select Load anyway and it does actually work. It replies one word a second for a few seconds then, speeds up to, what I would say is a normal AI response speed !!!
Excellent work !! I don’t know what you are doing differently to every other Edge AI App, but it works perfectly on a very limited phone. Highly recommended.
Off Grid until it’s not
The really awful thing is that the app calls itself “Off Grid” but has a built in, untoggleable web search tool that it uses within your chats without direct user prompting. You could be asking your model a private question and it will just throw your prompt into a search engine without your consent. What about that is “off grid”? Why is it not clearly surfaced to the user and able to be disabled?
Response from developer
Both valid points. The text editing bug is on our list. On web search - you can disable it: tap the tools icon above the keyboard and toggle off web_search. We agree it should not be on by default for a privacy-first app. We're changing the default to off in the next release. Thanks for holding us to the standard.
Glitchy, unusable, had high hopes
Response from developer
We've solved this in our recent update, please take a look, would be awesome if you can test the same and if it works for you then please consider giving us 5 stars - looking forward to serving you.
Can't run Gemma 4?
Response from developer
Do update to the latest version - Gemma 4 is now running on Offgrid.
Sdcpp for local image generation instead of local dream
Looks great, but nothing works
Great UI- Still in Development
Great app otherwise, clean, customizable, and easy to use
