Can you update
The app is great! Please update with the newest model. Thank you very much!
Great way to start, but feels unfinished.
This is a great, free starting point for someone who wants to play with AI chat, but doesn’t want every query being sent and stored in the cloud. The models offered have apparently been optimized for Apple silicon, and they do feel more responsive compared to other apps. The suggested Llama 3.2 works well, as does its bigger brother (if your phone has RAM for it).
My single biggest gripe is the apparent lack of ability to give the models standard instructions, like a “system prompt.” That omission is enough to knock this to four stars for me. It’s not a major issue for the default Llama model, or the bigger Llama model. But the Qwen models can be VERY verbose. I don’t want to have to keep telling the model “be brief.”
There’s also some fit-and-finish issues that aren’t show stoppers, but could use attention.
First, the initial model download stalled around 60% of the way in. There’s no obvious way to abort and retry. I killed the app and tried again. Fortunately that had no ill side effects.
Second, once a model is installed, I didn’t find a good way to delete it. I wound up deleting the app (purging my chat history) and reinstalling to remove the extra model.
Lastly, the number of models are limited. I realize that’s probably because of the Apple silicon optimizations. In the fullness of time, it would be nice to have some more options, even if they were paid upgrades.
Thanks to the developer for the effort. Again, it’s a great start; I’m picky. They clearly know what they’re doing, and I’m sure they’ll get there eventually.
My single biggest gripe is the apparent lack of ability to give the models standard instructions, like a “system prompt.” That omission is enough to knock this to four stars for me. It’s not a major issue for the default Llama model, or the bigger Llama model. But the Qwen models can be VERY verbose. I don’t want to have to keep telling the model “be brief.”
There’s also some fit-and-finish issues that aren’t show stoppers, but could use attention.
First, the initial model download stalled around 60% of the way in. There’s no obvious way to abort and retry. I killed the app and tried again. Fortunately that had no ill side effects.
Second, once a model is installed, I didn’t find a good way to delete it. I wound up deleting the app (purging my chat history) and reinstalling to remove the extra model.
Lastly, the number of models are limited. I realize that’s probably because of the Apple silicon optimizations. In the fullness of time, it would be nice to have some more options, even if they were paid upgrades.
Thanks to the developer for the effort. Again, it’s a great start; I’m picky. They clearly know what they’re doing, and I’m sure they’ll get there eventually.
Show more
🚨 False advertising: does not work offline
This app does not work offline. I have switched to Apollo for running offline LLMs. That one actually does work.
To reproduce: 1. Download a model and let complete.
2. Exit app.
3. Turn on airplane mode, turn off cell data and WiFi.
4. Open app and type to chat.
5. Chat returns a timeout error, long after the time interval it would have taken to start a response had the app been connected.
To reproduce: 1. Download a model and let complete.
2. Exit app.
3. Turn on airplane mode, turn off cell data and WiFi.
4. Open app and type to chat.
5. Chat returns a timeout error, long after the time interval it would have taken to start a response had the app been connected.
Show more
Works well, but not on flights.
This app is great. While it’s does work offline, the app requires a connection to hugging face, so it’s not always possible to use it during a flight.
For less powerful phones
My M2 iPad can handle bigger models, but Fullmoon’s in-app list is constrained to models they have packaged for mobile.
This is the best idea ever but…
It just needs new/more open source models as they get released! Please add more!
Great it can use offline
Old but gold
Is what it is.
This will do what you need it to do, no flashy stuff.
Don’t expect a genius, but it ain’t dumb either.
Thanks folks!
Don’t expect a genius, but it ain’t dumb either.
Thanks folks!
Wird wohl nicht weiterentwickelt
Nette Idee, wird aber wohl nicht weiterentwickelt
Check your app, jerks
Does not work on iPad Air 4th Gen, even though this listing says it does. That pisses me off.
Likes to have Internet
It kind of insists on being connected to the internet. Makes me wonder what it’s communicating too.
If I turn wifi and data off completely then it works much better. But if I’m connected to slow internet then this app will hardly output any prints.
If I turn wifi and data off completely then it works much better. But if I’m connected to slow internet then this app will hardly output any prints.
Not actually local?
To reproduce: 1. Download a model and let complete.
2. Exit app.
3. Turn on airplane mode, or turn off cell data and WiFi.
4. Open app and type to chat.
5. Chat returns a timeout error, long after the time interval it would have taken to start a response had the app been connected.
If a bug, please fix
2. Exit app.
3. Turn on airplane mode, or turn off cell data and WiFi.
4. Open app and type to chat.
5. Chat returns a timeout error, long after the time interval it would have taken to start a response had the app been connected.
If a bug, please fix
Show more
It is almost perfect, great optimisation and UI
The app works and looks great. Only if it would be possible to upload custom AI models, gguf support would be much appreciated
New models and delete downloaded models
The app has been great but could you add gemma3:270m and the possibility to delete downloaded models?
Great app
It is very convenient to use, and the installation is quite simple. It would be even better if it supported the recently released GPT OSS 20B.
Lack of newer models
Using the app was elementary. It was super consistent, modern, and minimalist. Everything worked flawlessly. The models they have now are great for most people as whoever is going out of their way to download this app isn’t most people. But I think the app could really take it to the next level by adding more models. For example, DeepSeek’s 0528 would be an absolute game-changer!
Show more
😭
Crazy ngl
Great but …
It is excellent for local usage of LLM models; however, adding more models, especially the new ones, would make it perfect. Thanks to the developers; your efforts are truly appreciated.
ローカルで動くAIを見てみたいなら
アプリケーションのUIは洗練されており、こういうものが初めてのユーザーでもローカル環境(それもiPadオンリーなど)でLLMを動かす体験を得るのにはとてもよいと思う。
その一方で、自分でモデルを自由に登録できないという制約もあり、枠の外に飛び出してみるということは難しい。そして使えるモデルの更新も止まっているようで、日本語に関していえばあまり賢くない子が並んでいるという悩みがある。
とりあえずニューラルチップをのせた端末でどんなことができるのかを試してみるのにはいいのではないだろうか
その一方で、自分でモデルを自由に登録できないという制約もあり、枠の外に飛び出してみるということは難しい。そして使えるモデルの更新も止まっているようで、日本語に関していえばあまり賢くない子が並んでいるという悩みがある。
とりあえずニューラルチップをのせた端末でどんなことができるのかを試してみるのにはいいのではないだろうか
Love the concept
3 stars minimum. Love the concept, but unable to install on the Mac. Upon selecting a LLM package, there’s no ability to continue and install.
