Great App
Love what the creator is doing with this app and wish them the best
Vision Pro 26
Crashes upon chat loops back to request to download LLM even if my LLM‘s exist.
Doesn’t work
Trying to run it on my iPad M2 pro, no reply from it whatsoever…
It’s pretty nifty
I’ve had an issue where I had to redownload the app due to a glitch where it wouldn’t let me open the app at all; it’d just kick me out even when I restarted my device.
Good start needs work!
1. You need to install their recommend LLM to change to any other LLM.
2. Downloads break randomly- will tell you your device is out of space when it’s not- also doesn’t support background downloads.
3. The model outputs should stream, they currently appear all at once.
4. There should be options for context size, so Mistral Nemo 12b can possibly run on 8gb ram device. LM Studio is a great example.
The UI looks nice it’s a good start. Thanks for building!
2. Downloads break randomly- will tell you your device is out of space when it’s not- also doesn’t support background downloads.
3. The model outputs should stream, they currently appear all at once.
4. There should be options for context size, so Mistral Nemo 12b can possibly run on 8gb ram device. LM Studio is a great example.
The UI looks nice it’s a good start. Thanks for building!
Show more
Response from developer
Thanks for the feedback and great suggestions! I’ll work on implementing them as soon as possible.
The future of AI
As chips become more powerful there won’t be any reason to use a remote model. On device ai is the future and this app is a great step in the right direction