Not sure why the good reviews
The issues were present before and even with the most recent update, it only runs Apple Intelligence, which seems to run fine. The inclusion of certain features (message regen, history, TTS, etc) is nice but…
models download from the curated list fine but it doesn’t load them… I did get one small model from the list to actually run briefly (first time… after I updated the app today… v1.9.1(96). When delete the downloaded model from the curated on-device list, I get an error stating the model is not found.. even though it shows downloaded. Crash report displays and then an error in the app where my only option is to close and reopen… Loading local models (even small ones) give an error that persists even after closing and reopening the app.
I do appreciate that its development is active and not stagnant but doesn’t seem to work beyond a certain point.
models download from the curated list fine but it doesn’t load them… I did get one small model from the list to actually run briefly (first time… after I updated the app today… v1.9.1(96). When delete the downloaded model from the curated on-device list, I get an error stating the model is not found.. even though it shows downloaded. Crash report displays and then an error in the app where my only option is to close and reopen… Loading local models (even small ones) give an error that persists even after closing and reopening the app.
I do appreciate that its development is active and not stagnant but doesn’t seem to work beyond a certain point.
Show more
__AppReview_
I don’t write reviews on apps
If you want to acess your home mostly offline llm stack, This app is the real deal, hook up to your home Stack of llms on your pc via WiFi or tailscale and message, transcribe or even have a voice conversation using lower web usage local voice to text software. It has good model organization, good server organization, conversation mgt and even some native setting like token size you can adjust on the client/Moble side. Interface is pretty seamless so far.
Show more
AGAnother waiting game
Response from developer
Thank you for your review, it means a lot to me :)
Checks all the boxes
I wanted a single app to run local LLMs and connect to cloud providers. This app does both really well for free. Only feedback is that the side bar is a bit cluttered, perhaps add a traditional chat history sidebar like other apps? But that’s not a big deal and the chats are organized very well.
DDibjibjub
Response from developer
That's a good suggestions, I will experiment with it and will check how it looks, maybe we can add collapsable toggle for other options. Let's see. Thank you for your review :)
