Solid app but..
Overall a great local LLM app but it would be amazing to be able to import non hugging face GGUF’s into the app so that I can run my own models for say testing on mobile devices. Good app though!
26.5 update
The new update completely made app non functional system fails to start working
Was solid, can't use your own api key
"You can download models from huggingface, not limited by the devs selection" old review, still applies for local chat but that is barebones and you need to start a new chat or it crashes every 10-20 messages. You can't bring your own api key and need to go through their subscription, there are many options that let you do that and it runs much better and less censored than local chat for pennies. They know users will not like local chat and pay them for a cloud sub.
Show more
Pretty good
It works better than the other local AI apps so far besides Google AI Edge Gallery. The only reason why I’m using this is because it automatically opens the chat window while Google Edge doesn’t do that.
feature request
to start, love the way you can install your own gguf’s from hugging face, because some other LLM apps simply do not give you such freedom. it also doesn’t have ads and tracking. but i believe if you could include an optional voice mode that uses the Kokoro voice generation model, voice mode would be more realistic than regular on-device voices. please consider my idea, and as always this is my go to local ai app—so happy i found this app!!
Show more
