Leave a Review Private LLM
App is actually not so bad but could be improved
I’m currently using the 3b model on a iPhone 12 and it’s pretty rough. It’d be great to see it worked on some more even if the 7b model is the priority.Wwefan2013
Developer Response
We're working on adding support for downloading more modern 3B models (A couple of stablelm-3b-4e1t fine tunes and MiniChat-3B) along with more 7B models (Mistral 7B and Llama 2 7B fine tunes) to the iOS app. This update to the iOS app will ship just in time for Christmas. We shipped a similar update to the macOS app today, with bigger models of course.Great so far
Seems to do most of what I want. I think there just needs to be two main features added, and one of them should be super easy:
1. Allow increasing font size. Right now the font is pretty small on my computer, and the view menu doesn't have an option to increase font size
2. Support LaTeX. I do a lot of math work these days, and I don't want to see math written without LaTeX. ChatGPT has this feature, which has been super helpful for me when studyingShow lessLeChatParle
Good app with a privacy oriented focus
This is a very important app and concept in this day and age. Although as a suggestion in order to improve the AI users should be allowed to "opt in" to submitting data to better refine the model. Thank you for everything you do!ManicCoder
This is crazy-good, running on my *phone*!
Nice for Shortcuts that need to “think” a little!!!GeraldShudy
Great
Feature suggestion: the ability to edit the REPLIES that the LLM gives. This way you can influence it better.Avaviel
A great package
Worth the $10. Obviously not as useful as Bard/GPT but it undeniably meets all expectations, and I have yet to see anything comparable. With outstanding email support, a Discord support server, and devs that continually work to improve the app for all platforms- this is a must buy for anyone interested.Show lessPhantm-
A good start
This app is fun, but being able to use other models and configure them would make this app 10 times more useful. I’m hoping the dev adds support for model selection (mistral, pls) and setting the role of the AI.mrcsscco
Developer Response
Thanks for the review! We've already got the Mistral-7B-OpenOrca in the macOS version of the app, and we'll soon be releasing support for more Mistral-7B based models on macOS. The iOS app will have Mistral-7B based models, soon after that.Love Being able to run a powerfull LLM locally
I cannot believe it is as easy as a few clicks to install an LLM like ChatGPT and it is running entirely on my Mac! No internet required, no monthly fee for a plus version. awesome!jfbloom22
Simply Incredible!
I cannot believe that I can run a model similar to GPT 3.5 on my iPhone 12 mini! It is a bit slow, but really impressive. The purchase allowed me to install on my MacBook Pro M1 Max 32GB and it is faster than GPT 4.
Really excited to see how this app continues to develop and the models get better.Show lessMissing some key features.
Would love to have the ability to include default custom instructions like ChatGPT has. Would also like the option to redo the ai’s chat. Otherwise it’s nice to see this working on a phone.Gordo vaca
Developer Response
Thanks for the review! > Would love to have the ability to include default custom instructions like ChatGPT has. The ability to customize system prompts (aka custom instructions) is on our roadmap and will be released in an upcoming update, soon. > Would also like the option to redo the ai’s chat. This has been possible for a long time now. Perhaps we should document it better. Users can long press on any AI generated response in the app and tap on "Regenerate" option in the popover menu to redo the ai’s chat. Additionally, users can also long press on any of their earlier messages in the conversation and tap "Edit and regenerate" to change that message and have it regenerate its response based on the edit (the ChatGPT app currently does not have this feature)
