Private LLM User Reviews

Top reviews

Leave a Review Private LLM
  • Great approach

    Having option to load own models will be wonderful. Eg Llama 2 or others.
  • Fantastic!

    A clean and easy-to-use Mac-native implementation of Llama. It's early days, but I'd love to see this on the roadmap:
    1. Ability to upload a file
    2. Ability to read a folder of files (imagine being able to ask questions about a bunch of documents!)
    3. Sharing options, incl. Markdown support
  • There should be an option to use 13B model. (feature request)

    UI is great and all but 7B model is not that powerful for any useful work, adding an option for Mac users to choose a bigger model will be useful.

    Developer Response

    Hello, thanks for the feedback! We've got an update that's currently in TestFlight Beta and App Store review, that'll let users on Apple Silicon Macs with 16GB or more RAM to download a bigger 13B parameter mode (WizardLM-13B-V1.2). This update should be released in the next couple of days. We're also working on enabling even bigger models for users with 32GB or more RAM. Update: The update with the 13B model download was released yesterday. Next up, 34B models for users with Apple Silicon Macs with 32GB or more RAM.
  • Helpful but not an end-all problem solver

    Gives solid basic advice. Can handle smaller projects and concerns. Not 100% there. Not 100% stable. Can tell some creepy stories that are unsolicited. Definitely needs a safety team.
  • Tons of Potential!

    This LLM Model is 100% offline, which makes me very happy! Even better, no data collection indicated! Using the application, it's very clear that this is not the final product; I have about a 50/50 success rate of getting an answer that is even close to the prompt, and the answers that are provided can be messy and hard to read. It's certainly not a ChatGPT replacement, which is to be expected from a 3B model that my mac reports is currently used in this app. However, for $10, having an easy to use, locally run instance of an LLM is amazing! My only real complaint is that I wish the Mac app could select larger models to use; the limitations on the iOS app make sense since the iphone is a lower-power device, but on M1 Macs, the more powerful processors should be able to run larger models just fine. Maybe that's a feature the developer could add in the future. I'm looking forward to what this app has in store for the future!
    Show less
  • Basically a scam

    I don't usually give 1 star reviews.

    A simple "hi" will give you a response that tells you it doesn't know what it's talking about.

    Tell it to be more concise it'll tell you it doesn't know what you're talking about.

    It will get very simple things just blatantly wrong, and overall will sound like a word salad being vomitted all over your screen. I saw the Reddit advertisement and this seemed promising, but honestly this is borderline insulting to install on my computer.
    Show less

    Developer Response

    The app has evolved significantly since v1.0.2. It now has bigger and more fluent models. Could you please try it again? Also, we never advertised on Reddit.
  • Easy to use and truly private and offline.

    Unlike almost every other offering on the App Store, Personal GPT was designed to provide a local, private GPT for you to use offline with no data being sent to third parties. It includes a limited LLM that works reasonably, given its size. The developer is clearly very passionate about this project and they are constantly updating and refining it. The more memory you have on your device the better this app performs.
    Show less
  • Reasonable Expectations

    The developer has given easy access to a usable information source, disconnected from the tentacles of big tech. This is to be applauded. But expectations are important here. You can't compare a solo effort with that of an organization with billion-dollar funding. Just contextualize this with pre-ChatGPT tech and you may find this a tool to have (in situations where yes.. you are disconnected from the internet or you don't want big tech operators to hoover your brain for free). Docs on if or how to do do supervised instruction of the model would be welcome or how to tweak this. Read the vendor warnings. These are known industry limitations of this type of offering.
    Show less
  • Great app

    This app is pretty great for when you don’t have internet, but want access to ChatGPT. It’s not as powerful as the online version, but the fact that this is a one-time price of $10 is awesome! The only issue I’ve encountered with it so far is that it reloads every time you leave the app even for a moment.

    I’d love to see a History feature to see previous conversations and maybe Shortcut support, but it’s overall a really great app!
    Show less

    Developer Response

    Thanks for your feedback! Shortcuts support is coming in the next version of the app: v.1.1.4, which is currently in App Store review. Also, thanks for mentioning the reload issue: I suspect the app reloads because iOS aggressively unloads apps in the background to conserve memory. We could persist the conversation when the app goes into the background and restore it back again, when the app is opened again. We'll implement that fix in an upcoming release (v1.1.5). Update: Shortcuts support has been released.
  • Disappointed with Inaccurate AI App - Seeking Refund

    I bought Personal GPT hoping for accurate and reliable results. However, I've been let down by the app's highly inaccurate output. I know AI technology is complex and evolving, but I expected better.

    Developer Response

    Thanks for your feedback! We'd appreciate it if you could tell us about the specific inaccuracies that you observed in the app's output. Please feel free to email us at support@numen.ie. Also, we're currently testing an optional 2x larger model that will only work on the latest iPhones (iPhone 14 series) and M1/M2 iPads. This will significantly improve the app's responses, when it's using the larger model.

Alternatives to Private LLM