# Offline Chat: Private AI — On-Device LLM with RAG > On-device AI chatbot for private, offline conversations and document analysis. (iPhone/iPad app by Opus Noma LLC.) - Source: https://appshunter.io/ios/app/offline-chat-private-ai/id6474077941 (this page in markdown: same URL + `.md`) - Developer: [Opus Noma LLC](https://appshunter.io/developer/1501593543) - Category: Business, Productivity - Price: $4.99 - Rating: 3.56/5 from 25 App Store ratings · 25 written reviews indexed - Age rating: 12+ - Requires: iOS 17.0 · 1.6 GB - Languages: English - Released: 2023-12-14 - Data updated: 2026-06-10 - Monetization: free - User reviews in markdown: https://appshunter.io/ios/app/offline-chat-private-ai/id6474077941/reviews.md ## What is Offline Chat? Introducing Offline Chat, the next-generation AI ChatBot that runs entirely on your device without the Internet. You can use it anywhere, and your data stays private and secure. In addition to asking general questions, you can also load your private documents and ask questions about their content. It's a great way to conduct research using sensitive material. Currently we support PDF and plain text files. We provide 3 models: Tiny, Small and Medium. A larger model gives better answers, but it runs slower and requires more capable devices. "Tiny" runs on almost all devices. "Small" requires iPhone 14 and 15 Pros and "Medium" needs Macs and high-end iPads. While Offline Chat might not match the prowess of top-tier online models due to inherent memory and processing constraints, it stands out as an engaging and versatile tool. It's perfect for sparking creativity and assisting in various tasks such as writing, though it's advisable to verify facts independently. For the technically oriented, "Tiny" model is based on Microsoft Phi 2, and "Small" and "Medium" models are based on Mistral 7B 0.2, quantized to 3-bits and 4-bits respectively. ## Key features - Runs entirely on-device - Offline access - Private data storage - Load and query personal documents (PDF, TXT) - Multiple AI model options - Supports document-based research ## Recent user reviews (10 of 25) All indexed reviews: https://appshunter.io/ios/app/offline-chat-private-ai/id6474077941/reviews.md ### 1/5 — No support *2024-09-29* The models can’t be downloaded and the link for the site are broken. Would love contact from the developer. ### 1/5 — No longer updated *2024-07-26* Development has stopped progress. It was getting twice a month updates and is now a defunct app. ### 1/5 — The app is broken and dev site is down *2024-06-08* Do not buy this app. It’s a rug pull. ### 2/5 — Stop trying to outsmart AI *2024-05-09* Oh where to start with the AI hype cycle here. RAG integration is great in theory but seems poorly implemented. The big problem with this and other LLM middleware is inserting system instructions that are not documented and can’t be edited: “I'm here to help answer questions and provide information to the best of my ability. My system instructions are to always assist with care, respect, and truth. I will respond with utmost utility while ensuring that the information provided is secure and accurate. I will avoid harmful, unethical, prejudiced, or negative content and instead promote fairness and positivity in all of my responses.” Positivity? Truth? The truth is that’s short-sighted censorship and a fail in my book. ### 2/5 — Disappointed. *2024-04-24* Although this is a good app and you guys did your thing, I only realized afterwards that this isn’t what I was looking for, it’s missing many features I was hoping for but that’s my fault. Do keep up the good work, I’m sure there are many updates to come but as of now I can’t make any use for this app. ### 5/5 — Astonishingly great! *2024-04-06* Excellent AI. Almost as good as Google Gemini. For offline use, this is amazingly fantastic! Wish the info was updated past 2021, though. Well worth the price. Thank you Developer! High Five! ### 5/5 — Ai dev review *2024-03-19* As a local app hosted on a mobile device this app presents outstanding performance. The results are very impressive and useful for summarizing and explaining large amounts of data and code. Good job 🤘🏻 ### 4/5 — Almost there *2024-03-16* Really clean interface. Running Mistral 7B on device is awesome. Though, I’d love to see an option to customize the system prompt, at least. ### 5/5 — Really Impressed *2024-03-12* I’m researching for a solution to a service we need and this is checking a lot of boxes for what I wanted to see in a locally installed model on my phone. ### 3/5 — Neat app *2024-03-05* Offline chat is cool but the it’s not able to provide accurate information about what’s inside of a pdf document. I uploaded a copy of the US constitution and the app said it’s a document about AI lol ## Frequently asked questions about Offline Chat ### What does Offline Chat do? Offline Chat is an AI chatbot that operates entirely on your device, meaning it doesn't require an internet connection. You can ask it general questions, and it also allows you to load your private documents (PDF and plain text) to ask questions about their content. ### What are the different AI models available? The app offers three models: Tiny, Small, and Medium. The Tiny model is compatible with most devices. The Small model requires iPhone 14 and 15 Pros, while the Medium model is best suited for Macs and high-end iPads. Larger models generally provide better answers but require more processing power. ### Is this app free to use? Yes, based on the provided information, the app is free to use and does not have in-app purchases or advertisements. You can download and utilize its features without any cost. ### What kind of documents can I use with the app? You can load PDF and plain text files into the app to ask questions about their content. This feature is particularly useful for conducting research using sensitive materials privately. ### What are the limitations of this app compared to online AI models? While Offline Chat is a versatile tool, it may not match the capabilities of top-tier online models due to inherent memory and processing constraints on devices. It's recommended to independently verify any facts provided by the AI, especially for critical information. ## Version history (last 5 releases) ### 1.2.0 — 2024-03-05 Welcome to the bleeding edge! Introducing the on-device document chat: You can now load private documents and ask questions about their content. PDF and plain text files are supported. This feature works quite well on a Mac or a high end iPad. An iPhone? Perhaps. You be the judge, but keep in mind that no other app can do this. Please email us at info@opusnoma.com with your feedback. And leave us a kind review. ### 1.1.1 — 2024-02-07 Offline Chat now supports all devices with a new "Tiny" model which is installed by default. The default model in previous versions is now "Small", and you'll need to download it from within the app. Plus, we're providing a new "Medium" model that runs on Macs and high-end iPads. All new models are free. We'd love to hear about your experience with on-device AI and how you use it. Drop us a line at info@opusnoma.com or rate us in the App Store. ### 1.1.0 — 2024-01-30 Offline Chat now supports all devices with a new "Tiny" model which is installed by default. The model in previous versions is now "Small", and you'll need to download it from within the app. And we're providing a new "Medium" model that runs on Macs and high-end iPads. All new models are free. We'd love to hear about your experience with on-device AI and how you use it. Drop us a line at info@opusnoma.com or rate us in the App Store. ### 1.0.3 — 2024-01-17 - Added chat history, with an option to disable it. - Command-Enter key sends prompt. ### 1.02 — 2023-12-26 Updated model to Mistral 7B 0.2. This new model is truly extraordinary considering its size. ## Apps similar to Offline Chat | App | Rating | Price | Category | | --- | --- | --- | --- | | [Menlo Ventures](https://appshunter.io/ios/app/menlo-ventures/id6470205066) | — | Free | Business | | [Nino for Mobile](https://appshunter.io/ios/app/nino-for-mobile/id6447332909) | 5.0 (1) | Free | Business | ## More apps by Opus Noma LLC - [VDWrite](https://appshunter.io/ios/app/vdwrite/id920583100) - [VDScan](https://appshunter.io/ios/app/vdscan/id1446737725) - [BusClock](https://appshunter.io/ios/app/busclock/id1530213758) All apps by Opus Noma LLC: https://appshunter.io/developer/1501593543 --- *Data collected daily from the US App Store and indexed by [AppsHunter](https://appshunter.io/). User reviews are verbatim App Store reviews. Ratings, prices and chart positions refresh continuously; this snapshot is from 2026-06-10.*