VecML vs Local LLM

VecML APP offers tools for intelligent photo search and large language models (LLMs) fully on device. Users can select from a range of small LLMs and engage in conversations with documents stored locally. The app can process files (PDFs, DOC documents, images, etc.) to generate embedding vectors, which are stored locally on the device. These embedding vectors are crucial for RAG (retrieval-augmented generation) capabilities, enhancing the LLM's ability to provide more accurate and relevant responses when queries are related to the local files.

MITHRIL is a private AI assistant that runs on your iPhone and iPad. Your conversations are processed on the device and saved on the device. No account, no cloud, no tracking. TWO KINDS OF MODELS • Apple's on-device model, built into iOS 26 on devices with Apple Intelligence. Nothing to download. • Open models from Hugging Face in GGUF format, from companies like Alibaba, Google, Meta, Microsoft, Mistral, DeepSeek and Liquid AI. Browse by company, see whether a model fits your device's memory before you download it, and switch any time. AN ASSISTANT THAT CAN DO THINGS It knows today's date, the time and your city from your device, and asks before it acts. Texts and emails open as drafts for you to review and send. Choose which abilities it can use: • Reminders and calendar events • Texts, email and phone calls • Look up your contacts • Directions and places nearby • Run your Shortcuts • Web search: Wikipedia, DuckDuckGo, or Brave with your own key • Search your own documents • Today's date and exact math PRIVACY YOU CAN SEE The Privacy map shows what runs on your device, what goes online, and exactly what is sent. A web search sends only the search words, never your conversation, and your location is only turned into a city name. A live list shows every network request MITHRIL makes. VOICE Dictate with Apple's speech recognition, or download NVIDIA Parakeet for more accurate on-device transcription. Hear answers in natural voices generated on the device. The floating assistant stays with you in Picture in Picture while you use other apps. FOR THE CURIOUS Tap the speed line under an answer for a live engine dashboard: tokens per second, time to first token, context use, cache hits and memory. REQUIREMENTS iOS 26. Apple's on-device model needs a device with Apple Intelligence. Open models run on any supported iPhone or iPad. Larger models need more memory, and MITHRIL shows what fits before you download. Models are made by their publishers and downloaded from Hugging Face. MITHRIL doesn't train or host models.