MLC Chat vs VecML

MLC Chat lets users chat with open language models locally on ipads and iphones. After a model is downloaded to the app, everything runs locally without server support, and it works without internet connections do not record any information. Because the models run locally, it only works for the devices with sufficient VRAM depending on the models being used. MLC Chat is part of open source project MLC LLM, with allows any language model to be deployed natively on a diverse set of hardware backends and native applications. MLC Chat is a runtime that runs different open model architectures on your phone. The app is intended for non-commercial purposes. It allows you to run open-language models downloaded from the internet. Each model can be subject to its respective licenses.

VecML APP offers tools for intelligent photo search and large language models (LLMs) fully on device. Users can select from a range of small LLMs and engage in conversations with documents stored locally. The app can process files (PDFs, DOC documents, images, etc.) to generate embedding vectors, which are stored locally on the device. These embedding vectors are crucial for RAG (retrieval-augmented generation) capabilities, enhancing the LLM's ability to provide more accurate and relevant responses when queries are related to the local files.