1. Home
  2. 📊 Productivity
  3. MLC Chat
MLC Chat

MLC Chat

Chat with Open Language Models

78 ratings
61 reviews
📊 Productivity
🛠️ Developer Tools
Free

Details

  • Released
  • Updated
  • May 31, 2023
  • September 27, 2024

Features

Developer

Tianqi Chen
✨Promote your app ✨
MLC Chat screenshot #1 for iPhone
MLC Chat screenshot #2 for iPhone
iphone
ipad
📌Ready
Reviews summary↘︎
⭐61
Reviews↘︎
📝6+ tags
Tags↘︎
🔄6+ apps
Alternatives↘︎
❓5 answered
FAQ↘︎
📦w/o updates
Updates frequency↘︎
🖼️Get Icon
Icons↘︎

About

Engage in conversations with open language models directly on your iPad or iPhone. Once a model is downloaded, all interactions occur locally, ensuring privacy and offline functionality without internet access. This app is designed for non-commercial use, allowing you to run various open-source language models on your device.

✓Local AI model chat
✓Offline functionality
✓No internet required
✓Privacy-focused
✓Open-source project integration
✓Downloadable language models
Show original description

What users say

Summarized from real user reviews of MLC Chat. Based on 78 reviews and a 4.2/5 average, it highlights the 7 positives and 7 negatives reviewers mention most about this Productivity app.

Positive things

  • 🚀Runs fast locally
  • ✅Works offline
  • 💰Free to use
  • 👍Easy to use
  • 💡Supports various LLM models
  • 📱Great on newer iPhones
  • ✨Impressive proof of concept

Negative things

  • ⚠️Limited model selection
  • 📉High VRAM requirements
  • 📱Incompatible with older devices
  • ❌Crashes on some devices/models
  • 🗄️Cannot save conversations
  • 🔄Download/upload features removed/broken
  • 🐌Slow updates/downloads
See all reviews

What's New in MLC Chat

1.6

September 27, 2024

This version include llama 3.2 3b

User reviews

Most RecentHighest RatedLowest Rated

Pre-Selected Models

Look it works so I’ll give it that but you can only use one of 5 models. Maybe it’s hard to code the ability to import others but add that and it’s 5 stars
MW Mike MWMW Mike MW

Phi is broken and crashes

It’s a great app it’s very nice on 17 pro max but phi does always crash on iOS 26.0.1 17 pro max. Might just be on this phone but I never got this model to work. Everything else works perfectly though
Sorin GeantaSorin Geanta

No point

This app allows you to download only 4 very small open source models. LLM Farm is what you people are looking for not this
Ryanmon11982Ryanmon11982

Good

It works
EngagedooopEngagedooop

Completely offline, no subscription!

I love that it’s completely offline, with local inference and that there’s no subscription. But, it’d be a lot cooler with two additional features: (a) history of conversations and (b) ability to use the LLMs in iOS shortcuts
Jim RobertJim Robert
See 56 more reviews

User experience

🐞

Reported Bugs

17 issues

Phi model crashes on iOS 26.0.1 17 Pro Max

Bug

App crashes on iPad Pro 4th Gen, iPadOs 17.7

Bug

RedPajama model crashes app on initialization

Bug

Update is extremely slow

Bug

Download model button disabled in new version

Bug

RedPajama model crashes, custom model download removed

Bug

App closes when hitting send on iPhone 13

Bug

Conversation resets when app is backgrounded

Bug

Vicuna and Mistral 7B models cause crashes

Bug

Some 7b q4f16/q4f32 models crash on iPhone 15 Pro

Bug

App crashes on iPhone 13 mini

Bug

Cannot load other models from URL

Bug

Crash on iPhone 12

Bug

Severe heating and frequency reduction on A15

Bug

Low VRAM failed initialization on 3GB LP DDR4X phone

Bug

Cannot run 4bit model on iPhone 15 with 8GB RAM

Bug

Loading models from HF MLC official Repo causes crashes

Bug
✨

Requested Features

14 requests

Ability to import custom models (from URL/Hugging Face)

Feature

Support for more specific models (DeepSeek, Phi-2, Gemma 2B/7B, MoE Mixtral 8x7B, LLaVA)

Feature

History of conversations

Feature

iOS shortcuts support

Feature

Ability to export entire responses

Feature

Information on VRAM requirements per phone/model

Feature

Ability to change system message/create custom profiles

Feature

Ability to edit responses and system prompt

Feature

Add coffee support

Feature

Delete downloaded models

Feature

Change settings per model (repetition penalties, temperature)

Feature

How-to guide for importing/recompiling LLMs

Feature

Estimate model compatibility before download

Feature

Support for CN and ZH languages

Feature

FAQ

What does MLC Chat do?

MLC Chat allows you to chat with open language models directly on your iPad and iPhone. Once a model is downloaded, all processing happens locally on your device, meaning it works without an internet connection and without recording any information.

How does MLC Chat ensure privacy?

The app ensures privacy by running all language models locally on your device. This means no data is sent to servers, and no information is recorded, providing a secure and private chat experience.

Is MLC Chat free to use?

Yes, MLC Chat is a free application. It is part of an open-source project and is intended for non-commercial purposes, allowing users to download and run various open-language models.

What are the device requirements for MLC Chat?

Because the language models run locally, the app requires devices with sufficient VRAM. The specific VRAM needed will depend on the size and complexity of the models you choose to download and use.

Can I use MLC Chat offline?

Absolutely. Once you have downloaded a language model to the app, MLC Chat operates entirely locally. This means you can chat with the AI models without needing an internet connection.