I can’t copy text from LLM Farm for external use of my research, useless !
Please correct this ASAP !
Great app
Incredibly good on iphone16 pro max.
Copying text
Ability to copy text out of the chat window would be great. Otherwise a good app.
Would love to see newer models for download.
Would love to see newer models for download.
It works!
Excellent app allowing easy setup for LLMs, looking forward to future updates to allow for attached photos or docs
More models!!!!!!
Stable Diffusion and can’t copy the llm’s answer
Very neat but needs some QOL improvements.
The fact that I can run an LLM on my iPad is insane. The fact that this is free is also insane. I imagine this app took a ton of work to create, so hat’s off. The one thing that I find irritating however is that you cannot edit responses (either the LLM’s or your own) and you can’t reroll a response, which is something that is pretty important especially with heavily quantized models that sometimes don’t “get it” the first time around. Also an indicator of the current context size would be nice. There’s also some controls that are unexplained like what looks like a refresh button that turns in to a checkmark. I have no idea what that does. Keep up the great work though!
Show more
Great, but…
Overall an amazing app. I really support allowing for anybody to grab models off huggingface and use them locally, but there are still a few issues:
1. Low RAM devices. I suspect certain models are being masked based on memory, but I dont see any newer models. Ive made and run some mamba/deepseek/qwen 3B param models locally with 4GB, so I know its possible.
2. audio models (speech to text, text to speech, and audio to audio) models are possible to run at low sample rates. The only other app I use for local language models is specifically because of this.
3. This is more long term, but I would like to see support for loading regular pytorch models (yaml/json for architecture, .pt/.pth for weights).
All in all, this is a great app, even without any changes. Thank you!!
1. Low RAM devices. I suspect certain models are being masked based on memory, but I dont see any newer models. Ive made and run some mamba/deepseek/qwen 3B param models locally with 4GB, so I know its possible.
2. audio models (speech to text, text to speech, and audio to audio) models are possible to run at low sample rates. The only other app I use for local language models is specifically because of this.
3. This is more long term, but I would like to see support for loading regular pytorch models (yaml/json for architecture, .pt/.pth for weights).
All in all, this is a great app, even without any changes. Thank you!!
Show more
Good lLM app but
I tried the app is great app, on image it show that user can import images to the chat, when I tried it and tap on button all app become grey without open the Image Photo Album!, I think it’s a bug on current version I hope it fixed, other than that, it’s the best Local LLM app so far !
Works well but copy failed
I would give 5 stars except copy function doesn’t work.
What is this
Selected the smallest model and it still won’t work or reply. Also you to stay on the download screen and watch download or repeat
Local LLm with RAG
This app is so close to being perfect. Please keep fine tuning it. Started following you on GitHub too. Good stuff you got going on.
WOW (yes pooks it’s here)
I mean this being free blows my mind. I’ve been messing around with it for a few days and it’s absolutely a game changer. It should definitely be more talked about. We can run AI’s that have been optimized to work on our phones LOCALLY. The Devs behind this are truly genius. Thank you for making me feel like iron man- your biggest glazer
Show more
Pretty good app!
Everything is nice, but crashes sometimes, policies in GitHub are extremely confusing and app needs some polish. But in general, very good app!
Was great, recent update broke it.
I had been using it with no issues for weeks until yesterday. Now no models load.
This app is not good
This app does not work lol
The best local LLM tool.
It's an excellent app. I hope it can add support for the Qwen large model.
No Image support.
This app doesn’t support VLMs though the preview image would suggest that it does.
False advertising
False advertising
Phenomenal
This is great! Lots of options for running custom models. Would love to have the ability to upload images for vision models. Allowing models to perform web searches would be handy too!
Five stars for now and for further
Really like this app after trying it out.
I can see in the preview images that can send pictures to llm, but I couldn't find the plus sign at the bottom left corner on my own phone. How does it works?
The download of models will be terminated when the phone screen is off.
It would be even more perfect if it could run in the background and share computing power services with other users on the local network through an API.
Very good!
I can see in the preview images that can send pictures to llm, but I couldn't find the plus sign at the bottom left corner on my own phone. How does it works?
The download of models will be terminated when the phone screen is off.
It would be even more perfect if it could run in the background and share computing power services with other users on the local network through an API.
Very good!
Show more
Response from developer
Thank you for your feedback. This is important to me. At the moment I am working on the site with documentation and bug fixes.
Good! But i have some suggestions
I think it's overall pretty good! However, I'm not a fan of the animal icons for every conversation. I believe using regular icons or even having the option to have no icon at all would attract more users to the app. Additionally, it would be great to have a "new conversation" button in the menu instead of creating a duplicate conversation each time which just made the title become longer and longer Also, maybe using AI to generate titles like ChatGPT does is great. Lastly, it would be awesome if the markdown format could be displayed during the generation process instead of after it's done. that would be awesome 👍 Anyway, thank you very much for this app!
Show more
Response from developer
Thank you for your feedback. This is very important to me. I am currently working on fixing the bugs. In the future I will add the possibility to use other icons.