Why models can’t be load
Why models can’t be load
Response from developer
Could you write a email about that from the app please?
Awesome!!
Just what you need for quickly running local llms
Make it work in background
You should make it work in the background, if you did that then I would pay for the premium and give it 5/5 stars
LLM on iPad Pro M4 16gb with Obsidian
Finally with ai.local I was able to integrate a local llm into Obsidian with Copilot and it works ✔️ Kewel! And thank you so much! Just need to keep both windows open side by side.
Ollama, not really
Says it’s an Ollama server, but they only allow models from hugging face. Had high hopes I could link this to OpenwebUI running on my NAS. Sadly it doesn’t work properly, but I like the concept.
Needs more features
This app could definitely help with more customization options, especially max token output
Can’t load my model?
I have not tried this fully yet and I’ll change the rating after I use it. But at the moment I do not seem to be able to load a specific model from Hugging Face. After searching in the install popup I am presented with a currated list of models. Also, there does not seem to be a way to cancel a download, I had to restart the ipad. Using an iPad Pro 11 inch M5.
Show more
Amazing App
I loved the app! it solves everything I needed: an AI server running on my own iPad. I would just like to request a few improvements:
• Improve the Hugging Face search, as I can’t find GGUF models, and it’s not possible to see the authors — only the number of downloads.
• Add the Hugging Face link to allow direct downloads.
• Allow the app to run in the background. I believe a possible workaround would be implementing something similar to YouTube’s background player.
• Improve the Hugging Face search, as I can’t find GGUF models, and it’s not possible to see the authors — only the number of downloads.
• Add the Hugging Face link to allow direct downloads.
• Allow the app to run in the background. I believe a possible workaround would be implementing something similar to YouTube’s background player.
Show more
This could make a lot of money
People don’t realize that ai Llm apps don’t expose rest api usually. This is a gem but it needs some fixes. I can confirm rest api actually works. It does need to allow custom models we can load ourselves, since stuck using their models. Can’t train these models unfortunately.
The models didn’t work well but I gave 3 stars still because this app could be the one that everyone goes to for this.
The models didn’t work well but I gave 3 stars still because this app could be the one that everyone goes to for this.
Show more
Overly complicated, functionally deficient
This app is complex and lacks instructions. Developers should realize that people don’t want to pay for poorly made AI apps. I’d happily pay for a powerful, well-designed, and documented on-device AI app.
Awesome, finally serious infra.
🇹🇭🧸
Great app
Perfect
Waited for this
Very easy to use sleek ui. I have it working with Pythonista apps. Does it have to remain open to work? O have problems with various clients connecting to it after pulling models. Otherwise it works looks good and can run nice size models
Works?
Have gotten it working, very nice have been waiting for something like this. I do have problems connecting to clients like Msty, chat wise, Kerlig, easy to setup worth the $ it does crash
