Leave a Review Private LLM
Great introduction to the use of open LLMs, but the Shortcuts integration is glitchy
This is a great, easy starting point to explore open LLMs locally on Apple devices.
Unfortunately the Shortcuts integration, likely the most helpful and distinguishing feature, suffers from glitches:
- The „ ask Private LLM” action errors out complaining of missing „q” and „s” parameters every second time, despite the input is one single text field
- the „Start a new chat with Private LLM” action doesn’t pass the values for prompt and query to the app most often than not, I originally thought it was due to some unexpected special characters or the text being too long, but copy/pasting the same prompt and input directly in the app always works without issues
Also, one missing feature that would make a world of difference since each model is tailored to specific use cases: allow pre-selecting a model for the Shortcuts actions.
If the issues with Shortcuts were to be addressed, this would be easily a 5 stars app that any LLM enthusiast with not much time on their hands should by yesterday!Show lessFederico Lox
Developer Response
Thanks for the review! Regarding the shortcuts issue, could you please email us at support@numen.ie sharing your device type and if possible your shortcut? We've been trying to reproduce it locally to no avail, perhaps we're missing some important detail.Works well
Works out of the box. I like that it’s getting updated with llms that will work on your phone. I would recommend to follow the developers recommendation for which LLM to use. Ps phone does warm up and use battery, but that’s expected.Concreteo
Good start!
This app is pretty fantastic! It runs almost smoothly on my phone and I can use it anywhere without needing the cloud. Some additional features that would be cool are being able to browse the internet, interact with documents, get connected with a keyboard for rephrasing or correcting grammar on my phone instead of just on a computer. Also, there could be some improvement in user experience - smoother animations would be awesome. Keep up the good work!Show lessWhatsApp12345