Most useful implementation of running LLMs locally
Would love to see updated UI, a more seamless way to manually add huggingface models, and support for many system prompt presets
Excellent local tool
Works great, but you should probably write a note explaining that you need to keep the app open to download a model, and the output textbox doesn’t seem to handle newline formatting correctly
Response from developer
Thanks for the feedback. I will look into this.
