Great
Great, it would be useful Latex format for formulas + RAG with reranker for local content.. Tiny models without RAG are bad.
Add Copy&Pate please!
Otherwise great, but lacks copy and paste of generated text… love the hugging face flexibility to import new models, such as the Qwen3.5 family (please make standard!)
Good but
Needs a bit more stuff, like allowing to edit the system prompt. The rog feature is really good.
bug in iPhone xs
Bug Report: Model Persistence and Startup Errors (iPhone XS)
App Version: Mithril (Local LLM) Device: iPhone XS iOS Version: [ ios 18.3.2]
Issue Summary
I am experiencing two main issues regarding model management and app startup:
Redundant Download Prompt: After successfully importing and downloading a custom model, the app prompts me to download it again every time I select it.
ExecuTorch Error: Every time the app opens, an "ExecuTorch error" appears, even though the model is already present on the device.
Steps to Reproduce
Import a custom model and complete the download process.
Select the model for use.
Observe the prompt asking to download the model again. (Current workaround: I close/force-quit the app to bypass this).
Re-open the app and observe the "ExecuTorch error" notification upon startup.
Expected Behavior
The app should recognize that the model is already stored locally and load it immediately without re-triggering the download prompt.
The app should launch without ExecuTorch errors if the model files are valid and present.
Additional Notes
Despite the error messages, the model does eventually work if I bypass the prompts.
I am using an iPhone XS, so there may be specific optimizations or memory constraints related to older A12 Bionic hardware that are triggering these flags.
App Version: Mithril (Local LLM) Device: iPhone XS iOS Version: [ ios 18.3.2]
Issue Summary
I am experiencing two main issues regarding model management and app startup:
Redundant Download Prompt: After successfully importing and downloading a custom model, the app prompts me to download it again every time I select it.
ExecuTorch Error: Every time the app opens, an "ExecuTorch error" appears, even though the model is already present on the device.
Steps to Reproduce
Import a custom model and complete the download process.
Select the model for use.
Observe the prompt asking to download the model again. (Current workaround: I close/force-quit the app to bypass this).
Re-open the app and observe the "ExecuTorch error" notification upon startup.
Expected Behavior
The app should recognize that the model is already stored locally and load it immediately without re-triggering the download prompt.
The app should launch without ExecuTorch errors if the model files are valid and present.
Additional Notes
Despite the error messages, the model does eventually work if I bypass the prompts.
I am using an iPhone XS, so there may be specific optimizations or memory constraints related to older A12 Bionic hardware that are triggering these flags.
Show more
Works as described so far
I’ve just started using the app and it’s working as described. There is one critical feature missing. It must have a way to quickly copy the generated text. Each request and response needs to be able to be copied easily. Preferably with a button or a shortcut. I will update my rating to 5 stars a fast as possible when this feature is added. If there is a stretch goal for this app I would like to be able to use text2image models as well. Great job, and keep up the great work.
Show more
