Consider its limitations.
OnDevice LLM has a significant issue: The majority of available models will not run on the most capable iPhones. This is because of a memory limit that each model requires. And only the developer can correct this, not the user. So effectively the developer has designed OnDevice LLM to be unable to run at least half of their offered models. Once this is corrected it would be a 5 star app.
Show more
