Nice app, but privacy concerns
It works pretty well, and lower memory requirements, depending on the task, than loading the full model in other frameworks
But: Why does a local AI app which runs on device (purportedly) give me the functionality to thumbs up or thumbs down the response??! personally, if I’m running it on device and powering the matmuls by draining my battery I want the model running in a Faraday cage
But: Why does a local AI app which runs on device (purportedly) give me the functionality to thumbs up or thumbs down the response??! personally, if I’m running it on device and powering the matmuls by draining my battery I want the model running in a Faraday cage
Show more
アップデートで動作不安定に
続けて質問するとフリーズするようになってしまった。
今は微妙
17無印でE2Bを試したけど回答にハングルやヒンドゥー語?にアラビア語も割と混ざったりする。めっちゃ大量のメモリ詰んだマシンで高性能なローカルLLMなら実用性が高まるだろうけど現実は金かけない人が大勢だしそこまでする価値はないから今はクラウドLLMで十分。完全ロマン枠
chat窗口,大于两轮对话,或文字比较多时,窗口死掉(冻结)。
如题,如果token超限,或资源不够,希望能有提示,并平稳退出,而不是死掉,然后只能强制关闭整个应用。
Great concept, but serious stability issue
I’m facing a serious stability issue on my iPhone 16 Pro. The first query works, but when I send a second query the app freezes and stops responding. Force-closing and reopening the app does not reliably solve the problem.
I’m using a Gemma 4 E4B-it model, so please investigate the multi-turn inference issue on iOS, particularly with larger models. The app has great potential, but it needs better stability and memory management for repeated queries.
The app needs a better storage management feature - clear breakdown of “model files, cache, media, temp data…etc.,.”. - wt can be safely deleted to free up space.
I’m using a Gemma 4 E4B-it model, so please investigate the multi-turn inference issue on iOS, particularly with larger models. The app has great potential, but it needs better stability and memory management for repeated queries.
The app needs a better storage management feature - clear breakdown of “model files, cache, media, temp data…etc.,.”. - wt can be safely deleted to free up space.
Show more
使えますね
良かった点
・システムプロンプトなどを含めて細かく設定ができる
改善して欲しい点
・UIがかなり不親切
タイルからチャットを選んだらそのままチャット移行でいいです。モデルチェンジもチャット画面から行えば十分
履歴も他のアプリに合わせて左に配置して隠しておけばいいと思います
履歴の名前変更ができないのもイマイチ
今あるローカルLLMでは最適解ですが、UIはまだまだβテストレベルです
・システムプロンプトなどを含めて細かく設定ができる
改善して欲しい点
・UIがかなり不親切
タイルからチャットを選んだらそのままチャット移行でいいです。モデルチェンジもチャット画面から行えば十分
履歴も他のアプリに合わせて左に配置して隠しておけばいいと思います
履歴の名前変更ができないのもイマイチ
今あるローカルLLMでは最適解ですが、UIはまだまだβテストレベルです
Honestly a good idea from Google: Local AI
[TL;DR] Great app, but some bugs need to be addressed. Could use .safetensors model support as well.
I honestly think this app is genius. Let’s say that you’re out in the middle of nowhere and you need to see what type of food is safe to eat. You upload an image, and let the Gemma model do its thing. Or, when you’re back online, you can use the Agentic mode where it can access the internet (with custom plugins).
You might be wondering why this review it only 4 stars. The bad part: the app is super buggy on an iPhone 15. After a second prompt, the app freezes. Want to change the model’s settings? Nope; another crash. And the problem with this app is that you can only use their special litertlm format for the models (the reason why is that it manages the orchestration, kv cache, and memory mapping all in one). It would be great to see safetensors support.
Also the desktop app is bugged as well. It’s just the iPhone app but ported to Mac. So it’s just an iPhone simulator (basically). Just don’t use this on desktop; use ollama, lm studio, or vllm instead.
In conclusion, this app has great potential, but would need some improvements.
I honestly think this app is genius. Let’s say that you’re out in the middle of nowhere and you need to see what type of food is safe to eat. You upload an image, and let the Gemma model do its thing. Or, when you’re back online, you can use the Agentic mode where it can access the internet (with custom plugins).
You might be wondering why this review it only 4 stars. The bad part: the app is super buggy on an iPhone 15. After a second prompt, the app freezes. Want to change the model’s settings? Nope; another crash. And the problem with this app is that you can only use their special litertlm format for the models (the reason why is that it manages the orchestration, kv cache, and memory mapping all in one). It would be great to see safetensors support.
Also the desktop app is bugged as well. It’s just the iPhone app but ported to Mac. So it’s just an iPhone simulator (basically). Just don’t use this on desktop; use ollama, lm studio, or vllm instead.
In conclusion, this app has great potential, but would need some improvements.
Show more
Love the App !
Make search skill and sometimes is crashing
今後の進化に期待(Gemma4 E4Bまでは動作)
iPhone Airで動作確認しました。
Hugging FaceからDLしたGemma4 12Bを手動インストールしましたが、動作はかなり重たく3〜4回のやり取りで爆熱になりました。
アプリ内からDLできるGemma4のE4Bであれば快適に動きますが、精度は大幅に下がりますね。
簡単なチャットなら最低限使えますが、複雑な資料の要約などに使えるようになるにはもう少し進化が必要でしょう。
Hugging FaceからDLしたGemma4 12Bを手動インストールしましたが、動作はかなり重たく3〜4回のやり取りで爆熱になりました。
アプリ内からDLできるGemma4のE4Bであれば快適に動きますが、精度は大幅に下がりますね。
簡単なチャットなら最低限使えますが、複雑な資料の要約などに使えるようになるにはもう少し進化が必要でしょう。
Missing MacOS Support
MacOS app needs to be downloaded from the webpage. It would be great to have it in the MacOS App Store as well.
Missing MacOS Support
Impossible to scroll horizontally on MacOS in case of longer math formulas.
Eleventh of July
Google Gallery on iPhone 17 pro. With the new Gemma 4E4b with default settings except for switching halfway through to speculatively decoding and think it made it through an 18 question Q&A
Zero config sovereignty
The configs return to default every time you close the app. Why? Also the lack of gestures is baffling
Works really well
I really like it!!
Impression
💜
Google!
那些要求简中的自己去学学英语吧,英语作为地球语不学好还要人家反过来内置方言?下载不了也不是谷歌的问题啊 谁的问题懂得都懂 谷歌加油 "I'm Feeling Lucky."
iPadOS
native iPadOS application please.
No shortcut options in IOS
No shortcut options in IOS
Works great for local LLM usage
This is a great app if you want to be able to run Gemma models locally. I’m really surprised at how fast it runs—it made a recipe for black bean enchiladas in just 22 seconds on my iPhone 17 pro. It’s not the most user friendly and is oriented towards people testing stuff out but is great for what it is
Show more
질문 여러개를 이어서 하지못하는건 아마도... 메모리부족?
다 좋은데 질문을 이어서 하지못하는건 kv cache용 메모리가 부족해서 일까요? “메모리가 부족합니다!”메세지라도 띄워주면 좋을텐데 걍 멈춰버리니 아쉽네요 앱이 아예멈춰서 홈화면으로도 못가니...
