Clean interface needs more OpenAI account cost transparency
For what ChatAI is—a clean iOS-native interface to ChatGPT—the app does its job well. However, it needs better transparency about how your personal OpenAI account ties into the experience in order to be truly useful. It seems there’s a hidden actual “total cost of ownership” which is probably nominal, but led to a puzzling disablement of ChatAI’s connection to ChatGPT in my case.
After a couple weeks of using this app, my prompts within ChatAI started retuning errors that I had exceeded my quota. Digging in on OpenAI, the $18 worth of gratis tokens provided initially by OpenAI for trying the API interface that ChatAI utilizes on my behalf (of which I’d used up only a few pennies’ worth) had expired at the beginning of the month. I presume I’ll need to supply OpenAI with a credit card to continue using ChatAI. While I presume that will continue to be less than $1 per month based on my token utilization, it would have been nice for ChatAI to clue me into the issue differently.
Better connectivity into your underlying OpenAI account would be helpful too. I think casual users are likely to be confused by OpenAI’s pricing, which is, of course, on top of the price for this app. The $20/month ChatGPT Plus option doesn’t currently cover API utilization at all. API use is a separate charge, metered by natural language token counts within the prompts you submit. (Something higher than the word count.)
After a couple weeks of using this app, my prompts within ChatAI started retuning errors that I had exceeded my quota. Digging in on OpenAI, the $18 worth of gratis tokens provided initially by OpenAI for trying the API interface that ChatAI utilizes on my behalf (of which I’d used up only a few pennies’ worth) had expired at the beginning of the month. I presume I’ll need to supply OpenAI with a credit card to continue using ChatAI. While I presume that will continue to be less than $1 per month based on my token utilization, it would have been nice for ChatAI to clue me into the issue differently.
Better connectivity into your underlying OpenAI account would be helpful too. I think casual users are likely to be confused by OpenAI’s pricing, which is, of course, on top of the price for this app. The $20/month ChatGPT Plus option doesn’t currently cover API utilization at all. API use is a separate charge, metered by natural language token counts within the prompts you submit. (Something higher than the word count.)
Show less
Conversation is a required value
You'd think there would be some kind of testing before pushing app to the appstore and selling it, not only does it not work, menu also doesn't open half the time.
What a gem! Fantastic app!
This app has quickly become my go-to for AI research. The pre-saved prompts are nice, but being able to create and save your own prompts is great. Also the app saves your chats locally so you can go back and continue any of them or just delete them. And the price is great. It took a minute to figure out, but once I did, I was glad I made found and purchased it!
Show less
Works like a charm
Exactly what I was looking for, a very functional app that exposes the API functionally in a transparent fashion . Thanks !
Great app! I just have 2 issues with it
I love this app, I’m glad I found it through a Reddit post, I use it very often, and mainly have no issues except these two problems.
GPT-4 can not handle long or semi-long prompts. It will take forever to load and then it will just say “the request timed out” and trying to regenerate it will just produce the same results. Sometimes the prompts will work and sometimes it doesn’t. it’s just a bit annoying when I try to regenerate it again and again and it keeps failing.
Secondly, I was trying to delete old conversations with the AI, and it somehow deleted the ones I was still actively using and I couldn’t find them anymore, so i was a bit annoyed by that. Possibly adding a trash folder could be helpful so you can restore a prompt if it accidentally gets deleted.
Other than that this is a well made app. I will continue to use it.
GPT-4 can not handle long or semi-long prompts. It will take forever to load and then it will just say “the request timed out” and trying to regenerate it will just produce the same results. Sometimes the prompts will work and sometimes it doesn’t. it’s just a bit annoying when I try to regenerate it again and again and it keeps failing.
Secondly, I was trying to delete old conversations with the AI, and it somehow deleted the ones I was still actively using and I couldn’t find them anymore, so i was a bit annoyed by that. Possibly adding a trash folder could be helpful so you can restore a prompt if it accidentally gets deleted.
Other than that this is a well made app. I will continue to use it.
Show less
App is great! Consider a less generic name?
The app is a breeze without absurd month subscription. However the name is very generic. Search ChatAi in AppStore and you’re flooded with other nonsense. You should get yourself a cool name.
Doesn’t work at all.
App doesn’t work at all. Doesn’t support gpt4 or 3.5. I don’t get any responses, just says conversation is a required value.
Solid, great start.
Update: Great update so far! I’m not sure if this is remotely achievable by straightforward means, but would it be possible to add a sort of failsafe or background contingency to reduce timeouts? I could also see it being helpful with eventual GPT-4-32k usage when they make that API more widely available. Where a request may take a moment while a user is multi-tasking, so that if they go into another chat or leave the app(running in the background); the conversation wont fail to fetch the API response.
Sometimes the GPT-4 API is slow and it would be preferable to close the app and receive a notification from the name/title of that conversation when it pings back from the API.
Also, I think an optional setting to enable a token limit or response cutoff/stop phrase like in the playground. This helps a lot with chats and convos that are more structured or functional towards a recurrent goal or task.
Bravo. This will be a 5 star app. It’s already a better choice than a lot of more expensive options.
Your skill, courtesy, and honorable intentions are going to shine through here!
Always remember breaks and a healthy pace are important, this AI stuff is true ludicrous speed and everybody wants get their progress out there.
Take your time, and take care!
Thank you
*****
First review:
I can see this being useful and I’ll probably use it daily. It works well so far and has no glaring issues. Only thing I noticed was that sometimes the settings button wont work after exiting the settings and trying to get back in, but a quick restart fixes it. Not sure what causes that but something that small will likely be fixed in the next update or so. I would like to suggest adding a couple features if they aren’t already on the roadmap; model-specific token cost calc - a counter at the top of our chats that allow us to see the API cost incurred from the beginning of the chat to the current message. the ability to remove, or preferably archive certain messages from a chat so they don’t affect the chat history. Similar to how messages from the AI and the user can be deleted in Quora’s Poe AI app. A context cleanse button like Poe AI has, which separates the chat context into a new one but doesnt wipe old messages. (with undo or deletable) A profile icon for each chat, just to give a customizable visual indicator from the main screen and some personable quality in-chat. A consistent user icon that the user can choose, or perhaps also the option for a user icon for each chat. I’m not sure how it could be done, but if you could give your app the functionality for users to select text within the chat bubbles to highlight and copy particle segments, it saves the user the time and experience of having to paste an entire chat bubble into their notes to extract a segment. Thanks for making this app! A great resource to come!
Sometimes the GPT-4 API is slow and it would be preferable to close the app and receive a notification from the name/title of that conversation when it pings back from the API.
Also, I think an optional setting to enable a token limit or response cutoff/stop phrase like in the playground. This helps a lot with chats and convos that are more structured or functional towards a recurrent goal or task.
Bravo. This will be a 5 star app. It’s already a better choice than a lot of more expensive options.
Your skill, courtesy, and honorable intentions are going to shine through here!
Always remember breaks and a healthy pace are important, this AI stuff is true ludicrous speed and everybody wants get their progress out there.
Take your time, and take care!
Thank you
*****
First review:
I can see this being useful and I’ll probably use it daily. It works well so far and has no glaring issues. Only thing I noticed was that sometimes the settings button wont work after exiting the settings and trying to get back in, but a quick restart fixes it. Not sure what causes that but something that small will likely be fixed in the next update or so. I would like to suggest adding a couple features if they aren’t already on the roadmap; model-specific token cost calc - a counter at the top of our chats that allow us to see the API cost incurred from the beginning of the chat to the current message. the ability to remove, or preferably archive certain messages from a chat so they don’t affect the chat history. Similar to how messages from the AI and the user can be deleted in Quora’s Poe AI app. A context cleanse button like Poe AI has, which separates the chat context into a new one but doesnt wipe old messages. (with undo or deletable) A profile icon for each chat, just to give a customizable visual indicator from the main screen and some personable quality in-chat. A consistent user icon that the user can choose, or perhaps also the option for a user icon for each chat. I’m not sure how it could be done, but if you could give your app the functionality for users to select text within the chat bubbles to highlight and copy particle segments, it saves the user the time and experience of having to paste an entire chat bubble into their notes to extract a segment. Thanks for making this app! A great resource to come!
Show less
Response from developer
Thanks for the feedback. Definitely working on these things, and have some ideas to help with the token management and visualization of cost, context, etc. Text selection is in 1.3, but it was rejected by Apple, so a little delayed, but resubmitted already. 1.3 also has the ability to edit and delete messages from a chat, so that will help a tad on managing conversations. I plan to get a lot more control and visualization of the API limitations built out, so there isn’t mystery about what will work. Thanks again for the feedback.
Yes!
Ever since ChatGPT was announced I’ve been looking for an app like this. Straight to the point, cool features, direct to chatgpt and not having to sign up for other extra things.
Interesting, but…
I like the prompts. They make things interesting … but: I have some challenges being able to delete chats. They come back on screen refresh. Then, I just lost chat history on an 8-part chat I had just had (it is back to 0). I cannot edit the built in prompts reliably and would love to make my own, and/or delete ones I wouldn’t use. My chats are also not showing up in my open AI history, so they are entirely lost. Looking forward to seeing how this app evolves over time.
Show less
