Hi there, I'm the creator of PPQ. Very interesting results! I think what is likely happening is that the ChatGPT "vision" model they are using to interpret the image is secretly watered down to save on costs. The one at PPQ uses openAI "vision" model as well, but it is their actual standard model.
Assuming you were using the "free" version of ChatGPT, the lesson here is that "you get what you pay for!".
"Free" actually means "shitty and watered down"!
this territory is moderated
Thanks for PPQ. Have been loving it. Really like being able to feed in GitHub links.
As for the ChatGPT comparison above, it was the paid version, via the iOS app. I wonder if the ChatGPT website vs. iOS app has any fundamental differences.
reply
As for the ChatGPT comparison above, it was the paid version, via the iOS app. I wonder if the ChatGPT website vs. iOS app has any fundamental differences.
That is interesting. Even so, when you say "paid" version, you are reffering to the subscription usage and not API, corr?
Even with the subscription, it would be easy for them to slip in watered down results to save on costs with most subscribers not knowing the difference.
The API gives raw access to the high quality LLM without adding in a bunch of shortcuts via context windows, output limiting, or other limiting stuff they may secretly put into the system prompt. And yea wouldn't be surprised if the experiences might be different on web vs via phone.
reply
That is interesting. Even so, when you say "paid" version, you are reffering to the subscription usage and not API, corr?
Correct, the $20 monthly plan. Very interesting. I’ll have to try more direct comparisons using PPQ.
reply
Curious, what is stopping you from cancelling your subscription and using PPQ exclusively?
reply
I have a lot of previous conversations that I still circle back to and ask for additional information from. It would be an awesome feature on PPQ if you could export a conversation on one browser, and import it into another. That’s one thing that is nice about the subscription is being able to circle back to the same conversations on different devices. I don’t think a central server is necessary, but, exporting into a small file that can be easily imported would be real nice.
reply
That's actually an easy addition for us. Currently we have "export" available in account settings but no import because no one ever asked us.
Looking at ChatGPT though I see it allows you export your chats. Seems possible that we could make it so you could import all of your ChatGPT convos into us.
reply
10 sats \ 1 reply \ @ACYK 29 Jul
Circling back to add one more comment in case this makes it on the roadmap at some point. When importing conversations, there are a number of situations where simply being able to paste in the json text might be easier than uploading a file if that would be possible.
reply
Thanks for the continued feedback. We are going to have a sitdown and discuss what kind of import/export we can bring in quickly and what kind will take a little more thought.
That would be a really nice addition. I will say, I would rate the ability to export and import individual conversations higher than a feature that exports all history. The ability to bring one or two conversations over to my work phone for example would be nice. No need to be importing all of my conversations over for example. Or, the ability to send one conversation json file to someone else, and they can continue off of it, would be really useful. I wouldn’t want to send all my of conversations to someone else necessarily.
reply