You can help by asking ChatGPT to produce the most processor intensive prompt it can come up with and then having it execute it repeatedly. With the free version this will burn through your allotment pretty quickly, but if thousands of people start doing it on a regular basis? It’ll cost OpenAI a lot of money.
Sooooo, wanna tell us how much the cost really is per prompt?
Why would anyone believe this? It’s a private company. They don’t have to be truthful talking about their finances.
Why would they lie about losing money? Companies lie for the opposite all the time, but none of them boasts of losing money, as that causes FUD, which exactly what a hypelord like Altman doesn’t want.
$200 a month for a user is losing money? There’s no way he’s just including model queries. An entire a6000 server is around $800 / month and you can fit a hell of lot more than 4 peoples worth of queries. He has to include training and or R&D.
I’m honestly fairly surprised as well, but at the same time, they’re not serving a model that can run on an A6000, and the people paying for unlimited, would probably be the ones who setup bots and apps doing thousands of requests per hour.
And honestly? Those people are 100% right.
If they can’t deliver true “unlimited” for 200 bucks a month, they shouldn’t market it as such.
grumble grumble unlimited mobile data grumble grumble
To be fair, unlimited is supposed to mean unlimited for a reasonable person. Like someone going to an “all you can eat buffet”. However those purchasing these would immediately set up proxy accounts and use them to serve all their communities, so that one unlimited account, becomes 100 or a 1000 actual users. So like someone going to an “all you can eat” and then sneaking in 5 other people under their trenchcoat.
If they actually do block this sort of account sharing, and it’s costing them money on just prolific single users, then I don’t know, their scaling is just shite. Like “unlimited” can’t ever be truly unlimited, as there should be a rate limit to prevent these sort of shenanigans. But if the account can’t make money with a reasonable rate limit (like 17280/day which would translate to 1 request per 5 sec) they are fuuuuuucked.
