• Headline is innacuralte. Customers who purchase a $200/month subscription, can save up to $13800 on token costs compared to “a la carte” token pricing. Open AI does lose over $1 per $ in revenue, but this is more a function of them having too much compute, and very high training costs, rather than a loss per gpu hour on tokens served, it should stilll be a loss for OpenAI:

    Open source model pricing per gpu hour, ranges from 80% margins at high batch saturation per user (low tps per user) to 50% at concurency of 8, to loss at fewer user requests per gpu. https://inferencex.semianalysis.com/compare/deepseek-r1-b300-vs-h200

    OpenAI has very high prices, and too much compute. They would likely lose $6000 per user who maxes out their $200 plan, and certainly over $1000 per user.

  • 10 days

    Is this a reverse psychology trick to convince people to pay for ChatGPT subscriptions?

  • 10 days

    I wonder what companies that have integrated AI into all their workflows and processes are planning to do when the times comes to pay real price for the tokens.

    spoiler

    Nothing. They aren’t thinking ahead.