Prices from OpenAI and Anthropic have really jumped in the past month. I work for a big giant company and our Github co-pilot costs increased as of today, June 1st. Our internal estimates are that our bill will double or triple. How much are we willing to pay? I don't know, but nobody wants to be "left behind".

I think there's actually a big market opportunity here. Somebody, like Dell or HP, should start selling turnkey on-prem LLM servers.