@edzitron There's a lot of compute coming online, but for inference companies (been working with a friend's startup a lot on this), a lot of it is unusable. Craters the H200e pricing, but means profitable inference is still extraordinarily constrained. Too much of what nobody needs
Designing parts for highschool edutech has been great for my professional development because i design everything assuming a highschooler will make fun of my decisions online
@itsnoahd@Railway Does railway metal environments also use GCP? Seeing complete outages of all projects on railway metal, which is slightly disappointing to see
Bullish on providers that actually make changes to stay sustainable and profitable. Worth far more then short term subsidies to anyone serious about building a business on top of a provider.
When I was originally talking with people about a request based subscription, the original plan was to offer a basic $5 and $10 plan so casual people could enjoy the service free of worry, but some people wanted more usage and the $5 and $10 plans were very quickly considered small
the big shift happened when someone asked me for a $50 plan, at the time I was making maybe $100-$200/month in total revenue so $50 felt huge and the person I was talking with didn't feel like it was fair for a plan that was so much larger to have the same usage per dollar as the smaller $5 and $10 plans, when they asked for 7,500 requests/day I gave in because I was scared of losing out on the $50 (still on me to price something too low)
I try to do my best to price things higher than necessary so that going forward I can lower prices or raise usage, instead of raising prices or lowering usage
As of late I've found that the higher subs with more usage/$ are (in some cases) starting to drain the service a bit, $1/100 daily requests is comfy but tight, and I should've realized and stuck with that a while ago.
Obviously I don't like trying to make a change like this, that's why I made it a poll. It always feel bad to make a change that negatively impacts anyone so vote for what you think is fair, just know that a service that doesn't exist can't offer the best pricing