Benchmarking CI across cloud providers. Got some counterintuitive result on runcloud
1 × 16 vCPU box → 60s, $0.00227
20 × 1 vCPU sandboxes → 44s, $0.00209
25% more vCPU. 26% faster. 8% cheaper. Why?
My theory: at 1:06 of the 1:20 run, 477 of 478 test modules were done and load average was 3.93 on 16 cores, meaning you're paying for 12 idle cores to wait on one straggler, while sharding lets each core stop billing the moment it finishes.
Does that hold up, or am I missing something? Curious whether the other providers show this same patter and what other quirks are hiding in there.
“Competing on price is the dumbest strategy” is one of those guru lines that sounds smart until you look at reality.
China built the world’s manufacturing powerhouse by competing hard on price. Same playbook created massive winners across industries.
In cloud infrastructure, prices for agent sandboxes and microVMs can be marked up by as much as 13x. His company and Modal are clear examples of providers charging far more than the costs of the service.
Price competition is how real scale is built. Dismissing it just hands the market to someone hungrier.
Ignore the “never compete on price” gurus, thats how you lose the long game.
Competing on price is the dumbest strategy.
You're not buying a Porsche by dollar-per-horsepower.
Three Volkswagen Beetles might have more aggregate horsepower than a Porsche for the same money. But nobody wants three Beetles.
Hey @dbworku, really solid work on the hpc-sandbox-benchmarks!
Im working on a CI-shredding demo, taking the full CPython test suite and sharding it across hundreds of sandboxes to show how a long sequential CI run can be collapsed into something much faster. It mainly looks at total runtime, cost, and how evenly the tests distribute.
Im also planning to push the vCPU count as high as the providers allow to see how well they scale under heavy parallel load.
Any advice on config details or tips for the high parallelism tests would be appreciated!😁
This is fluid dynamics, the same math used to design wings and predict weather
267 billion calculations
16 minutes on one machine
$0.0729
this used to need a supercomputer and a waiting list
now it's seven cents in the cloud https://t.co/38VXiFOS0I