@DanielleFong Next startup: gigawatt islands of floating solar out in the ocean where gravity battery economics are awesome. Good to try off of Hawaii or Japan where the drop off is fast
@leyten@Zai_org Cool! But optimizing for single stream is costing you like 2x Opus. The tricks you use to get better single stream tok/s are blocking what you need for efficient economics through batching and PagedAttention.
We've talked to hundreds of hardware engineers. None of them think CAD generation is a bottleneck. The CAD was done 11 years ago bro, we're still working out ISO 314159 compliance.