Colin Weld

Cloud capacity lead @Modal. Thinking about GPUs a lot.

[Colin Weld @colin_weld]

@ekzhang1 appreciate the appreciation :)

[Colin Weld @colin_weld]

@dexhorthy Definitely! Nomad is so elegant; the concurrency model in this design takes quite a bit of inspiration from it.

[Colin Weld @colin_weld]

@ahmetb appreciate it!

[Colin Weld @colin_weld]

@neilsong yup -- one thing i didn't explicitly mention but is actually pivotal to the design is that we switched sandbox scheduling to be synchronous w.r.t. sandbox creation (was previously async), which then allows us to remove state which could have been a scaling bottleneck otherwise

[Colin Weld @colin_weld]

@viciocassaro @modal We intentionally designed the system so the stream doesn't need to be persistent, so Kafka would be overkill

[Colin Weld @colin_weld]

@adidshaft @modal Yes, the idea is that all mutative operations go straight to the worker!