@lukasletsgo unfort the limit is network connectivity
that's why i bearish on rtx sparks: they're bottlenecked by connection
there must be a better way to do distribute compute
@RealCamBrown@elliotarledge unified is a soc thing
they say coherent because it's a hybrid memory system where some is hbm and some are standard memory
it crushes any equivalent priced setup for moe models
@0xSero open source doesn't even need to be for all
trained my own small model for sales reps on 4 sparks
gonna keep it closed sources but serving prod on my local machines rn