@harsehaj@_buildspace great idea, @karpathy just did something similar using letterboxd(?) embeddings to recommend movies, using this for music could be even better
@roshannarayan7@_buildspace awesome idea, I think that also having the assistant proactively suggest certain tasks to be automated could be a useful interaction
the tier list of AI companies is going to be determined by who owns the newest hardware, then who buys the last generation of HW from them, then who buys their HW, etc
🧵We’re excited to announce MegaBlocks, our system for efficient “dropless” MoE training! 🤖
MegaBlocks outperforms Tutel by up to 40% by reformulating MoEs as block-sparse operations, which allows us to avoid token dropping without sacrificing hardware efficiency 🚀.