@FabiMarshbebe@aschilling@top500supercomp It was pretty obvious last year when it was 50% powered up at 600PF that it wasn't going to hit its >2Exa target. Very late and underdelivered. I imagine this is one of the reasons they are skipping a gen and focusing on Falcon Shores.
@IanCutress I would say it highly depends. The 7B models we have now are mostly condensed from a 70 or 80B model, and are far more accurate than a model that was originally designed at the 7B level.
@smems_@thorstenball Yes... This is how you make reusable modular shell/bash scripts. You define all your modules up top, then have the logic running them at the bottom.
@danielnewmanUV Inference yes, training no. This is specifically about low precision acceleration, vnni/amx. Patrick did a piece on Numenta you might like. https://t.co/jwJS9WpfNt…
@anthonyspiteri I went the Opnsense T740 route, far cheaper, far more performance. With the expansion slot in the T740 you can choose between quad 2.5 or 10gbe.
@akatzzzzz@__tinygrad__ IDK man, they didn't qualify the hardware before announcing it and are using consumer gear and expecting enterprise support. >2 consumer cards is not supported in ROCm right now, more than that, >1 is in beta right now. If you want multi-gpu support, go mi210s.
@tekwendell Frankly it is kind of embarrassing to announce a solution before qualifying it. Multi-gpu support on consumer cards is just in preliminary ROCm support. If you want to span cards, use instincts.
@BadBooy2k I feel ya @BadBooy2k I've gotten Tbanned while prepping to compete before (not opens) due to a client/server render bug. It was reviewed and lifted quickly because there were community managers back then. Really just feels like they are milking us at this point.
@__tinygrad__ I also think you have work to do in internal qualification processes. Now the goal may have been to pressure AMD by postponing canceling products knowing full well you needed AMD to fix certain things before they were viable but it's a bad look.
@__tinygrad__ I think you have done a very useful thing for the community... but... you announced a product without it functional. That is concerning. You are also expecting enterprise support for consumer gear. I hope the results are good for the community, AMD needs to nail this.
@IanCutress Oh, I missed a video, (goes to watch). In general I enjoy your interviews. Some of your videos feel a little flowery, but you have shifted to consultant/Influencer and are very open when something is sponsored. Don't let the haters get to ya.