@sudoingX@AMD You can checkout that PR: 21344 and follow the steps to build and flags to set. I don't have strix halo but after your bench run I was reading about the prefill speed difference between AMD and NVIDIA. Then I found out about this PR that was closed but had gfx1151 optimization.
@ranaharshraj7@huggingface I love @huggingface but ml-intern can be replaced with an hugging-face agent-skills suite.
I tried it and it feels unnecessary.
people keep asking me, if you were starting over today with nothing, how would you do it.
here is the honest answer, the one nobody wants because it isn't sexy.
i would buy the cheapest used card that runs a real model. a 3060 12gb, 200 bucks, and i would not spend another cent until i had squeezed everything out of it. not because i couldn't dream bigger, but because the card was never the thing standing between me and the work. it never is.
everyone thinks they are one purchase away from being ready. one more gpu, one more course, one more follower count, one more month of learning quietly until they feel good enough to be seen. and they stay there for years. waiting to be ready is the most expensive thing you will ever buy, it just never shows up on a receipt.
i started scrappy and i stayed scrappy on purpose. i posted the small wins, the cheap setups, the ugly first benchmarks, the stuff that felt too small to matter.
and the small stuff is exactly what people needed, because most of them are sitting where i was sitting, staring at a spec sheet they can't afford, convinced they can't begin.
you can begin. today. with whatever you have.