Wolfgang Schwach

topics: [[@SAP]]|[[#Java]]|[[CS in general]]|[[photography]]|[[everything else]]|[[personal opinions only]]

[Wolfgang Schwach @toraxx]

@Prince_Canuma @GolGappay102 @GoogleDeepMind @charmainemahach Looking forward for it.
While it’s nice to tinker around, tune many knobs, test infinite options, etc. it would be nice to have a “recommended starting point as of <month>.<year> for <task> with <standard configuration>”.
I know that this is a moving target.

[Wolfgang Schwach @toraxx]

@ivanfioravanti As it was with Gaming on Linux until rhe SteamDeck arrived: the capability is there, but it lacks bundling. A small, complete setup guide or installer for the 80% use case, that just works is still missing. Currently it is still research, trial & error with a moving target.

[Wolfgang Schwach @toraxx]

@ivanfioravanti That’s a good idea, but DS4 is focused at a very limited audience. Shelling out the equivalent of a very nice used car for a small-usercount-LLM rig is not acceptable for many.

[Wolfgang Schwach @toraxx]

@PolizeiPF vielen Dank an sie und ihre Kollegen für ihren Dienst rund um die Entschärfung des Blindgängers!

[Wolfgang Schwach @toraxx]

@ivanfioravanti Though this is a bit disappointing the different performance/speed ratios are very valuable for the non-highend users. These are the numbers to weigh our decisions which compromise to make, when running our "pay once" LLM workloads. Thanks!

[Wolfgang Schwach @toraxx]

@Ex0byt @Whos_Ur_Doggy Are you planning to release your patches?

[Wolfgang Schwach @toraxx]

@ivanfioravanti Is just me, or is there really some kind of mlx-tsunami happening?

[Wolfgang Schwach @toraxx]

@ivanfioravanti Oh my poor old M4 Pro. I can see you struggling.

[Wolfgang Schwach @toraxx]

@ivanfioravanti @bnjmn_marie I've been subscribed to his blog for some time now. I guess I understand only half of his academic-ish articles, but I take that as a "know your gaps" kind of encouragement.

[Wolfgang Schwach @toraxx]

@ActuallyIsaak Thanks for the explanation!

[Wolfgang Schwach @toraxx]

@gepardtatze Currently everyone is losing - the only questions are "what?" and "how much?".

[Wolfgang Schwach @toraxx]

@ivanfioravanti @lafaiel That’s on of the benefits of the limited configuration dimensions in the Apple ecosystem. E.g. my personal MBP M4 Pro is free during work/sleep hours and I’d be happy to give something back to the community - even if this is not much.

[Wolfgang Schwach @toraxx]

@TheTuringPost @karpathy Whoever was writing this ignores the existence of #Mastodon

[Wolfgang Schwach @toraxx]

@bnjmn_marie @N8Programs Do you have some hints how to become an "educated ML user" that understands these fundamentals? For every technology (e.g. databases, programming languages, frameworks, etc.) you need to to have that to use it reliably. For ML I am stuck with the outdated bits from university.

[Wolfgang Schwach @toraxx]

@jeethu If there is persistence as well it's more like twothirds-stack

[Wolfgang Schwach @toraxx]

@Schlagzeile2026 @gepardtatze Eher Kubernetes als ein einfaches Linux.

[Wolfgang Schwach @toraxx]

@ivanfioravanti I wish I had your energy and time on my hands 😎

[Wolfgang Schwach @toraxx]

@ivanfioravanti @Apple Are you aware of any collection of benchmarks for the different quants and formats? I know that @bnjmn_marie did something like that for the GGUF quants of Qwen3.5, but never saw anything for MLX