SideOfIcePlease

Currently wrangling ~100k servers a day.

Any opinions are my own and are not representative of any employers, companies, or larger groups.

[shrey birmiwal @shreybirmiwal]

Hot take the infra stuff around ai is way cooler than model training

[SideOfIcePlease @SideOfIcePlease]

@0xSero I'm disabling reasoning more often than I anticipated.

Running Qwen3.5-397B at 10t/s without reasoning gets me the answer much faster than running Qwen3.6-27B with reasoning at 35t/s.

[SideOfIcePlease @SideOfIcePlease]

@antirez @AMD I daily drive ROCm for inference. Ubuntu 24.04 is the only first-class customer right now. Fedora 44 works but there's always some minor catch.

[SideOfIcePlease @SideOfIcePlease]

@0xSero Good size for a REAP 👀

[SideOfIcePlease @SideOfIcePlease]

@lavacape1 @antirez One write and lots of reads isn't bad.

The sustained heat in such a small space might be a concern though.

[SideOfIcePlease @SideOfIcePlease]

@Mayhem4Markets Can confirm

[SideOfIcePlease @SideOfIcePlease]

My music taste in 2012 for no particular reason:

[Gregor Zunic @gregpr07]

Finally fully switched to Zed and not looking back.

[SideOfIcePlease @SideOfIcePlease]

@mikepat711 @3lectricBrawl +1 for Air Pump and Jumper battery. The frunk is the only part of the car you can easily access if the low voltage battery goes!

[SideOfIcePlease @SideOfIcePlease]

@danveloper @antirez Did you alter the number of experts used per token?

[SideOfIcePlease @SideOfIcePlease]

@RyanLeeMiniMax Give param count

[SideOfIcePlease @SideOfIcePlease]

My CRUD app was a Django1 music app. Thanks @thenewboston_og

[Abhishek B R @abhitwt]

this sh!t could have land me a $5k/month job in 2016😭💔

[SideOfIcePlease @SideOfIcePlease]

@bleysg @MiniMax_AI @datacurve @theo Depending on parameter count - that's totally fine.

[SideOfIcePlease @SideOfIcePlease]

@brah_ddah @niccruzpatane I'd hope so. The Atom/Ryzen CPU in the media center do nothing towards the actual driving.

[SideOfIcePlease @SideOfIcePlease]

@RyanLeeMiniMax How many parameters?

[RyanLee @RyanLeeMiniMax]

@Mayhem4Markets @thegenioo Yes, M3 will be open-weight. coming sooon

[SideOfIcePlease @SideOfIcePlease]

@shashankgoyal95 @OpenRouter Encourage more support for hosted quantized models (not just labeling fp4/q4 or 'turbo' versions). I would love to see "does Q5 of model xyz work still work and provide speed/cost-savings?" without renting a bunch of h100's. That service doesn't exist today.

[SideOfIcePlease @SideOfIcePlease]

@0xSero King, ty.

[SideOfIcePlease @SideOfIcePlease]

@GameNativeApp Yepp - but I'll try it again and report back. Both OOS and GameNative have had updates since my last go.

[SideOfIcePlease @SideOfIcePlease]

@GameNativeApp @Synaelle OOS will fight its users to the bitter end if they try and do anything high-performance (or with several forked processes) that's not installed from the Play Store.

Source: OnePlus 12 user that's lost this battle