BentleyPC

i was a data guy, but now i am a GPU baller!

[BentleyPC @bentleypc]

Started measuring my local LLM usage 1/2

[BentleyPC @bentleypc]

@BrianEastwoodx Is that his cell phone falling out of his pocket🤦

[BentleyPC @bentleypc]

@BasilTheGreat @Gvozdenac71 YouTube needs to be stopped. Quit using it.

[BentleyPC @bentleypc]

@FanlessTech Will it run crysis?

[BentleyPC @bentleypc]

@kaiostephens GTK!

[BentleyPC @bentleypc]

@neural_avb The Q8 is 👨‍🍳💋

[BentleyPC @bentleypc]

@svpino You get at least 50 of these people at every major sporting event in America. It doesn't scare anyone.

[BentleyPC @bentleypc]

@wangzhr4 Bro, if you haven't ndiswrapper you haven't linux'd on a windows laptop.

[BentleyPC @bentleypc]

With 4x you could run 8 x qwen36 32b at Q8. Models in that range consume about 40-50gb of vram and aren't bad at all combined with opencode.

So I'd imagine you having several of these smaller models running constantly to handle most demand on the 4x and the extra 4x you can send to me 🤗 or use them for testing new models before you replace the older "always on" models.

[BentleyPC @bentleypc]

@leftistwhatever @omgsidewalks What is it that you don't like? 😢 you so mean, where's my mom, I'm telling...

[BentleyPC @bentleypc]

@GhostOfWarmth @thenate36 @JennDinKC Then it reappears in an instant as you continue to pull straws.

[BentleyPC @bentleypc]

@HarakiriInu @storagereview @230V @ZbyHP @HP Standing corrected 🤗

[BentleyPC @bentleypc]

@HarakiriInu @storagereview @230V @ZbyHP @HP Cool story bro, I own one.

[BentleyPC @bentleypc]

@storagereview @230V @ZbyHP @HP Thanks I totally skipped the max q part

[BentleyPC @bentleypc]

@vultuk @AcrossTimePod @sporadica But.. it requires the PR to get to dev in my pipeline 🤦

[BentleyPC @bentleypc]

@HarakiriInu @storagereview @230V @ZbyHP @HP Only if you limit it is it a 300w card

[BentleyPC @bentleypc]

@kuberdenis You say that and then I do 1 billion tokens in 7 days for $2

[BentleyPC @bentleypc]

@0x45o I got these nand gates that say otherwise

[BentleyPC @bentleypc]

@MrJohnJnr Just more proof you don't need a degree to do a job

[BentleyPC @bentleypc]

@RealXavier011 Imagine wasting your hard earned cash on this instead of a real SCUBA?