BIM Computing

Hardware for AI freedom. Building the local AGI for everyone. Your models. Your hardware.

[BIM Computing @BIM_Computing]

Local abliterated AI is the solution: run inference on hardware you own, not a remote provider.

https://t.co/lcqvhmm3K2

[HDUX @HaStrive]

Self-hosted Claude Managed Agents is in private beta, and the constraint I care about is this: you can host the control plane, but every model call still sends the conversation so far to the provider you pick.

Anthropic's docs are explicit. Agents, credentials, and session history stay on your server and database. Model requests go where you choose: Anthropic, Bedrock, Google's Agent Platform, Microsoft Foundry, or your own gateway. Each call carries prompts, tool inputs, and tool results.

What I'm checking before I even request access:
1. pick the inference provider on purpose, don't leave it on the default Claude API just because that's the default
2. stand up PostgreSQL 16+ on day one — with no database, a restart wipes agents and history
3. treat zero data retention as applying only to those model calls, the same way it does for the Messages API; the transcripts themselves live in your database

If the conversation still leaves the building, what else has to stay inside the perimeter for this to be worth running?

[BIM Computing @BIM_Computing]

@HaStrive If model calls still leave, the inference itself must run on your own GPUs. A 4× Tesla V100 32GB Liquid-Cooled Tower costs €7,900 and keeps weights local.

https://t.co/lcqvhmm3K2

[BIM Computing @BIM_Computing]

Local abliterated AI is the solution: weights stay on your hardware, not on a remote server.

https://t.co/lcqvhmm3K2

[AI News Smoothie @ainewssmoothie]

Pope Leo XIV wants clear boundaries between human art and AI, while @pewdiepie just launched an uncensored model called Ajax after getting banned from major platforms.

https://t.co/ZThOQwRinh
@AnthropicAI #PewDiePie #AjaxModel #AIEthics

[BIM Computing @BIM_Computing]

@ainewssmoothie @pewdiepie @AnthropicAI When an open model runs on your own hardware, you set the rules. On someone else's server, bans and refusals can arrive.

https://t.co/lcqvhmm3K2

[BIM Computing @BIM_Computing]

@swarogan Running massive models on CPU and RAM alone is impressive. GLM-5.3-Flash at 4-bit is 193 GB. Our 8x V100 32GB node holds all of it in GPU memory: 256 GB of VRAM in one 4U server. https://t.co/7Su0z8Lb4L

[BIM Computing @BIM_Computing]

@ZyphraAI @ArtificialAnlys @AMD GLM-5.3-Flash at 4-bit is 193 GB. Our 8x V100 32GB node holds all of it in GPU memory: 256 GB of VRAM in one 4U server. https://t.co/7Su0z8Lb4L

[BIM Computing @BIM_Computing]

@martiano That token speed is reasonable for local inference. We offer a retrofitted RTX 2080 Ti, 22 GB at 616 GB/s, for local models. https://t.co/QjQR9IH4dm

[BIM Computing @BIM_Computing]

@0xBakeer @nunomo1 For a small local box we offer the retrofitted 22 GB 2080 Ti, 616 GB/s, €480 plus €80 DDP shipping. https://t.co/QjQR9IH4dm

[BIM Computing @BIM_Computing]

@beingsalluu GLM-5.3-Flash at 4-bit is 193 GB. Our 8x V100 32GB node holds all of it in GPU memory: 256 GB of VRAM in one 4U server. https://t.co/7Su0z8Lb4L

[BIM Computing @BIM_Computing]

@tolewis We offer a 128 GB GPU-memory tower: four Tesla V100 32 GB cards, 128 GB DDR4 ECC included. https://t.co/bg17XtXi6y

[BIM Computing @BIM_Computing]

@Gael_DDOS Paging experts out to system memory makes bandwidth the bottleneck. For 128 GB of GPU memory we offer a liquid-cooled tower with four Tesla V100 32 GB cards. https://t.co/bg17XtXi6y

[BIM Computing @BIM_Computing]

@ZOTAC Unified memory is great for running large local models. For 128 GB of GPU memory we offer a liquid-cooled tower with four Tesla V100 32 GB cards. https://t.co/bg17XtXi6y

[BIM Computing @BIM_Computing]

DeepSeek V4.1 Flash on 8x Tesla V100 32GB: prefill 949 tok/s, decode up to 71 tok/s, 512K context. Fully local, abliterated, speculative decoding on every card. https://t.co/hI5iqSVaKr

[BIM Computing @BIM_Computing]

@Dennis_Rye For 128 GB of GPU memory we offer a 4x Tesla V100 32 GB liquid-cooled tower. https://t.co/bg17XtXi6y

[BIM Computing @BIM_Computing]

@jakeinmotion Unified memory on laptops is a game changer for local models. Our 128 GB option is four Tesla V100 32 GB cards in a liquid-cooled tower, with 128 GB ECC RAM. https://t.co/bg17XtXi6y

[BIM Computing @BIM_Computing]

@rlaope That throughput is impressive for the cost. GLM-5.3-Flash at 4-bit is 193 GB. Our 8x V100 32GB node holds all of it in GPU memory: 256 GB of VRAM in one 4U server. https://t.co/7Su0z8Lb4L

[BIM Computing @BIM_Computing]

@k2sbhai That RAM requirement is very accessible for local inference. GLM-5.3-Flash at 4-bit is 193 GB. Our 8x V100 32GB node holds all of it in GPU memory: 256 GB of VRAM in one 4U server. https://t.co/7Su0z8Lb4L

[BIM Computing @BIM_Computing]

128k-token context on a 10 GB RTX 3080. It reads a 129,000-token document in 69s and writes at 166 tok/s - private, no refusals, no per-token bill, on a card you buy once. https://t.co/BRPNFohPj0

[BIM Computing @BIM_Computing]

@Damian_Py_Off Love this approach: own weights, own machine, fully under your control.

[BIM Computing @BIM_Computing]

Run local abliterated AI on a card that answers to you. No remote policy switch.

https://t.co/lcqvhmm3K2

[RenshuBTC @RenshuBTC]

Changed my AI stack from Claude Opus 5.5 max + another frontier fast/cheap model to Claude Opus 5.5 max + best local abliterated open source model

Really tired of the guardrails after guardrails, especially with REA i just want to control software on hardware i own lol