Arlo Gilbert

Unapologetic Founder & Builder. ❌

You've used my software today.

Posting about AI, agents like Hermes, startups, politics, governance, risk, and compliance.

[Jason Dainter @jasondainter]

99% AI. Hope you enjoy!

Lyrics: Me + Claude Opus 5.5
Image Stills: Midjourney v8
Video: Minimax H3
Editing: Me + Davinci + Claude Opus 5.5
Music: Suno v6 wild

[Arlo Gilbert @arlogilbert]

@ScooterCasterNY @yyeeaahhhboiii2 @FreedomNTV We're watching college students learn about geopolitics.

Listening to that was painful "If you can't sell Puerto Rico you can't sell Palestine" as though they are the same thing.

Such idiots. It's a shame they have mouths.

[Arlo Gilbert @arlogilbert]

@Scobleizer Looks like it's happening... https://t.co/P5nuwT8wjS

[Arlo Gilbert @arlogilbert]

I'm not using your engine (but I will soon I promise)... My findings might be applicable if you haven't implemented switch optimizations for the fabric.

<codex>
Our four DGX Sparks had working 200 Gb/s links, but RoCE traffic was experiencing packet loss and retransmissions.

The MikroTik CRS812 was running RouterOS 7.20.8, which lacked the required CRS8xx PFC/ECN support.

We upgraded RouterOS and switch-marvell to 7.23.5, configured priority-3 PFC with 200 Gb/s queues, and aligned host/switch traffic priorities and ECN.

Repeating the same DeepSeek tests reduced adaptive RDMA retransmissions from 1,425 to zero, with zero switch queue drops observed. Prefill improved; generation remained essentially unchanged.

These are five-repeat medians using the same model, settings and requests, with one user, thinking off and no prompt-cache hits.
</codex>

[Arlo Gilbert @arlogilbert]

I'm on a microtik crs812 (804s are all sold out).

One thing you MIGHT find improvements on is looking at the retransmission rates across the fabric, I too am getting way-faster than NIC speeds on my fabric but Codex identified a significant retry rate that is related to the switching...

Working on it now. If it's helpful I'll share my mitigations once i have them working. No idea if it's 1% or 15% speedup at this point.

[Arlo Gilbert @arlogilbert]

I wrote a blog about self-hosted inference and why it's so important.

Plus, TL/DR it is FASSSSSTTTT!!!

[Osano AI @osanoai]

We've been busy building on Hermes from @NousResearch and local models from @deepseek_ai

TL/DR, our stack is WAY faster than OpenAI models and it doesn't refuse to do the job like Anthropic frequently does.

Also, @OpenAI Ultrafast is not nearly as fast as advertised.

Link to the article in the comments...

[Arlo Gilbert @arlogilbert]

@JimEagleUC @OurOwnNation I wouldn't have standing as a Minnesotan b/c it requires in-state/in-person.

But I love your idea! Any smart American living in in Colorado should apply.

[Arlo Gilbert @arlogilbert]

Israel has been bragging about a 30 year blockade the entire time? Cool, post the quote or shush your shusher.

The hard closure people actually argue about kicked in AFTER Hamas seized Gaza in 2007. Egypt shut Rafah too. What Israel says in public is it is stopping weapons and rockets, not confessing your genocide script.

Making 6 claims doesn't make them true. Here, I'll prove it.

You're smart
You're handsome
You're kind
You've served in the military
You make a great living
You're married.

See 6 things. All lies.

[Arlo Gilbert @arlogilbert]

@JohnJon535 @Tbonepickens69 @Guidodibra @ShawnEni Except that isn't true.

[Arlo Gilbert @arlogilbert]

@EXM7777 you're going to get a lot of heat for those icons looking like grok i think.

[Arlo Gilbert @arlogilbert]

@Hatand1962Nina @yaelbt Being anti zionist is a pretty new thing on the left (last year or two) but the use of Zio is something I've only started seeing on the left in the past few months.

But I'm one guy so I don't see everything, you may be right :)

[Arlo Gilbert @arlogilbert]

@jeff_weinstein @stripe Email heading your way.

[Prof. Math & CS @Zeev81309559]

The entire Palestinian propaganda is built on 3 things: ridiculous lies, AI or staged videos, and stupidity of a large part of the audience.

[Arlo Gilbert @arlogilbert]

@Tbonepickens69 @Guidodibra @JohnJon535 @ShawnEni Nope. I'm just not your personal assistant.

You made the claim. Back it up dumbfuck or get out and go cry harder.

[Arlo Gilbert @arlogilbert]

@aaronthomas106 @yaelbt It's interesting, sometimes it's circular but sometimes it's described as a U shape (horseshoe theory).

It's been so long since I took polisci that I don't know what today's accepted view is.

[Arlo Gilbert @arlogilbert]

@MiaAI_lab Testing it today!

[Arlo Gilbert @arlogilbert]

@CostelloDiamond Ireland was on my short list of places to visit.

Now it's on my short list of places to avoid.

[Arlo Gilbert @arlogilbert]

@StopAntisemites @Barrys @StopAntisemites looks like Barry's doesn't want to be associated with his antisemitism. He is no longer listed as a trainer.

[Arlo Gilbert @arlogilbert]

This guy? https://t.co/qZqwhvgvUA

Does @Barrys support antisemitism?

Do Barry's Jewish clients know that they aren't safe when Joe is working?

Do his family members Ruth Nicastro Age 65+ in West Warwick, RI and Justin Jesse Age 40s in Hope Valley, RI
Kerri Gill Age 40s in Hope Valley, RI know that he's a Jew hating bigot?

Joe sure thinks highly of himself.