ScraperNerd

Average coder, below average runner, worse cyclist & not able to swim.

[ScraperNerd @ScraperNerd]

kitne ajeeb log hai, telling me on friday morning, we need to do prod cluster migration, friday night cooked 🥲

[ScraperNerd @ScraperNerd]

@MohitMa11446106 Tonight 🙌

[ScraperNerd @ScraperNerd]

wtf is this scoreline 🤯....
#ENGvSL

[ScraperNerd @ScraperNerd]

This pr is merged to upstream. But my approach was mostly changed to support path prefix now 😅. Will explain in upcoming threads.

[ScraperNerd @ScraperNerd]

Every time we added a model lane behind our gateway, the bottleneck wasn't only GPUs. It was certificates too.
Each lane had to be distinguished by hostname or port → new SAN entry, DNS record, cert rotation overhead. On managed cert infra, that's the tax on adding a model.

[ScraperNerd @ScraperNerd]

https://t.co/fdQWmESmTo
This is upstream pr for same, awaiting approval, let's go 😇.... #llmdRouter #epp #llmd #gateway #hostnames

[ScraperNerd @ScraperNerd]

Getting praised by CTO of my company is not on my 2026 bucket list… 🙈
But it kind of embarrassing/weird over mail with all tech leads 😅.

[ScraperNerd @ScraperNerd]

@MohitMa11446106 @dhaiwat Let’s go 🙌

[ScraperNerd @ScraperNerd]

This has been merged to upstream…
Let’s go 2nd os contribution… 🙌

[ScraperNerd @ScraperNerd]

In multi-cluster llm-d, suppose the EPP on cluster A steers requests to gateways on clusters B and C. Those gateways have DNS names. But the proxy only understood IP:port. So we had to hardcode load
balancer IPs — which break silently when an LB is recreated.

[ScraperNerd @ScraperNerd]

https://t.co/1jNkPSZuo9 this is upstream pr for same, awaiting it's approval 😇.
#llmd #inference #gateway #agentgateway

[ScraperNerd @ScraperNerd]

Open source contributions is more about convincing maintainers for the issue and approach, rather than implementation, felt this most of the time. 🫡
#opensource

[ScraperNerd @ScraperNerd]

@panipurrii Call Aunty at 5 AM and then go to sleep simple 🥱

[ScraperNerd @ScraperNerd]

Running in hometown is absolute beauty and that too without music 🤌…

[ScraperNerd @ScraperNerd]

@stfu_aayushiii crazzy enough 😂

[ScraperNerd @ScraperNerd]

@MohitMa11446106 yes, even more secure as it comes under the L7 TLS protect communication which can be served under VPN persistently. It will be somewhat slow(few milli seconds), but that gap we can ignore.