Ishit Vachhrajani

CTO | now @awscloud | transformation, leadership, change, tech, cricket, food, travel, media, not in that order (cricket is #1) | my own opinions

[Brian Armstrong @brian_armstrong]

How to keep AI spend flat while token usage grows exponentially: Not with friction and spend alerts. With better defaults, routing, and caching.

Better Defaults (not Usage Caps) – Engineers can choose any model they want, but defaults matter. We’re experimenting with defaulting to open weight models like GLM 5.2 and Kimi 2.7 through our LLM gateway, while still encouraging engineers to choose the right model for the task. 91% of our employees were never hitting their usage caps, so instead of lowering caps and driving up alerts, we're moving to cheaper defaults. Note that code reviews use a diversity of models, so they can check each other's work.

Better Routing – In our custom harnesses, we preprocess prompts and route to the best model for the job, considering cache hits and model pricing. For instance, you may want a frontier model for planning, but not for execution where they can be overkill. Ultimately, humans shouldn't be choosing models - AI can automate this task.

Better Caching – Cache misses are the easiest way to drive your cost up. All of our requests are cache aware, so we’re reusing a warm cache wherever possible. For example, our cache hit rate went from 5% → 60% in LibreChat once properly implemented.

Keep Context Lean – Start fresh sessions when switching tasks. Scope file context narrowly. Disconnect unused tools. Don't just compact. The goal isn't fewer tokens used, it's fewer tokens wasted.

Better Visibility – Our engineers can use as many tokens as they want, from whatever model they want, but we’ve made usage visible – and the more you spend on AI, the more impact we expect.

The goal isn't to suppress usage. It's to build the infrastructure that makes exponential growth sustainable.

Putting this into practice has cut our AI spend nearly in half, while our token usage continues to grow.

[Kunal Shah @kunalb11]

What we call talent is often just the combination of:

A deep need to win and high agency
The ability to learn fast from mistakes
A beginner’s mind that never disappears

The common thread: an unusually high rate of learning.

[Ishit Vachhrajani @IshitV]

🍎🏀

[B.W. Carlin @BaileyCarlin]

Good lord this edit. Insane.

[Ishit Vachhrajani @IshitV]

😂

[Daniel Vassallo @dvassallo]

A good general rule is when your instinct says something is dumb, and that something was planned for years by people with way more information than you, the dumb one might be you.

[Ishit Vachhrajani @IshitV]

❤️ 🍎

[Mayor Zohran Kwame Mamdani @NYCMayor]

Welcome to the greatest city on Earth.

Here are some tips and tricks for how to get around and make the most of your time here.

Learn more at https://t.co/mki8gOyIED.

[Ishit Vachhrajani @IshitV]

The companies letting their teams burn tokens and experiment right now aren’t being reckless.

They’re building instincts their competitors won’t be able to buy later.

May your tokens be with you!

[Ishit Vachhrajani @IshitV]

Most CFOs want to minimize AI token spend. That’s the wrong instinct.

Tokens aren’t a cost. They’re how your team learns to think differently.

[Ishit Vachhrajani @IshitV]

There’s a chasm between people who’ve seen AI demos and people who’ve felt what’s possible firsthand.

It’s the difference between reading about the internet in 1995 and getting your first dial-up connection.

You can’t unfeel that moment.

[Ishit Vachhrajani @IshitV]

Let’s go! 🌕🇺🇸

[NASA @NASA]

Liftoff.

The Artemis II mission launched from @NASAKennedy at 6:35pm ET (2235 UTC), propelling four astronauts on a journey around the Moon.

Artemis II will pave the way for future Moon landings, as well as the next giant leap — astronauts on Mars.

[Ishit Vachhrajani @IshitV]

Remains one of the greatest heists in Test cricket history.

[VVS Laxman @VVSLaxman281]

25 years ago at Eden Gardens Rahul and I shared a partnership that will forever remain special. In a moment when the game looked beyond us we chose belief, patience and resilience. That stand was not just about runs but was about trust, teamwork and fighting for every session. Grateful to have shared that journey with Rahul and to be part of a Test that reminded us all that in cricket comebacks are always possible👍 @BCCI #PowerOfPartnership #Believe #Resilience

[Ishit Vachhrajani @IshitV]

🏏🏆

[BCCI @BCCI]

𝐂.𝐇.𝐀.𝐌.𝐏.𝐈.𝐎.𝐍.𝐒 🇮🇳

#TeamIndia clinch a record 3️⃣rd ICC Men's #T20WorldCup title 🏆

Take. A. Bow 🫡

#MenInBlue | #Final | #INDvNZ

[Ishit Vachhrajani @IshitV]

🫳🎤

[AWS Newsroom @AWSNewsroom]

🗞️ @sdxcentral shares AI inferencing trends in 2026 featuring @IshitV and the AWS vision to build Amazon Bedrock as the world's biggest inference engine. Read: https://t.co/8U4VY2xhv4

[Ishit Vachhrajani @IshitV]

Its too cold to walk to train from the parking lot 😜

[Ishit Vachhrajani @IshitV]

#52 👑

[BCCI @BCCI]

A leap of joy ❤️💯

A thoroughly entertaining innings from Virat Kohli 🍿

Updates ▶️ https://t.co/MdXtGgRkPo

#TeamIndia | #INDvSA | @IDFCFIRSTBank | @imVkohli

[Ishit Vachhrajani @IshitV]

What a team! #Champions

[ICC @ICC]

The moment all of India has been waiting for as ICC Chairman @JayShah hands India captain Harmanpreet Kaur the trophy 🏆

#CWC25

[ICC @ICC]

𝐂𝐇𝐀𝐌𝐏𝐈𝐎𝐍𝐒 𝐎𝐅 𝐓𝐇𝐄 𝐖𝐎𝐑𝐋𝐃 🇮🇳🏆

India clinch their maiden Women’s @cricketworldcup title at #CWC25 🤩

[Ishit Vachhrajani @IshitV]

@collinsadam Hi Adam - Can I please get the hi-res version of this photo for a fan print? I appreciate it if you can DM me, happy to also purchase it if you have it somewhere. Thank you!

[Ishit Vachhrajani @IshitV]

@collinsadam Thank you. Done.