Michael Griffin

Rule #6: Be nice to everyone you meet and see tonight.

[Patrick Wendell @pwendell]

Today @databricks we're publishing a detailed analysis of techniques we used to drastically reduce our internal AI spend while aggressively growing adoption. Savings come from layering in several techniques, which combine to drive unit costs down as much as 90% in some scenarios. Tl;dr, the wins come from:

1. Shifting defaults to more efficient models, including OSS models such as GLM. Maximum intelligence models simply aren't needed for many coding tasks, and "good enough" models are quickly becoming very cheap. We shift traffic between models using Unity AI Gateway. Approximate savings: 50% or more.

2. Using smart routing to automate model selection. Routing can further squeeze efficiency by dynamically selecting the model or harness that can most efficiently execute a particular task. Our task-level routing leverages @omnigent_ai. Approximate savings: 30%.

3. Providing user visibility and adaptive budgeting. Every user can see how much they spend, and users receive hints on how to contain spend. Heavy spenders encounter progressive friction as they ratchet spend above certain levels. Approximate savings: 10%.

4. Managing context bloat by pruning tool call results and tuning harness settings. Extraneous context costs $$ and delivers no value. Tuning cache settings also help lower average token costs. Approximate savings: 10%.

[Michael Griffin @Griffinitive]

@alexanderxgreat Don’t yuck people’s yums. You’re a picky eater and nobody calls you out on Twitter…

[Michael Griffin @Griffinitive]

@theryanking Disagree

[Michael Griffin @Griffinitive]

@Rotter89 Weird flex

[Michael Griffin @Griffinitive]

@alexanderxgreat Go work for @theryanking

[Michael Griffin @Griffinitive]

@CryptoKevy @molly0xFFF You mean my slot in the blockchain hills? Waiting for my eth2…

[Michael Griffin @Griffinitive]

@robosalt I’ve had good rides on the pele. I’ve also heard people lose weight with herba life. If I could rent the bike until I turn off my subscription and then they take the bike back I’d be down

[Michael Griffin @Griffinitive]

Writing a joke about how Peleton is legal pyramid scheme:

- Pay up front for the promise of major life changes
- The "high-quality goods" are actually cheaply made in Taiwan
- Hearing people convince you it's legit is nails on a chalkboard

[Michael Griffin @Griffinitive]

@dickiebush @Nicolascole77 @dickiebush does this offer still stand?

[Michael Griffin @Griffinitive]

@dickiebush @Nicolascole77 🚢 🚢!

[Michael Griffin @Griffinitive]

@robosalt https://t.co/IKfvJX1X6j

I'll give you $100 and an uber eats gift card with $6 left on it

[Michael Griffin @Griffinitive]

@heyeaslo 👋🏻

[Michael Griffin @Griffinitive]

@AmandaMGoetz Ginger beer

[Michael Griffin @Griffinitive]

@BigBizBrodie You sure you weren’t watching new Spider-Man movie?

[Michael Griffin @Griffinitive]

Pretty sure I lost fantasy football cause of log4j

[Michael Griffin @Griffinitive]

@ThirdStringer @BallySportWI Like Bally total fitness Bally?

[Michael Griffin @Griffinitive]

@Rilee_Cyrus @robosalt Looks like you *found* time to tweet about it too…you’re welcome

[Michael Griffin @Griffinitive]

Imagine what we could do with all the collective time saved by not asking "can you see my screen" and waiting for the affirmative

[Michael Griffin @Griffinitive]

@ThirdStringer Set and setting.