Andrew Garrett

Site Reliability Engineering Manager. opinions my own

[Andrew Garrett @werdnum]

@dilanesper It's not just this - like housing, exclusive experiences have mostly fixed supply unless you actively expand it, but demand scales ~with population. Compare to labour intensive goods (supply also scales with pop) or manufactured (pop x productivity)

[Andrew Garrett @werdnum]

@max_spero_ There are actually some detectable watermarks in the model weights themselves which filters down to the choice of adjectives https://t.co/0CCjpOGYdE

[Andrew Garrett @werdnum]

@simonw I don't know anything internal about Spark, but I use the "antigravity SDK" internally, it's being used for ~everything and I believe it's more or less the same thing as the Go binary packaged with agy.

[Andrew Garrett @werdnum]

@bawfuls @US_Stormwatch It did when I took it in 2018, but I guess Singapore can't fly over Russia anymore.

[Andrew Garrett @werdnum]

@EricCrampton It's a shit-show, but for the first time this year I started using AI for it (carefully). Claude + Codex + https://t.co/zEQs24avgP absolutely nailed it, including finding me a refund I was about to lose because of the statute of limitations and a typo from 3 years ago.

[Andrew Garrett @werdnum]

@hecubian_devil It's not terrific, it's got plenty of issues, but the difference between code and prose is that you can get value from code even if nobody ever reads it. AI code definitely has "tells" though - it would rather have mysterious bugs than show an error for example.

[Andrew Garrett @werdnum]

@dannolan Me to Claude 10 times a day: "Grab the latest round of Codex comments and address"

[Andrew Garrett @werdnum]

@Lola_lmao7 My first day of work in NYC in 2015. "Well, I don't know what milk is normal for you". I just assumed the (whole foods) barista was being intentionally obtuse. In CA the other week I feel like i would generally be asked "regular milk okay?" if I didn't specify.

[Andrew Garrett @werdnum]

@anirudhology @SumitM_X It is impossible to return a faster definite positive with a bloom filter because a bloom filter answers "no" or "maybe". bloom filters are entirely unnecessary because this kind of check is trivial with a distributed hash table. The latency is dominated by the network RTT.

[Andrew Garrett @werdnum]

@melvynx python-c 'subprocess.exec("rm -rf /")'

LLMs are VERY creative getting around blocked commands.

[Andrew Garrett @werdnum]

@midware_midwife Probably the difference between models is better instruction following in 3.1?

[Andrew Garrett @werdnum]

@midware_midwife It's from here https://t.co/h0znRxM29l

Usually this kind of thing is added to address some model behaviour issue. You can set your own system prompt with GEMINI_SYSTEM_MD= and try out what happens if you remove that snippet.

[Andrew Garrett @werdnum]

@roanoke_gal Usually this kind of thing is an attempt to correct for problems seen in testing. Presumably when they tested the base model they found it annoying for those reasons

[Andrew Garrett @werdnum]

@melvynx python -c "import os; os.system('sudo rm -rf /')" :)

[Andrew Garrett @werdnum]

@Jinxsaint @disco___cat How many people are injured and scared and killed by cars? Many more, we're just numb to it.

[Andrew Garrett @werdnum]

@banteg Can't believe the obvious answer isn't here: because cost to serve is proportional to peak demand, not average demand.

If everybody uses the models during the US peak, you have to have enough GPUs/TPUs to serve that much load otherwise you serve errors. That's how many you need.

[Andrew Garrett @werdnum]

@infinitehumanai @bcherny Sandbox and YOLO mode.

[Andrew Garrett @werdnum]

@ArmandDoma It's worse than Baumol. For services like healthcare, the available labour scales with population (price goes up with productivity), but for scarce goods like celebrity access, land, etc, supply doesn't scale at all (price goes up with productivity x population growth)

[Andrew Garrett @werdnum]

@heresyfinancial Manufactured goods are cheaper because of productivity and technology advances. Healthcare and education are labour intensive services that become more expensive due to Baumol's cost disease when productivity goes up. Housing is scarce and goes up with population wo upzoning

[Andrew Garrett @werdnum]

@john_macgowan @Ben_Thompson247 Only permanent residents are eligible. https://t.co/K6tx5GBBy4

Similar for commonwealth supported places. https://t.co/Do7gieZPWv