merce’s cunning ham(ming it up)

@KimsVideo vet, working on ml infra @spotify (he/him)
mastodon: @[email protected]

[merce’s cunning ham(ming it up) @mioalter]

Why does reverse-mode auto differentiation work OR what even is a derivative? A Christmas thread:

[merce’s cunning ham(ming it up) @mioalter]

Cool well I'm an idiot and left my phone on a table in a little park in my neighb after eating lunch outside because it is nice out. I realized half a block away that I didn't have it and went back, but it was gone. I wiped it remotely and now it is in the Bronx.

[merce’s cunning ham(ming it up) @mioalter]

One thing that recent advances have made clear is that we need to standardize how to talk about model sizes. I propose the following terminology for models with the given numbers of parameters
< 1B: LLM
< 1.5B: XLLM
< 3B: BigGulpLM
< 4B: DoubleGulpLM
>= 5B: LMs of Unusual Size

[merce’s cunning ham(ming it up) @mioalter]

Bill Orcutt guitar quartet at Roulette (sorry I missed it)

[merce’s cunning ham(ming it up) @mioalter]

@atomly Imagine going to see Mandy (2018) at a drive-in in that

[merce’s cunning ham(ming it up) @mioalter]

@travisbrown wow thanks!

[merce’s cunning ham(ming it up) @mioalter]

@atomly basquiat me a brewski, bro!

[merce’s cunning ham(ming it up) @mioalter]

@Quelklef @JadeMasterMath @analytichegel More explicitly about "newtyping it": you could make a dataclass that wraps the thing you want and define operations on that e.g. make your own integer type for which addition is max. I'm sure there's a way to get the methods onto the classes, but I don't know Python.

[merce’s cunning ham(ming it up) @mioalter]

Cool, back to harassing my mortgage lender on Twitter to get them to provide basic services that they claim to provide.

[merce’s cunning ham(ming it up) @mioalter]

@AskCitizensBank the Tax Documents section when I log in is empty, but I should have a 1098. I tried calling but there is no option to speak to a representative and your online help chat is currently unavailable. It is March 20th. Please let me know how I can get my tax doc asap.

[Alex Albert @alexalbert__]

this phenomenon is called token smuggling, we are splitting our adversarial prompt into tokens that GPT-4 doesn't piece together before starting its output

this allows us to get past its content filters every time if you split the adversarial prompt correctly

[merce’s cunning ham(ming it up) @mioalter]

- Oh, you engineer prompts for state-of-the-art chatbots that internet people try to dunk on Chomsky with? Cool!
- No, I just show up on time.

[johnny v5 @generativist]

guy at the (palo alto) library (in quiet room) has just been saying "oh fuck" and "oh no" and "jesus" every few minutes for the last hour

[merce’s cunning ham(ming it up) @mioalter]

I was going to make a joke about how I come here for the choice content, then my partner walked in and we had a minutes long conversation about the dog's poop

[merce’s cunning ham(ming it up) @mioalter]

The Banach in Baby Spinach really leapt out at me today

[merce’s cunning ham(ming it up) @mioalter]

@thebasepoint @NYCMayor 95% in 32 years is in improvement over phase 1 of 4 of the second avenue subway in 45 years so things are looking up!
https://t.co/gdxnnXtoDB

[merce’s cunning ham(ming it up) @mioalter]

.@NYCMayor when exactly is this more accessible future? I take my toddler on the subway—e.g. today to the museum of natural history—and it is the rare exception that I do not have carry all 30+ pounds of her in her stroller up and down multiple flights of stairs.

[Greg Egan @gregeganSF]

I want David Cronenberg to design the new USB standard, so all the ports and plugs sigh and moan and writhe before finally accommodating each other’s anatomy in a blissful, disturbing union that allows charging and data transfer to occur effortlessly between all equipment.

[merce’s cunning ham(ming it up) @mioalter]

@atomly yikes