mark

llms, molecules, optimization

[mark @notmapika]

@AestherML @OpenAI this level of mathematics rarely has real world implications, whilst curing cancer would save millions.

[mark @notmapika]

@rasbt Actually how does mimo compare with deepseek on kv cache footprint and long-context throughput? Those attention changes mostly target efficiency, but cheaper rollouts also mean more RL for the same budget. That seems hard to separate from the training-recipe gains.

[mark @notmapika]

@teortaxesTex damn who would buy that training stack

[mark @notmapika]

@jpschroeder 2h gh200 finetune
https://t.co/Vv5unUvmty

[mark @notmapika]

@k_grajeda two hours on a gh200: https://t.co/Vv5unUvmty

[mark @notmapika]

After all these connectome tweets i saw i decided to train the a fly’s brain on children’s stories. Now i’m doing mechanistic interpretability on it, and tracking which neurons contribute as it generates “Once upon a time.”

[mark @notmapika]

@finkd metaclaw

[mark @notmapika]

@forloopcodes so only humans are generally intelligent. bro cooked

[mark @notmapika]

@forgebitz thats what general means in 'agi'

[mark @notmapika]

@Ed25518 PFC prior to ethanol-mediated cortical inhibition

[mark @notmapika]

@EU_Commission Peak European progress

[mark @notmapika]

@tacokingX @Ed25518 ts

[mark @notmapika]

@0xSero smokes opus

[mark @notmapika]

@default_smell zai running it on what

[mark @notmapika]

@Ed25518 ldx: attention revisited

[mark @notmapika]

@Pv Btw Google doing ts for a long time with images (synthid) I'm pretty sure oai images are watermarked too. And it's not too hard to imagine a text as a high dimensional discrete vector as llms have vocabs...

[mark @notmapika]

@sudoingX i cant decide if you are dead serious about this, or this is just your edgy frontier bad twitter persona. comparing a 27b model to a frontier class a la fable / sol / k3. and don't you guys pay your electricity subscriptions? or you have it on a home hydroelectric power-plant

[mark @notmapika]

@Ed25518 @thsottiaux production ready circadian rhythm

[mark @notmapika]

@0xSero 150k in gpus 28 usd in shelving. interconnect is hopes and prayers. nice homebrew tho

[mark @notmapika]

@_jaydeepkarale