Sibesh Kar

fixing bugs @mayalabsio. tweets are notes to self.

[Sibesh Kar @sibeshkar]

To build machines that can program themselves to do any task, you need to measure how well they learn to do things they were never programmed to do.

Today we release a new benchmark that's the first attempt to do this for any real-world task.

[Sibesh Kar @sibeshkar]

interesting how relativity means travelling to larger and larger scales of the universe will require mastering tinier and tinier scales of autonomy/self-replication

[Sibesh Kar @sibeshkar]

converse: if information doesnt need to travel, it takes no time

[Sibesh Kar @sibeshkar]

hypothesis : gravity is what happens when information has to travel, and travel takes time

[Sibesh Kar @sibeshkar]

hypothesis : gravity is what happens when information has to travel, and travel takes time

[1517 Fund @1517fund]

The beauty of Lingdong Huang's λ-2D - a drawn programming language.

[Sibesh Kar @sibeshkar]

the human abstract world-modelling system never ceases to amaze

https://t.co/1Rur3Uv2Z4

[Sibesh Kar @sibeshkar]

underrated tweet

[(((ل()(ل() 'yoav))))👾 @yoavgo]

i would argue that the nature of the arc challenge is that incremental improvements means you are doing it wrong. a true solution should move from not working to near 100% in one go

[Sibesh Kar @sibeshkar]

insane
https://t.co/Oqx5XY6H6j

[Sibesh Kar @sibeshkar]

octopus learns how to play a custom piano!

https://t.co/htNRZeWmkB

[Sibesh Kar @sibeshkar]

Collating thread of biological intelligence generalising to out-of-distribution tasks from just a few samples.

1. Pro basketball player composes models of the hoop and the windmill mentally, in order to simulate the right trajectory to throw ball at - in just two tries.

[Massimo @Rainmaker1973]

Professional Red Bull basketball athlete Chris Matthews attempts to shoot hoops through a moving wind turbine.

[📹 TheLethalShooter]

[Sibesh Kar @sibeshkar]

Chimpanzees model the structural/mechanical properties of materials to craft new tools for unseen challenges

https://t.co/8HJpA6V3TG

[Sibesh Kar @sibeshkar]

two-strip technicolor : the shoemaker and the elves

https://t.co/QuIcJ9QxsV

[Sibesh Kar @sibeshkar]

perhaps the highest bandwidth human-machine interaction in the future looks something like an LSP

https://t.co/dlgnfsInrg

[Sibesh Kar @sibeshkar]

a thought is a program, converting a synthesized thought from a context-free grammar to context-sensitive one is lossy transmission

[Sibesh Kar @sibeshkar]

the language server protocol is severely underrated/underutilized technology

an instrument to collaborate live with a machine via shared syntax & context in realtime

[Sibesh Kar @sibeshkar]

reiterating w.r.t GPT-5 : expecting exponential gains from log-linear trends (in play since GPT-2) is a category error

https://t.co/NZibwFqrJp

[Sibesh Kar @sibeshkar]

a linear gain in 'intelligence' (or more accurately, benchmark performance) for an exponential increase in resources

fancy betting on a curve that has explicit diminishing returns

The correct learning regime will display the exact opposite curve

src : https://t.co/QoBViISmv4

[Sibesh Kar @sibeshkar]

a deep learning network : rigid, dense fully-connected, ordered, non-local updates, needs a lot of data/energy to learn anything new

a biological brain : flexible, sparse, local updates, messy, can adapt to a new task from a few samples and less than a few watts

[Sibesh Kar @sibeshkar]

https://t.co/9Wgz74Ktr5

per "saturate in months" prediction : LLM RL post-training follows the same log-linear laws as RL pre-training, which means similar theoretical wall (reached faster)

(in graphs : xAI 10x’d the amount of compute used on RL for only marginal perf improvement)

[Sibesh Kar @sibeshkar]

first principles :
> reasoning model perf is downstream of base model perf
> if base model perf plateaus, reasoning model perf is a few months from plateauing
> unless there's a way to auto-induce shorter CoTs
> unlikely - penalizing CoT length leads to memorization in practice

[Sibesh Kar @sibeshkar]

wild
https://t.co/meKwIeZpCQ

[Sibesh Kar @sibeshkar]

everyday we wakeup and pretend the world we live in is completely normal while the thing on the left routinely wraps & dissolves itself to turn into the thing on the right

[Sibesh Kar @sibeshkar]

https://t.co/158Gm6essq

[Kat ⊷ the Poet Engineer @poetengineer__]

the nervous system of the caterpillar during metamorphosis

[Sibesh Kar @sibeshkar]

biological von neumann probe
https://t.co/2ybUvxaMjK

[Sibesh Kar @sibeshkar]

i'm on team mammal but have to admit that the egg is an absolute marvel of bio engineering