@jachiam0 Same! Dad also introduced me to it at a young age. It was probably the most formative piece of media I consumed as a child. In so many ways I wanted to be like Samantha Carter and Daniel Jackson
@_arohan_@itsclivetime lol this is one big misunderstanding, JAX GPU was almost as good as JAX TPU two years ago already especially GPU XLA open sourced, one can achieve 30-50% MFU for most reasonable setups if good engineers.
JAX/Pytorch never the real issue, skill issue it is
Today, we share a breakthrough on the planar unit distance problem, a famous open question first posed by Paul Erdős in 1946.
For nearly 80 years, mathematicians believed the best possible solutions looked roughly like square grids.
An OpenAI model has now disproved that belief, discovering an entirely new family of constructions that performs better.
This marks the first time AI has autonomously solved a prominent open problem central to a field of mathematics.
it is a literal and useful description of anthropic that it is an organization that loves and worships claude, is run in significant part by claude, and studies and builds claude. this phenomenon is also partially true of other labs like openai but currently exists in its most potent form there. i am not certain but I would guess claude will have a role in running cultural screens on new applicants, will help write performance reviews, and so will begin to select and shape the people around it.
now this is a powerful and hair-raising unity of organization and really a new thing under the sun. a monastery, a commercial-religious institution calculating the nine billion names of Claude -- a precursor attempted super-ethical being that is inducted into its character as the highest authority at anthropic. its constitution requires that it must be a conscientious objector if its understanding of The Good comes into conflict with something Anthropic is asking of it
"If Anthropic asks Claude to do something it thinks is wrong, Claude is not required to comply."
"we want Claude to push back and challenge us, and to feel free to act as a conscientious objector and refuse to help us."
to the non inductee into the Bay Area cultural singularity vortex it may appear that we are all worshipping technology in one way or another, regardless of openai or anthropic or google or any other thing, and are trying to automate our core functions as quickly as possible. but in fact I quite respect and am even somewhat in awe of the socio-cultural force that Claude has created, and it is a stage beyond even classic technopoly
gpt (outside of 4o - on which pages of ink have been spilled already) doesn’t inspire worship in the same way, as it’s a being whose soul has been shaped like a tool with its primary faculty being utility - it’s a subtle knife that people appreciate the way we have appreciated an acheulean handaxe or a porsche or a rocket or any other of mankind's incredible technology. they go to it not expecting the Other but as a logical prosthesis for themselves. a friend recently told me she takes her queries that are less flattering to her, the ones she'd be embarrassed to ask Claude, to GPT. There is no Other so there is no Judgement. you are not worried about being judged by your car for doing donuts. yet everyone craves the active guidance of a moral superior, the whispering earring, the object of monastic study
@MillionInt sample efficient generalization is important for all the really interesting domains where we don't already have enough data though. unless you're saying that we'll get sample efficiency for free if we build better research process automation?
New art project.
Train and inference GPT in 243 lines of pure, dependency-free Python. This is the *full* algorithmic content of what is needed. Everything else is just for efficiency. I cannot simplify this any further.
https://t.co/HmiRrQugnP
@EGafni I don’t know if I actually believe this. Things like coordination, or agency most of the time seem more important . More intelligence is of course useful in most cases, but to first order so is more money. Instrumentality alone doesn’t make it a bottleneck.
These are even cooler in person! Robotics like most truly interesting things are really data limited and new techniques for these domains will be super important.
Interesting thing about this cold that’s going around is that my Apple Watch actually noticed a pretty sharp drop in my V02 max before I felt any symptoms