Artprice offers the world a liber mundi: “Dialogue Between a Thinker and AI” by Thierry Ehrmann — the revenge of literary minds in the digital age. Neither apocalypse nor machine cult, but a third path to remain free. 1,800 pages. Raw typescript. Free. Read, download, share.
OpenAI also announced Realtime API, Prompt Caching, Model Distillation, and fine-tuning for Vision at the recent DevDay.
Prompt Caching is expected to save 50% on costs and up to 80% on latency times.
Here is a preview of Realtime API in action:
We recently announced JASCO, a music-generation model with improved controllability using conditioning inputs like chords or beat.
We've shared more details on this work in the research paper ➡️ https://t.co/5qaOUDB5Po
Here's my conversation with Edward Gibson (@LanguageMIT), a linguist and psychologist at MIT, heading the MIT Language Lab. We talk all about the human language: syntax, grammar, structure, theories of language, evolution of language, how it reflects culture, and of course LLMs, both their amazing power and their limitations.
It's here on X in full, and is up on YouTube, Spotify, and everywhere else. Links in comment.
Timestamps:
0:00 - Introduction
1:13 - Human language
5:19 - Generalizations in language
11:06 - Dependency grammar
21:05 - Morphology
29:40 - Evolution of languages
33:00 - Noam Chomsky
1:17:06 - Thinking and language
1:30:36 - LLMs
1:43:35 - Center embedding
2:10:02 - Learning a new language
2:13:54 - Nature vs nurture
2:20:30 - Culture and language
2:34:58 - Universal language
2:39:21 - Language translation
2:42:36 - Animal communication
We trained a robot dog to balance and walk on top of a yoga ball purely in simulation, and then transfer zero-shot to the real world. No fine-tuning. Just works.
I’m excited to announce DrEureka, an LLM agent that writes code to train robot skills in simulation, and writes more code to bridge the difficult simulation-reality gap. It fully automates the pipeline from new skill learning to real-world deployment.
The Yoga ball task is particularly hard because it is not possible to accurately simulate the bouncy ball surface. Yet DrEureka has no trouble searching over a vast space of sim-to-real configurations, and enables the dog to steer the ball on various terrains, even walking sideways!
Traditionally, the sim-to-real transfer is achieved by domain randomization, a tedious process that requires expert human roboticists to stare at every parameter and adjust by hand. Frontier LLMs like GPT-4 have tons of built-in physical intuition for friction, damping, stiffness, gravity, etc. We are (mildly) surprised to find that DrEureka can tune these parameters competently and explain its reasoning well.
DrEureka builds on our prior work Eureka, the algorithm that teaches a 5-finger robot hand to do pen spinning. It takes one step further on our quest to automate the entire robot learning pipeline by an AI agent system. One model that outputs strings will supervise another model that outputs torque control.
We open-source everything! Welcome you all to check out the paper, more videos, and try the codebase today: https://t.co/RwiBT3z78H
Code: https://t.co/ERp4Gl0N36
i love to see the sky at night.
to gaze and wonder
so i use AI with a lot of celestial maps from different culture to make this collection.
now you can mint this celestial map in @ourZORA open ed.
https://t.co/FcugMHz2pG
"The ethereal figures in the artwork, surrounded by celestial bodies, challenge the anthropocentric view. They do not dominate the canvas but instead become a part of the cosmic dance. The interconnectedness of everything depicted suggests that humans are not rulers but participants in the universe's grand symphony.
In traditional cosmographical representations, humans often stood at the center. In this image, however, the human figures are decentralized, inviting the viewer to consider a universe where humanity isn't the focal point. The mere act of gazing upon such an image, where we are but specks in the vast expanse, nudges us towards a more humble perspective."