I canโt say enough good things about John Carmack @ID_AA_Carmack and his Keen Technologies. But now Khurram Javed @kjaved_ and I have broken away to start our own startup and pursue a slightly different path toward understanding intelligence. Like Keen (and like Ineffable) we at Oak Lab @oaklab_ai believe in reinforcement learning and that intelligence is created and maintained from run-time experience. But we think current deep learning methods are weak and inefficient, and need not more tweaks, but fundamentally new ideas and a thorough reworking before they can provide a solid foundation for achieving the more ambitious goals of AI.
@khoomeik What does this really mean? Could it be because a disproportionate amount of data of these languages are probably books and media and not from the internet?
Also, Iโm wondering if clear formal and informal use of pronouns (which English doesnโt have) causes this skew?
@steveruizok When we were working on Text-UI in 2022, we kept collapsing into defining ontological structures for UI. That would either constrain the user or constrain the LLM, both of which are bad. This is probably the nature of all DSL-like/based interfaces.
in a nutshell, your brain reacts differently to words compared to other people. if we use an LLM like an MRI to decode each person's reading patterns, we can actually see different signatures.
My first-ever internship was at a startup,with the most clichรฉ setup you can imagine - a literal garage office.
The CEO and interns shared one table.
The culture was incredible(if you were a hustler. ) Everyone there was insanely good at what they did.
Its funny how we have unconsciously created the same mechanics at Chiseled ๐
- we never start a brainstorm without a whiteboard.
- ideation always happens at the end of the day (tired brains = wild ideas xD).
- no oneโs tied to a fixed desk.
- and yes, we turned a beautiful home into an office too.
@sumukhbett thanks to you, I donโt just know what first-principles thinking is. I know how to live it.