Daniel Droke

I’m an engineer now doing GTM things @akalabs

[Daniel Droke @droke_daniel]

Tried training a language model from scratch with pure RL today

Everything became kawasaki

[Daniel Droke @droke_daniel]

@ishanr07 RL env was a text JEPA that wasn’t ready to face the power of kawasaki spamming

[Daniel Droke @droke_daniel]

Tried training a language model from scratch with pure RL today

Everything became kawasaki

[Daniel Droke @droke_daniel]

@james_moore_24 Basically the RL env was a text JEPA model. It only saw "kawasaki" a couple times in training, so its embedding was basically still random noise. I guess the decoder found a local min at kawasaki lol

all roads lead to kawasaki

[Daniel Droke @droke_daniel]

Nvidia is 6-8% of the S&P500

[The Wall Street Journal @WSJ]

Breaking: Nvidia’s board is preparing to oust CEO Jensen Huang after he had two extramarital affairs, including one with a suspected Chinese spy. https://t.co/Pjsu5j87CF

[vogel @ryanvogel]

Jensen fired from NVIDIA before GTA VI

buzzer beater

[Daniel Droke @droke_daniel]

@collagenfan @FranticRblx "Central Jersey is a real thing" 😂

[Daniel Droke @droke_daniel]

There is a really strong similarity between dogs and beaches in text embedding models

[Daniel Droke @droke_daniel]

@alth0u fair point

[Daniel Droke @droke_daniel]

The UX of software is plummeting.

I take a lot of pride in trying new software products. I try something new every single day.

But I'm finding that there's a huge gap between what I want from a product and what the product wants from me. Like I click a button expecting one thing, and I'm immediately given another.

Eventually, I just get pissed off and delete it.

So yes, you can write a million lines of production level code and I still won't use it.

If you're going to put something out into the world, make it elegant.

Build something small and beautiful.

[Daniel Droke @droke_daniel]

Keep an eye out for CRWV earnings today

[Daniel Droke @droke_daniel]

People are way too obsessed with LLMs.

LLMs are by all means "intelligent". It's amazing that I can talk to a model in natural language.

But the idea that language is all that's needed to produce human-level intelligence discredits the human mind.

Language is a collapsed representation of thought. It's one output method of the minds ability to express itself. Just because we can build a model to predict one output method of the brain, doesn't mean that this model is naturally equivalent to the human brain.

You can argue that all we need for digital tasks are LLMs. But don't pretend that LLMs are the end-all-be-all of AI just because it can write essays for you about hard concepts.

Also, the idea that the science of AI is finished is a limiting belief. You are holding yourself back by assuming labs have already solved the "final problem".

[Richard Sutton @RichardSSutton]

Brute force computation is not enough for intelligence. Clever new methods are needed. The science of AI is far from finished. IMHO

[Daniel Droke @droke_daniel]

@garrytan Tech is full of innovators. Policy might make this difficult, but even if we aren’t able to scale compute, we can still find a way.

[Daniel Droke @droke_daniel]

@YannickScholich @martin_casado This is worth a read too! https://t.co/9TEPanrryG

[Daniel Droke @droke_daniel]

I'm starting to think attention might not be all we need...

[The Macro Paper @macropaperr]

🚨 BIGGEST SINGLE-DAY WIPEOUT IN US STOCK MARKET HISTORY

$2.8 Trillion has been wiped out from the US stock market today so far, the largest one in history.

Previously, the largest single-day wipeout was of $2.69 Trillion during the Covid crash.

[Daniel Droke @droke_daniel]

@dedene I am groot

[Daniel Droke @droke_daniel]

@DavidPawlan @cuysheffield @VNallatamby Getting on a flight mid market crash must've been insane lol

[Daniel Droke @droke_daniel]

@nikitabier import pandas as pd

[Daniel Droke @droke_daniel]

Are people actually buying things with AI?

[Daniel Droke @droke_daniel]

@Zacbunchanumbrs @GaryMarcus It's the timeline that doesn't make sense. Everything we know today was obvious Tuesday night. Dems were very clear about their position on data centers. Data centers in general have been deeply unpopular for years.