Imagine every pixel on your screen, streamed live directly from a model. No HTML, no layout engine, no code. Just exactly what you want to see.
@eddiejiao_obj, @drewocarr and I built a prototype to see how this could actually work, and set out to make it real. We're calling it Flipbook. (1/5)
This works really well btw, at the end of your query ask your LLM to "structure your response as HTML", then view the generated file in your browser. I've also had some success asking the LLM to present its output as slideshows, etc.
More generally, imo audio is the human-preferred input to AIs but vision (images/animations/video) is the preferred output from them. Around a ~third of our brains are a massively parallel processor dedicated to vision, it is the 10-lane superhighway of information into brain. As AI improves, I think we'll see a progression that takes advantage:
1) raw text (hard/effortful to read)
2) markdown (bold, italic, headings, tables, a bit easier on the eyes) <-- current default
3) HTML (still procedural with underlying code, but a lot more flexibility on the graphics, layout, even interactivity) <-- early but forming new good default
...4,5,6,...
n) interactive neural videos/simulations
Imo the extrapolation (though the technology doesn't exist just yet) ends in some kind of interactive videos generated directly by a diffusion neural net. Many open questions as to how exact/procedural "Software 1.0" artifacts (e.g. interactive simulations) may be woven together with neural artifacts (diffusion grids), but generally something in the direction of the recently viral https://t.co/z21CP5iQfu
There are also improvements necessary and pending at the input. Audio nor text nor video alone are not enough, e.g. I feel a need to point/gesture to things on the screen, similar to all the things you would do with a person physically next to you and your computer screen.
TLDR The input/output mind meld between humans and AIs is ongoing and there is a lot of work to do and significant progress to be made, way before jumping all the way into neuralink-esque BCIs and all that. For what's worth exploring at the current stage, hot tip try ask for HTML.
@PrimeVideo Only now (b/c have a life and family) just found out @WheelOfTime was canceled after looking forward to its for the last year. Very sad it's too expensive to continue one of the best series ever made.
The talk voted “most mind-blowing” at our workshop was on post-AGI values by @BerenMillidge. The main idea: cooperation and pro-social values could remain viable because they’re competitive. After all, they won in our Malthusian past!
Not to unfairly single out SV and tech in general, but a lot of people who have been waxing lyrical about building a beautiful future seem awfully and conspicuously silent about the ugliness of the present.
Thankfully there are notable exceptions, but there's a broad disconnect.
NEW:
There’s been a lot of discussion lately about rising graduate unemployment.
I dug a little closer and a striking story emerged:
Unemployment is climbing among young graduate *men*, but college-educated young women are generally doing okay.
NEW: I’m not sure people fully appreciate how dire the US life expectancy / mortality situation has got.
My column: https://t.co/dBIhT9eZLv
And some utterly damning charts.
1) at *every* point on the income distribution, Americans live shorter lives than the English.
@swappro@jam_croissant@elonmusk@realDonaldTrump Musk briefly worked with Thiel after X was acquired by PayPal. Thiel fired him. He had a boss briefly as a banking intern while in High school....
@bchesky@Airbnb talked to couple of support sounds like host’s ability to filter out ppl w poor reviews is no longer applicabl reviews > 365 days ?Are you going abr hire ppl into your company saying I don’t care what you did 13 mo ago, just tell me what you did in last 11 mo?
🚨MOT GIVEAWAY ALERT🚨
Thanks to the kind folks at @tickticktrader we are giving away 2 100K Direct2funded Tradovate Accounts. Follow the link and do the various things to earn entries. Winner announced on Monday! Good Luck
https://t.co/FWMUoCxIxJ
#propfirms#propfirm#futures
The originator of D2F, @tickticktrader is making big moves with their revised plans. I sat down with Zak, CFO of TTT, to talk about the company, the industry & why Ticktick should be on the top of your mind for D2F accounts
https://t.co/5IIUpCZt65
#futures#propfirms#propfirm
my father's first book, life in the semiconductor industry. He didn't go to any fancy schools, he almost won a diesel mechanic scholarship, but "threw it", because he didn't want to be a mechanic, and instead went to an 2 year degree in ONLY EE TX A&M. https://t.co/5GttBmH4ts
“Over the past year, the talk of the town has shifted from $10 billion compute clusters to $100 billion clusters to trillion-dollar clusters. Every six months another zero is added to the boardroom plans.”
This is more than worth reading. Fantastically written. Zero pandering. The message may be chilling, but the writing is some of the best you will ever read. I have no affiliation, except as a fellow earthling. Best -
For years, I wished someone inside 3M could give me insight into the company’s decision to keep making and selling “forever chemicals” even though they were accumulating in people. Then I met Kris Hansen... https://t.co/vsBSK04gY3
For years, I wished someone inside 3M could give me insight into the company’s decision to keep making and selling “forever chemicals” even though they were accumulating in people. Then I met Kris Hansen... https://t.co/vsBSK04gY3
⚡ I've almost finished the new version of Allmaps Viewer. Currently, it can only render one georeferenced map at the same time. The new version supports viewing hundreds of maps at the same time, and stitching them together. 🗺️🗺️🗺️