I made this last weekend to experiment w/ building an app end to end on LLMs: https://t.co/eOHZunKTyf
It's like Wirecutter, but uses an LLM to recommend product choices based on reddit conversations and reviews, so you don't have to spend 20-30min reading reddit
My experience: I'm late to the game, but this is the first time I've tried building an app end to end around an LLM.
1. It's very fast to build something that's 90% of a solution. The problem is that the last 10% of building something is usually the hard part which really matters, and with a black box at the center of the product, it feels much more difficult to me to nail that remaining 10%. With vibecheck, most of the time the results to my queries are great; some percentage of the time they aren't. Closing that gap with gen AI feels much more fickle to me than a normal engineering problem. It could be that I'm unfamiliar with it, but I also wonder if some classes of generative AI based products are just doomed to mediocrity as a result.
2. On the other hand, I think the discomfort I feel with having an unpredictable black box at the center of a product which can fail in very creative ways some percentage of the time might actually be a competitive advantage for startups. I think Wirecutter, especially branded as NY Times, would have a lot harder time tolerating that unpredictability and unreliability than an app like this (or an actual startup) which can set that product expectation with users to begin with. It might be that the current problems with generative AI are actually the things that create an innovator's dilemma and give startups an advantage to slip under the incumbents. It seems like the ideal spot right now would an app where 90% "done" is a mostly great experience, but the failings are still somehow not stomach-able by incumbents.
3. I do not understand how the economics of LLMs pencil out. When I look at the per concurrent user costs associated with inference, they seem orders of magnitude higher than per concurrent user costs of previous internet technologies. It seems to me that if previous apps like webmail, messengers, etc had costs as high, they would not have been viable products. This is something I want to learn more about.
During Queen Elizabeths funeral procession an unknown female voice came into the news-feed and said the following:
"The death is irreversible, and the fact that she is trapped..."
Before being cut-off. They tried to dismiss it as a hot-mic on the set, what do you think?
I sell signed โnerdyโ giclee prints, greetings cards and now offer portraits.
If youโd like to be included in tomorrows batch of orders you can find my shop here https://t.co/QPnAuXidP9
If you could please share this tweet so I can reach new customers, Iโd really appreciate it!
@maximumleader Honestly, I don't think there's any complicity, just everyone, museums and protesters alike, having enough shared background/class that that instinctively know what is and is not truly out of bounds.
One of the smartest people I know, the amazing @acedtect, wrote a book about tech! I'm going to help get it published and you can, too!
https://t.co/szsHIbqt8M
Considering that muffin tops are the best part, it occurs to me that in zero gravity on the ISS, you could bake spherical muffins that are โall topโ by just floating a ball of dough in the oven with no pan.
@eric_the_read I dunno. Doesn't that make this v2.0? In my own mind, the original is carved in stone: EVERY FLEETING THOUGHT YOU'VE EVER HAD IN YOUR LIFE, NO MATTER HOW BIZARRE, IS SOMEONE'S LIFELONG OBSESSION / AND THEY HAVE A WEBSITE #7fc27ab#f62367d
My @jenfulwiler Saint for 2024 is St Peter the apostle! In addition to his more well-known domains, he's also the patron saint of bakers and watch makers, two of my current favorite interests! My word of the year is Adore, which will take some figuring out.
@pptsapper, my daughter just told me she wants to become a military historian. Do you have any references or recommendations for a high school freshman on how to pursue this?