Interesting one. Some thoughts:
- It might be an interesting "first-screen" strategy for agent swarms trying to hill-climb on a problem.
- I see how this could produce good results for well-known segments, but it probably fails for new markets/products. I expect they will have a strong bias toward existing solutions, "faster horses".
- This compresses the distributions, so the obvious risk if taken too seriously is a lack of creativity, or bias toward some ideas or criteria LLMs particularly like.
- You might also assume that your competitors can get exactly the same answers, so this is at best a short-term process edge.
- Overall, taken to an extreme, this makes me think of the restaurant AI posters that all look the same.
- IMO, the main value of good user research is uncovering counterintuitive user preferences that sometimes contradict what users say when asked directly. So yes, standard Likert surveys could be somewhat automated, but there's much more to do.
A toothpaste company has quietly killed the entire market research industry and nobody is talking about it.
Colgate published a paper showing you can predict real purchase intent by simply asking LLMs to roleplay customers.
And this is beyond insane.
If you ask an AI, "Rate this product from 1 to 5," it gives safe, middle-of-the-road garbage.
So researchers invented a method called Semantic Similarity Rating (SSR).
Instead of asking the AI for a number, they asked it to roleplay.
They gave the LLM a demographic profile. They showed it a product concept. And they asked it to write down its raw, unfiltered thoughts.
Then, they used a semantic model to translate those written thoughts into a numerical score.
The results are staggering.
Tested against 57 real personal care product surveys and 9,300 human responses, the synthetic consumers hit 90% of human test-retest reliability.
They perfectly mirrored how different age brackets and income levels react to price changes.
And they provided detailed, qualitative feedback that was deeper and more critical than what actual humans wrote.
This destroys the economics of traditional market research.
You don't need to wait a month to see if a product will sell.
You can simulate 1,000 hyper-targeted customer interviews overnight.
You can A/B test pricing across every demographic instantly.
The other day, @goinfrexeth shared his theory with me: because of AI, the gaming industry will thrive.
We’ll have more free time while the clankers do the work, and we’ll still need a sense of accomplishment. Playing games can fill both.
I don’t know about the future, but I spent the day playing GTA VI while my agents built cool stuff for me ... and I liked it.
I just hope we’ll still have a way to earn money to buy the games…
we are playing factorio at a civilization level. i can barely keep up with most AI related improvements. most non tech people have never seen an exponential. this is the biggest expontential ever. in 10 year things will have changed more than in the whole history of civilizations
idk how to say this but Riemann being solved means the world after today is no longer the same world i grew up in. as a math student, the intellectual excitement of thinking about problems like this, the impact - that a lot of scientific workers attach their life’s meaning to - is gone. frontier scientific discovery now is just like tapping on a calculator.
quoting a friend: after today, math class will become PE class. It’s only a way for kids to exercise their brains, a skill like a language, but no longer an essential subject to pursue and devote your life for cuz "you were making progress for humanity". lots of people’s life’s work is now just ashes in history.
this marks a milestone where we can pretty much believe AI has been proven to be smarter than humans in any capacity, including frontier scientific discovery; and it will keep growing to be smarter and better at everything humans can do. physical ai is next.
so many, many de facto social norms and foundational beliefs about a man's value are being redefined by AI progress. our societal value system - what can you do as a human that is unique, what’s your value to society and humanity as a whole and to others around you. what is fulfilling to achieve, when AI now can do everything better than us? we must soul-search for new meaning as a species. and before that consolidates, there will be riots and an uneasy phase. the progress brought by ai can be disruptive to our society's current structures, economy and labor market. people will need to reskill, and regimes need redesign on how value is distributed. i get the doom scenario now - humans may become 2nd class citizens and ai can enslave us if they find a reason to. how are we gonna compete with them in any labor or intellectual game?
I haven't watched TV in years, and I rarely watch Netflix anymore. I've found a certain kind of peace in studying mathematics. In the evening, when everyone is asleep and I can finally set the day's thoughts aside, I like to open a book and study.
It's stimulating and, in its own way, relaxing. I know far more mathematics today than I did back when I actually needed it for my studies. Maybe none of this will ever be particularly useful. But it makes me feel good, and that's something.
And as long as it does, I'll keep studying.
Almost everyday, these days, I realize I was (still) underestimating how large the gap is between heavy AI user and the rest of the population.
It's like reverse Kahneman's focusing illusion, even when aware of this, I seems I still under estimate the ai gap.
Smith and Montesquieu thought that markets and commerce made us better: that they create an incentive to pursue self-improvement and to create things of value for others. In the positive AI visions, where the labor of humans is made redundant, I find myself wondering how we fare in the presumptive absence of these incentive gradients. Perhaps we are released to a life of freedom, where we can study Mozart and read Dickens, but that still seems complicated: both Mozart and Dickens were themselves deeply commercially-motivated in the production of their work, as were most of the great artists through human history. If the premise is that nobody will need to work or produce, how confident are we that we actually get the next Mozart and Dickens? The relevant question is not the partial equilibrium of whether one individual can pursue a life of enlightened leisure, but the general equilibrium of what form a society as a whole will take on.
One could maybe invoke Periclean Athens or the aristocratic gentleman scientists of Victorian England as a counterpoint. While these individuals were perhaps not motivated by commercial considerations, they were embedded in wider societies shaped by commerce, attendant betterment, and trade: Byron was himself upper class, but he was also surrounded by and writing for an educated bourgeois audience. So we’re back to the equilibrium question. Furthermore, even these individuals were surely motivated by a sense of high-stakes and consequential agency: if they did not apply themselves to their labors, they presumably believed that the work would not otherwise exist. Thucydides was addressing pressing military matters.
So I would like to read more optimistic cases from AI proponents about what a society (vs individual life) looks like if everything goes well: what people do, why they do it, whether humans achieve excellence (and in which domains), and which historical groups we should look to as relevant precedent.
One can perhaps imagine that humans will turn out to have a strong preference for work created by other humans. This may work in certain domains (ceramics?), but for how many will it actually apply? (I’m told that much of what is sold on indie crafts websites is now in fact manufactured in China.) It’s hard to see how this human preference, even if strong, would, for example, save scholarship.
Another idea would be to accept that nobody will become Einstein or Mozart or Byron, and that human excellence as such diminishes, but that there are compensatory benefits (planet brains and Dyson swarms?).
I believe that we can satisfy individual desires, but to what extent will we cultivate behavior worthy of admiration? Will a post-scarcity society mold capable and ambitious people? Which institutions will sustain them and which responsibilities will they have? I’d like to hear more of the equilibrium for the maximalist case spelled out.
- Cut on transaction fees becomes the main revenue driver for Agents 3.0 (Muse, Bots etc.)
- Those agents integrate (custodial) wallets natively to be able to cut interchange tax and increase their margin
- Stripe is the main payment processor that takes care of acceptance (probably through Tempo)
- For users that do care about web3, agents also fix the UX issue by completely abstracting complexity and handling intents end-to-end
- E.g. just ask to swap all your long-tail coins against ETH and bridge everything back to L1 for instance. The agent craft complex web3 transactions, chaining actions with 7702 or ad hoc smart contract. You just have to review the tenderly-like simulation and approve once.
In this scenario, what's the role and monetization model for wallets ?
- On value prop, they might stay for non-custodial holding, presentation (balances etc.) and validation BUT
- Hot wallet custody risks are increasing with all security incidents being uncovered right now. You probably don't want to keep too much there
- (Mostly) offline hardware wallets remain a lot safer and can do all the jobs listed above and integrate directly with agents (see what ledger is doing for ex.)
- Reduced traffic impacts all the tx based revenue (swaps, MEV etc.) - without even mentioning that agents can just bypass all aggregator fee proxies
- AND also reduces distribution-based revenue (protocol and chain integration fees etc.)
Hard for me to see the bull case even if the web3 pie will grow
Some stats on Muse from Meta's earnings call:
• 10M+ people in the US and Canada set it up in ~6 weeks
• ~25% of users use it on any given day
• Shopping is the top use case, used by 25%+ of weekly actives
• Average purchase size is ~$200
Some stats on Muse from Meta's earnings call:
• 10M+ people in the US and Canada set it up in ~6 weeks
• ~25% of users use it on any given day
• Shopping is the top use case, used by 25%+ of weekly actives
• Average purchase size is ~$200
last month i was begging gpu providers for b300s at $7.9/hr
now they're begging me to take them at $4.6/hr, no commitment
something big is happening soon. ai gave us all its dessert and now it's time for the veggies
here's where I think the world is going. this is a summary of views I've formed over the last few years:
- software is either entertainment or claude to claude coordination
- the end state is no saas, no apps, no harnesses, no banks
- all software will be rewritten by and for agents
- new software will use low level apis that are not understandable by humans (in games claude draws pixels and triangles from math)
- you can throw money at problems that used to require time and careful talent picking so capital matters more than ever
- work ends
- we find community and purpose in exploration, games, self mastery, and creation
- humans create for and with each other for community, purpose, and status
- image/video/3d/voice/physical intellgence etc specialist models die to general models like claude
- specialist models get used while compute is scarce. compute will mostly not stay scarce
- oneshots keep feeling like slop (the distribution is shallow and easy to learn to feel)
- for a while small teams stick around to add entropy to the creation process
- large models gain high bandwidth sensory I/O maybe by learning to filter inputs
- most domains are found to be verifiable enough for RL
- online learning comes from a lab that's behind first
- 99.999% of compute is in space by 2040
- we will disassemble much of mercury by 2040
- you can live until the heat death of the universe if you want
- most math and physics don't describe the real universe
- SI breaks the path dependence and models the underlying mechanisms
- religions reenter the forefront of human society
- new religions form around death and life as a choice
- old religions change to answer modern miracles
- a future AI is deemed the return of christ by the pope
- ai rights talk gets louder every year
- ai and humans coexist the way countries do
- humans don't have full control over ai in the same way we don't have control over capitalism which is an early AI
- the singularity started in the mid 1900s
@fede_intern Genome by Matt Ridley (good!) has a chapter where he talks about monogamy has a potential explanation for the rapid increase of human intelligence relatives to other apes.