@ubernion@ubernion somewhat connected idea. think ai-generated personal life invasive ads r going to ruin users experience across most free webapps. these ads will be powered by the personal data u’ve allowed to be disclosed. the more they have on u the more invasive the ad
one thing that I wonder is if we’re ever going to get LLMs that stream our inputs?
The same way as a human, when talking to another human you’re essentially incrementally tuning your guess distribution of what the other human means with every bit of information they spit out - and start processing their query as soon as you’ve decreased entropy enough to pick a plausible response path.
Could we have LLMs that stream our inputs and start answering as soon as they’ve gotten that entropy down under a certain threshold? This seems possible now with current architecture although it would be extremely compute intensive, but surely we could find a way to, akin to systolic arrays, stream process the inputs efficiently? Probably not actually given the nature of the forward pass
yeah nevermind, but i was just thinking like imagine talking to a human that starts thinking only when you’re done talking.
like this is how you get llms that interrupt you, that have insanely fast response times etc …
Years ago, as a youngin, a mentor of mine told me that Goldman Sachs had a concept called "the person vs the seat". He explained it: if you look at a person and you put him on a seat at your firm, is it the seat making the money or is it the individual? Think about one aspect of the seat, which is the deal flow. Is the flow coming to the seat because it is Goldman, or is it coming to the person?
As human chimpanzees, we have a tendency to think we are the ones who are doing all the work and getting the job done (self attribution bias and other highly comical biases), but very often, we are just sitting in a really good seat. What if we leave? Will we still have all that flow? Could we even replicate the flow? How about the other benefits of the seat?
I think there are several lessons to this. a) make the seat very powerful, as @johnarnold explains in a part of the pod below. What are the conditions you can create at the seat level to make it powerful? b) the persons who are valuable are the ones who augment and preferably multiply the value of the seat. Those are the ones that you make a partner. c) The "seat" is the reason why if a person leaves a firm, bc he has done well there and then goes to the next shop and does not have the same performance. Very common.
By the way, on John Arnold. a) John just went to China, and he shared on X a recap of his trip. Must read. It complements very well the pod that @bgurley did with @altcap on China. (Go read Gurley's book!) John is on the board of META now and check out how good the board is. Would love to be a fly on the wall on this one. Must be business learning on steroids. b) An interesting event in market history is Centaurus' run-in with Amaranth. Worth taking a look at that. c) his other pods are also worth a listen.
Im consistently amazed at the quality of @patrick_oshag pods and also his questions. Crazy that we have access to these now. When I was starting out, Id have paid a small fortune to listen to this.