@sinasojoodi The reverse path is the interesting bit. If the code and spec disagree, how do you tell whether it's drift or the spec is out of date? Does a person still decide which one to change?
@mikeknoop Showing cost per task next to the score is underrated. A number without its price and its conditions is hard to decide with. Would love to see that as the default on every benchmark
The last point stays with me. If the legwork gets automated, the scarce skill is checking it. I'd add one thing - the most useful thing an output can show is not the answer but the assumptions behind it, and which ones would change it. Clear to read is good. Clear to challenge is better.
Here's my case against @perplexity_ai and more generally the potential of LLMs to replace search.
I'm writing this when it's been a bit more than 2 weeks since a new President was elected in Sri Lanka. @Google gets it right while Perplexity seems to still be outdated.
Now we could argue here that Perplexity can improve very soon on this by having a better retrieval mechanism that finds more up-to-date data.
But I was surprised to see that it was not the case yet, especially looking at its current valuation which is ~3B.
I can safely say that my usage of Google search has reduced by ~50% since GPT-4 on ChatGPT.
Many it's because of the nature of my work. - 70% for coding | 20% for Youtube | 10% for other reads including Twitter.
What is your experience so far?
I just spent a whole day coding with GPT-4. I was initially skeptical about how much it might help, but OMG, there's no going back now!
Will those years of coding experience even matter going forward?
I built a custom ChatGPT plugin but still didn't get access to plugins on the app to test it out. @sama How long should I wait on the waitlist?
Sincerely,
ChatGPT Plus user. @OpenAI
🎉 GPT-4 is out!!
- 📈 it is incredible
- 👀 it is multimodal (can see)
- 😮 it is on trend w.r.t. scaling laws
- 🔥 it is deployed on ChatGPT Plus: https://t.co/WptpLYHSCO
- 📺 watch the developer demo livestream at 1pm: https://t.co/drEkxQMC9H
Deathbed Regret: Not spending enough time with my kids during the magic years.
There's a devastatingly short window of time during which you are your child's entire world.
After it, they have friends/partners that fill that role.
I refuse to miss those precious years.