"He seemed too submissive to Paul, but then the Sardauker had never been prepared for such happenings as this day. They'd never known anything but victory which, Paul realized, could be a weakness in itself."
"Before we begin ruthlessly deconstructing the amateur life, let’s pause for a moment to give it its due. The amateur life is our youth. It’s our hero’s journey. No one is born a pro. You’ve got to fall before you hit bottom, and sometimes that fall can be a hell of a ride." - SP
For anyone starting out with transformers as language models, this is *by far* the most complete, to the point, and non-BS expository document.
https://t.co/OV6pZMs3Vy
major extra points for having zero figures of chaotically intertwined boxes
@emilymbender Whether or not industrial entities are publishing papers isn't related to whether or not cultural biases of the masses give people a different impression of industry vs. academic experience that relates to rampant anti-intellectualism... and the sentiment of the original comment.
@smiteri There’s certainly plenty of mathematicians working in non-academic contexts. Math is much broader than what people are doing with it in academia.
@emilymbender ...which is kind of funny -- as if the computer I'm typing on would have been possible without the computational/electromagnetic theories underlying its design.
@emilymbender I think even for CS/Math/Engineering people, there is a general bias against people whose experience is primarily academic. Seems associated with general anti-intellectualism, as if theoretical results are not worth pursuing...
The thing about heuristic devices is that the device itself can't tell you whether or not you should be applying the device. To assume a particular heuristic is always the solution is to make a fetish out of a tool.
@egrefen I find her criticisms thoughtful in general. It’s fairly obvious LLMs have a lot of utility and will reshape a lot of tech in very interesting ways but that doesn’t mean there aren’t significant theoretical concerns with their usage that should be a part of the conversation.
The hard truth is, in most cases, the solution to "how do I get better" is to become more skilled and put in the time. No shortcuts, just hard-earned results.
This one sentence encompasses so much of the route technology is likely to take in the coming years. Guessing it’ll be some flavor of clearly amazing but potentially terrifying.
@shaneparrish Thinking in Systems by Donella Meadows. Key takeaway: the key to understanding and anticipating system level behavior is in feedback mechanisms and their interactions. Surprises are usually due to a significant impact of a higher order interaction that isn’t being considered.