@nikete@aaron_defazio The paper contains asymptotic analysis, but intuitively, when the number of parameters is very large compared to the number of samples, you'll need a lot of L1 regularisation for variable selection and you end up shrinking the remaining coefficients too much.
@joftius@yuvalbenj@tabletmag The argument is indeed unsupported. This is valid critique. Attacking the cum-sum plot is just besides the point. I don't know what the data looks like for a "typical" armed conflict, would love to see data. The correlations are at least surprising though.
@joftius@yuvalbenj@tabletmag The author claims the variation is lower than anticipated for an armed conflict (without supporting data). He talks about the underlying data, not the sums. The visualisation may be misleading but that doesn’t negate the argument.
@lpachter@adiwyner I agree that the claims at the end (about the mechanism and the real death count) can’t be determined from the data, but on this he specifically says (without reference though) that 15% SD in the daily rate is lower than expected in armed conflicts.
@lpachter@adiwyner Your critique is very weak. The author reports the variation daily rate of casualties, not the cumsum, and only uses cumsum in a visualisation.
He also makes other supporting analyses.
Not sure why you’re pushing this.
Yes, I do.
LLMs produce their answers with a fixed amount of computation per token.
There is no way for them to devote more (potentially unlimited) time and effort to solving difficult problems. This is very much akin to the human fast and subconscious "System 1" decision process.
True reasoning and planning would allow the system to search for a solution, using a potentially unlimited unlimited time for it. This iterative inference process is more akin to the human deliberate and conscious "System 2".
This is what allows humans and many animals to find new solutions to new problems in new situations.
Some AI systems have planning abilities, namely those that play games or control robots. Game playing AI systems such as AlphaGo, AlphaZero, Libratus (poker), and Cicero (Diplomacy) have planning abilities. These systems are still fairly limited in their planning abilities, compared to animals and humans.
To have more general planning abilities, an AI system would need to possess a *world model*, i.e. a subsystem that can predict the consequences of an action sequence: given the state of the world at time t, and an imagined action I could take, what would be the set of plausible states of the world at time t+1.
With a world model, a system can plan a sequence of action so as to fulfill an objective.
How to build and train such world models is still a largely unsolved problem.
Even more complex is how to decompose a complex objective into a sequence of sub-objectives. This would enable hierarchical planning, something that humans and many animals can do effortlessly but is still completely out of reach of AI systems.
@devonzuegel As an argument for passive investing you only need a much more permissive argument to hold true: your chances to pick assets / money managers that beat the market after accounting for fees are pretty bad.
@punk6529 Medical sciences are substantially bottlenecked by the need to conduct physical experiments, leading to long iteration times on knowledge acquisition, with or without AI. AI can maybe help us pick our experiments better.
@Andrew_Marshall Because tech is the only viable growth engine the UK has post-brexit, and the cost to avoid serious harm to the ecosystem is very modest