@ID_AA_Carmack Indeed -- causal inference lies at the heart of that problem, and at the heart of understanding the world and our place in it: https://t.co/uAJjKIjSyi
@yudapearl@NandoDF While there's no structural causal model or anything, the claim is such agents would be performing causal inference. Perhaps not in a formal sense, but more in the sense studied by developmental psychologists and animal behaviorists.
@yudapearl@NandoDF The Q it asks is how far can 'standard' RL frameworks and algorithms get at solving tasks in environments in which, while not known to the agent, there is a separation between observation and interaction, and solving the tasks does require transferring bw obs and interaction.
@NandoDF@yudapearl An RL algorithm that can transfer what it learns from observation to interaction, and vice versa, can more reasonably be argued to be capable of causal reasoning. Even just at the level 2 rung. Shameless plug for a workshop paper I wrote on this: https://t.co/3kr1DDBpQ4
@NandoDF@yudapearl On your second question, another way of phrasing it may be the need to be able to distinguish between actions that are in some sense passive observations of the world and actions that are interactions. In some way this may be separation of the environment into self and non-self.
@Sara_Imari I think a paraphrase of the last clause is: we've evolved to have a sense for 'mathematical' patterns in reality and an ability to form abstractions. Depth in time = evolved long ago to the point of being subconscious abilities for us. But I'm not sure... What is depth in time?
@Sara_Imari Computing existed before Turing. Computers are interesting because they represent (and can manipulate) quantities we're interested in. Biological systems very likely represent (and manipulate) features of their environment.
My brilliant trainee Piotr Sokol (@MannyDePresso) PhD is on the job market! He's an expert in machine learning, differential geometry, dynamical systems / stochastic processes, and lover of manifolds and algebra.
Tour-de-force discussion from @raphaelmilliere on what it means for a video generator (like Sora) to have a "world model". Long, but definitely worth reading.
https://t.co/PxXEgqgj1X
1/ IIT can and should be critiqued, but this letter, despite many admirable signatories (& colleagues/friends) is disappointing. The accusation of pseudoscience is serious & clickbaity & IMO the letter doesn't justify it https://t.co/W9n6XkZz3S