Elliot Murphy

• Postdoc, Department of Neurosurgery, UTHealth
• Neural enforcement of compositional syntax

[Elliot Murphy @ElliotMurphy91]

A thread of some new work that’s appeared since I was last on this platform a couple of years ago!

⬇️🧵 🧠

1) A lecture for Michael Levin’s symposium on Platonic spaces in biology.

https://t.co/Jo4TkbqPKd

[Kording Lab 🦖 @KordingLab]

Here is the key problem in the recent paper arguing that neurons are simple. It is the same logical problem plaguing much of neuroscience.

[Kyle Siler (@kylesiler.bsky.social) @KyleSiler]

New article in @PNASNews:

We all know that ChatGPT loves to delve, bolster, leverage, encompass, showcase, underscore, et cetera. I analyzed full text of 7.3 million journal articles published 2020-2025, hunting for 228 words that spiked after ChatGPT launched in late 2022.

[Luiz Pessoa @PessoaBrain]

𝗕𝗶𝗼𝗹𝗼𝗴𝘆 𝗮𝗻𝗱 𝗣𝗵𝘆𝘀𝗶𝗰𝘀
Looks very interesting.
"We counterpose this view to ... reductionist physical theories of biological systems and highlight open questions regarding incompletely characterized and enigmatic forms of living matter.
https://t.co/MTAH5DGvHE

[Joséphine Raugel @JRaugel]

1/ We’re so glad to share this new study 💫
Does the brain learn like a Deep Net? 🧠⚙️
- 📄Misalignment Between Backpropagation and the Hierarchy of Brain Responses to Images
- 🔗https://t.co/yrb4otBEYk
Thread below 🧵

[Tania Lombrozo @TaniaLombrozo]

Do LLMs *understand* language? Do educational AI agents *understand* the material they teach (or their students)? Claims about what AI systems do or don't understand are pervasive, but assessing them requires an account of MACHINE UNDERSTANDING

[Elliot Murphy @ElliotMurphy91]

Extremely cool work 😎 🧠

Fine-tuning language encoding models on slow fMRI improves prediction for fast ECoG

https://t.co/tbwbUKKBDO

[Elliot Murphy @ElliotMurphy91]

Transitioning from speech to language brain–computer interfaces

https://t.co/l9eHDjtqRX

[Elliot Murphy @ElliotMurphy91]

Discussion about Platonic spaces in biology

https://t.co/igfRCif2qb

[Christopher W. Lynn @ChrisWLynn]

Our understanding of neural computation (in the brain and artificial networks) is founded on an assumption: That neurons fire in response to a linear sum of inputs. But can real neurons be so simple?

In a new paper, I systematically test this assumption
https://t.co/vQtYVe8wKQ

[Alison Gopnik @AlisonGopnik]

Here is the specific link to our paper with Eunice Yiu, Shiry Ginosar and Kelsey Allen, how to construct causal models through intrinsically motivated action, something kids do and LLMs don't. The whole issue on world models is very much worth reading.
https://t.co/kk8xLFpsAU

[Elliot Murphy @ElliotMurphy91]

Deconstructing “science populists”

https://t.co/0acVjUtCwr

[Adam Safron @adamsafron]

It is the deepest honor to have been joined by Michael Levin (@drmichaellevin), Victoria Klimaj, Zahra Sheikhbahaee (@zah_bah), Dalton Sakthivadivel (@DaltonSakthi), Adeel Razi (@adeelrazi), David Ha (@hardmaru), Nick Hay, Kevin Schmidt, Irina Rish (@irinarish), David Krakauer (@sfiscience), Melanie Mitchell (@MelMitchell1), Samuel Gershman (@gershbrain), and Joshua Tenenbaum in organizing this special issue of the Royal Society’s (@RSocPublishing) Philosophical Transactions A:

“World models, A(G)I, and the Hard problems of life-mind continuity: Toward a unified understanding of natural and artificial intelligence”
https://t.co/XMYB2SAofX

This collection was motivated by a question with far reaching implications, ranging from the fundamental nature(s) of mind to choices that may determine the future of our civilization/species: what kinds of world modeling capabilities are likely to be realized by which kinds of minds and what world might we be in with respect to increasingly advanced artificial intelligences?
Will the scaling and refinement of present approaches result in AI with human-like (and beyond) cognitive abilities, or do we need radically different paradigms that more closely follow the principles of natural intelligence? Learning “world models” to predict/compress information may be how biological learners so efficiently learn (to learn) to achieve goals and generalize that knowledge across a broad range of task environments. World models may also be useful for reverse-engineering forms of “System 2” cognition, or the self-reflexive, deliberate, multi-step reasoning associated with cognitive capabilities that may be unique to humans. Predictive models that reflect how the world may be causally modified by actions allow agents to adaptively control their behavior with flexibility and context-sensitivity. Spatiotemporally and causally coherent models of the physical world may not only be the key for creating AIs that we can rely on for real-world deployment, but may even be the (dynamic) core of conscious cognition.

The contributions to this special issue consider the varieties of world models worth modeling from diverse points of view:

Douglas Hofstadter explores whether sufficiently coherent self-referential world modeling could ground meaning, consciousness, and a genuine “I” in future AI systems.

David Krakauer (@sfiscience), Melanie Mitchell (@MelMitchell1), and John Krakauer (@blamlab) examine the principles of emergent intelligence from a complex systems perspective.

Alexander Ku (@alex_y_ku), Declan Campbell, Xuechunzi Bai (@baixuechunzi), Jiayi Geng (@JiayiiGeng), Ryan Liu (@theryanliu), Raja Marjieh (@RajaMarjieh), R. Thomas McCoy (@RTomMcCoy), Andrew Nam, Ilia Sucholutsky (@sucholutsky), Liyi Zhang (@LiyiZhang_Leo), Jian-Qiao Zhu (@JQ_Zhu), and Thomas Griffiths (@cocosci_lab) argue for using the tools of cognitive science to understand and evaluate LLMs across multiple levels of analysis.

Evelina Leivada (@EvelinaLeivada), Gary Marcus (@GaryMarcus), Fritz Günther, and Elliot Murphy (@ElliotMurphy91) test whether LLMs deeply understand language and the “world behind words,” or primarily learn surface statistical regularities.

Pedro Tsividis (@ptsividis), João Loula, Jake Burga, Juan Pablo Rodriguez, Sergio Arnaud, Nate Foss (@_npfoss), Andres Campero, Ajay Subramanian (@ajaysub110), Thomas Pouncy, Samuel Gershman (@gershbrain), and Joshua Tenenbaum introduce a theory-based meta-learning architecture inspired by the remarkable flexibility and efficiency of human cognition.

Eunice Yiu (@eunice_yiu_), Kelsey Allen, Shiry Ginosar (@shiryginosar), and Alison Gopnik (@AlisonGopnik) explore empowerment, controllability, and causal reasoning as means of understanding the remarkable learning abilities of both child and adult minds.

Nadav Amir, Stas Tiomkin, and Angela Langdon investigate how goals shape the structure of experience and how the world modeling abilities of natural intelligences may be inseparable from values.

Vickram Premakumar, Michael Vaiana, Florin Pop (@FlorinPop17), Judd Rosenblatt (@juddrosenblatt), Diogo Schwerz de Lucena, Kirsten Ziman, and Michael Graziano show unexpected benefits of self-modeling as an inductive bias and regularizer for training artificial agents.

Hanlin Zhu, Baihe Huang, and Stuart Russell analyze why model-based reinforcement learning may fundamentally outperform model-free approaches in representational efficiency.

Bradly Alicea (@balicea1), Morgan Hough (@mhough), Amanda Nelson, and Jesse Parent (@JesParent) revisit fundamental cybernetic principles of regulation, adaptation, and world modeling across a wide assortment of complex adaptive systems.

Francesco Sacco (@FrancescoSacco1), Dalton Sakthivadivel (@DaltonSakthi), and Michael Levin explore topological constraints on self-organization and suggest that biological systems maintain long-range coherence in ways that are fundamentally different from current transformer architectures.

Georg Northoff (@NorthoffL), Yasir Catal, and Samira Abbasi examine how biological intelligence may depend on capabilities for flexible “inner time” to ensure adaptive alignment between the dynamics of system and world.

Nicolas Rouleau (@DrNRouleau) and Michael Levin explore whether theories of consciousness generalize beyond brains to unconventional embodiments and living systems more broadly.

Benjamin Lyons and Michael Levin investigate economies and collective intelligence as systems coordinated by “cognitive glues” in the form of shared models of scarcity and value.

Katherine Collins (@katie_m_collins), Umang Bhatt (@umangsbhatt), and Ilia Sucholutsky (@sucholutsky) consider “Rogers’ paradox” to demonstrate ways in which collective learning is impacted by different kinds of human-AI interactions.

Ruairidh Battleday (@RMBattleday) and Samuel Gershman (@gershbrain) distinguish between the “easy” and “hard” problems of science, and describe how while current AI systems demonstrate powerful narrow forms of optimization with respect to well-defined inference-spaces, further developments are needed for achieving capabilities for novel scientific discovery.

Fritz Breithaupt (@FritzBreithaupt) explores narrative world models and the roles of uncertainty and transformative experiences in natural intelligences, suggesting that coherent agency may depend on better understanding human-like meaning-making.

Taken together, these diverse perspectives suggest that while LLMs can clearly learn powerful generative models of language, they likely do so without having world models of sufficient spatiotemporal and causal coherence to achieve human-like reasoning abilities, capacities for generating subjective conscious experiences, or pathways to realizing artificial general superintelligence. However, by further developing world modeling architectures, we may eventually be able to create forms of intelligence that recapitulate the remarkable flexibility and generality of human intelligence. Finally, enhanced (e.g. more coherent/integrated) world models may not only afford expanded capabilities, but could potentially help ensure that increasingly powerful AI systems achieve both inner and outer alignment with human(e) values.

[Elliot Murphy @ElliotMurphy91]

The U.S. has 1,200 AI bills and no good test for any of them

https://t.co/4YwjHCL7UY

[Elliot Murphy @ElliotMurphy91]

Picture naming: Stereoelectroencephalography and connectivity insights

https://t.co/OkyiqEiFuR

[Thomas G. Dietterich @tdietterich]

Attention @arxiv authors: Our Code of Conduct states that by signing your name as an author of a paper, each author takes full responsibility for all its contents, irrespective of how the contents were generated. 1/

[Elliot Murphy @ElliotMurphy91]

New paper out today on LLMs and world models

"A sentence is worth a thousand pictures: can large language models understand hum4n L4ngu4ge and the W0rld behind W0rds?"

https://t.co/sj9EemVQtt

[Nature Rev Neurosci @NatRevNeurosci]

Rethinking hierarchy: the auditory system as an integrated cortical–subcortical network — a Review by Michael Lohse, Ben D. B. Willmore & Andrew J. King

https://t.co/p5FlxgXTvd

[Elliot Murphy @ElliotMurphy91]

Shared Neural Computations for Syntactic and Morphological Structures: Evidence From Mandarin Chinese

https://t.co/Q0WiwtuoTC

[Elliot Murphy @ElliotMurphy91]

Alpha phase coding supports feature binding during working memory maintenance

https://t.co/HOo1Wempeu

[Elliot Murphy @ElliotMurphy91]

@PessoaBrain Don't know if this is related but the Santa Fe Institute obviously is relevant here

https://t.co/mGUO0GVQob