The Cleveland Clinic and startup Piramidal are developing an AI model trained on brain wave data to monitor patients in the ICU. https://t.co/0om75Jxw05
Congrats to the Piramidal team on the $6M seed!
Piramidal (YC W24) is building a first-of-its-kind foundation model that can detect and understand complex “brain language” or brainwaves.
https://t.co/VboNkk62fq
(17/25) Piramidal (https://t.co/smarTORqvr): A foundation model for understanding brain activity, trained on a “colossal and diverse corpus” of brainwave data. They’ve been able to train a large model with lower computational costs by dividing sequential EEG data into chunks.
Piramidal (W24) is building a foundation model for the brain. Imagine ChatGPT but for the “language” spoken by your neurons.
Their first product is a copilot for epilepsy diagnosis that helps neurologists get insights around a patient’s EEG, in real-time: https://t.co/BL7czznM71
📜🚨📜🚨
NN loss landscapes are full of permutation symmetries, ie. swap any 2 units in a hidden layer. What does this mean for SGD? Is this practically useful?
For the past 5 yrs these Qs have fascinated me. Today, I am ready to announce "Git Re-Basin"!
https://t.co/mRu5k3ONUm
@MishaLaskin 🔥To add 1/ RNN also imposes step-wise dependencies 2/ Attention pooling can sit on top of RNN 3/ But superiority in Transformers lies with deploying self-attention combined w/ positional embedding so that calculation is parallelisable. That excess of compute allows for multihead