Ramon Correa-Medero

ASU DSE Ph.D. student. Just retweeting ML/CS Takes. Opinions are my own. 🇵🇷🇵🇷🇵🇷🇵🇷

[ArtButMakeItSports @ArtButSports]

Mephisto, by Joaquín Espalter y Rull, 1872, 📸 by Dan Mullan

[MedAI Group @MedaiStanford]

This Monday, Frances Dean from UC Berkeley and UCSF will be joining us to talk about their work on building digital twins of cardiac hemodynamics. Catch it at 1-2pm PT this Monday on Zoom! Subscribe to https://t.co/Tr8mrytDbz #ML #AI #medicine #healthcare

[Zhuang Liu @liuzhuang1234]

Can you tell which datasets these images are from, with only their segmentation maps?

In our new work, we find neural networks can do this task quite well, with ~70% accuracy for a three-way classification problem, for three large-scale image datasets.

[Zongwei Zhou @Zongwei_Zhou]

Are We on the Right Way for Evaluating AI Algorithms for Medical Segmentation? https://t.co/5CQ9UYXHIi

[Pablo Samuel Castro @pcastr]

📢Don't flatten, tokenize!📢

tl;dr: the key reason for softmoe's efficacy in deep RL turns out to be tokenization!

i.e. the common practice of flattening the output of conv encoder layers is quite suboptimal!

👇🏾more details in thread below👇🏾
1/11

[Case Western Reserve @cwru]

From moving into their dorms to taking part in "tradition," our first-year students have had a busy start to Discover Week 💙 Take a look at how the CWRU community welcomed the #CWRUClassOf2028 home:

[Ramon Correa-Medero @Ramonbelt]

@pradeeban https://t.co/eSFBxRajok one suggestion

[Horace He @cHHillee]

For too long, users have lived under the software lottery tyranny of fused attention implementations.

No longer.

Introducing FlexAttention, a new PyTorch API allowing for many attention variants to enjoy fused kernels in a few lines of PyTorch.
https://t.co/IXeUS6AkrY
1/10

[Josiah Johnson @KingJosiah54]

LeMerica! 🇺🇸

[Yusong Wu @wuyusongwys]

We built a real-time music jamming system using RL and generative models -- you can play along with this model and learn more about our work at #ICML2024 🎶!

📄 paper: https://t.co/9HdyO7PHhU
🌐 website: https://t.co/1JEfQdgHca

🕐 Tue 23 Jul 1:30 - 3 p.m. CEST
📍 Hall C 4-9

🧵

[Marco Ciccone @mciccone_AI]

Is ReNet cool again? or never stopped to be cool? https://t.co/R6Ig3impG4

[Ori Press @ori_press]

Entropy minimization is often used to increase the accuracy of models on unlabeled data, but it isn’t clear why it works. In our new ICML paper, we show that it clusters the embeddings of its inputs. With @ziv_ravid, @ylecun, @MatthiasBethge

https://t.co/RzdIgxbZaH
1/5 🧵👇

[Google AI @GoogleAI]

TimesFM is a forecasting model, pre-trained on a large time-series corpus of 100 billion real world time-points, that displays impressive zero-shot performance on a variety of public benchmarks from different domains and granularities. Learn more → https://t.co/U1OctNPZET

[Ken Liu @kenziyuliu]

The idea of "machine unlearning" is getting attention lately. Been thinking a lot about it recently and decided to write a long post: https://t.co/YWFco5xNNq 📰

Unlearning is no longer just about privacy and right-to-be-forgotten since foundation models. I hope to give a gentle overview of unlearning and touch on things like copyright, NYT v. OpenAI, NeurIPS unlearning challenge, retrieval-based systems, AI safety, & pretending to unlearn.

I hope it'll be a fun weekend read!

[Fabian Isensee @FabianIsensee1]

Concerning results: We've evaluated Transformer-, Mamba-, and CNN-based architectures, revealing widespread validation flaws in #MedicalImageSegmentation. Many claims of superiority do not withstand strict testing. Time to push for rigor in the field :) https://t.co/xVRI1wX1mB

[Jeremy Howard @jeremyphoward]

In Australia we have a computational thinking competition for kids each year called Bebras. You get a certificate if you get all of them right.

Here's one of the "easy" level questions for children in grade 3.

GPT 4 got it wrong.

[Jeremy Nguyen ✍🏼 🚢 @JeremyNguyenPhD]

MYSTERY SOLVED!

Why does ChatGPT use the word "delve" so much? We've seen a 10x increase in the proportion of medical studies using the word "delve" from 2022 to 2024. But why?

@alexhern at The Guardian might've just solved it. Thread below, complete with the trail of clues:

[hardmaru @hardmaru]

RNNs are not dead yet‼️

In fact, they are coming back with a vengeance recently. Very nice paper about “The Illusion of State in State-Space Models” (https://t.co/TPhu4g8NtW) and thread 👇

[Hilde Kuehne @HildeKuehne]

Ever asked yourself what's the best explainability method for ViT Transformer at the moment?

🚨 We present you LeGrad, a Layerwise Explainability GRADient method for large ViT transformer architectures. 🚨

So, grab your ☕️ and 🥐, release your inner 🇫🇷, and join us on our journey through the layers of different ViT models.

Authors: @BousselhamWalid did all the programming, but we would have been lost without the wisdom of @angie_boggust and @hen_str ! Thanks so much for being so great collaborators!

@MIT_CSAIL @MITIBMLab