Pratyush Tiwary

Professor at University of Maryland
Chemistry for AI and AI for Chemistry
Co-founder,

[Pratyush Tiwary @tiwarylab]

5/5
The encouraging part: structure-guided pretraining improves the signal-to-noise ratio of learned base-pair couplings.
We hope REDIAL helps guide RNA FMs that are not just larger, but more efficient, interpretable, and reliable for RNA therapeutics and de novo design.

[Pratyush Tiwary @tiwarylab]

Presenting REDIAL: a zero-shot diagnostic to detect & quantify overparameterization in RNA language models. We find bigger RNA FMs are not automatically better—& propose path to more efficient, interpretable models.

Preprint: https://t.co/FvXCL7dJUm
Code: https://t.co/Qgc8xFN5gO

[Pratyush Tiwary @tiwarylab]

4/5
The main finding is sobering: current RNA language models appear severely overparameterized relative to available RNA sequence diversity.
In this domain, scale alone is not enough. Bigger is not automatically better.