An exciting milestone for AI in science: Our C2S-Scale 27B foundation model, built with @Yale and based on Gemma, generated a novel hypothesis about cancer cellular behavior, which scientists experimentally validated in living cells.ย
With more preclinical and clinical tests, this discovery may reveal a promising new pathway for developing therapies to fight cancer.
Think your LLM is a time wizard? ๐ง One might think they answer temporal questions through reasoning, but under the hood they may solely rely on their parametric knowledge ๐คฏ
Our new benchmark, ToT, is specifically designed to measure the temporal reasoning capabilities of LLMs.
๐จ Transformer theory alert ๐จ
What algorithms can transformers execute efficiently?
Our preprint sheds some light on reasoning capabilities of transformers, now in ๐๐๐๐๐๐๐๐๐ ๐๐๐๐๐๐๐๐๐ ๐๐๐๐๐๐๐.
Paper: https://t.co/JR0U6qGgov
More in thread! 1/8
โช๏ธ It's "Talk Like a Graph" day at #iclr2024
- 3:15, at #google see a *live demo* of GraphToken, where we train a tiny model (Gemma 2B) and get sota!
https://t.co/vKsCe2ec0h
- 4:30, stop by poster 89 to see the TLG leaderboard and talk with us!
https://t.co/SRCAVt1dd9
At 3:15pm today, the #ICLR2024 Google booth will host @phanein, @BahareFatemi, and @jhalcrow for a talk on finding the correct graph inductive bias for Graph ML and developing strategies to convert graphs into language-like formats for LLMs.
@agihippo Beyond the physical system models like GraphCast (from GDM) we have a lot of impact inside Google with anti-abuse applications. Graph representations are really effective in that domain in a way that's hard to convey with public datasets / open models
Talk Like a Graph or Let Your Graph Do the Talking ๐ง ๐ธ๏ธ
New paper alert ๐จ: we show how GNNs can effectively encode graph-structured data for LLMs: https://t.co/rxe0ItYOJT
๐๐๐ญ ๐๐จ๐ฎ๐ซ ๐๐ซ๐๐ฉ๐ก ๐๐จ ๐ญ๐ก๐ ๐๐๐ฅ๐ค๐ข๐ง๐ : ๐๐ง๐๐จ๐๐ข๐ง๐ ๐๐ญ๐ซ๐ฎ๐๐ญ๐ฎ๐ซ๐๐ ๐๐๐ญ๐ ๐๐จ๐ซ ๐๐๐๐ฌ
Don't know what to do with your graphs in 2024? Shove them to an LLM, of course, and let LLM figure out what to do!
https://t.co/lqYpOqeXha
Short thread (1/5):
New paper alert ๐จ: "Talk Like a Graph" studies the problem of encoding graph-structured data, paving the way for AI to better understand and process complex relationships. Surprising results below ๐คฏ! #AI#LLM#GraphData#MachineLearning