Theoretical Foundations of Foundation Models

Workshop on Theoretical Foundations of Foundation Models @icmlconf 2024.

[Theoretical Foundations of Foundation Models @tf2m_workshop]

We are happy to announce that the Workshop on
Theoretical Foundations of Foundation Models will take place @icmlconf in Vienna!

For details: https://t.co/QGKBMvZ3Yy

Organizers: @BerivanISIK, @SZiteng, @BanghuaZ, @eaboix, @nmervegurel, @uiuc_aisecure, @abeirami, @sanmikoyejo

[Berivan Isik @BerivanISIK]

It was a really fun @icmlconf workshop with amazing speakers, panelists, poster presentations, and a highly engaged audience! @tf2m_workshop

[Kamalika Chaudhuri @kamalikac]

It was very fun participating in the @tf2m_workshop. A big thanks to the organizers @BerivanISIK @SZiteng @BanghuaZ Enric Boix-Adsera Merve Gurel Bo Li @abeirami @sanmikoyejo!

[Subbarao Kambhampati (కంభంపాటి సుబ్బారావు) @rao2z]

Missed the speaker dinner but the panel at the Theoretical Foundations of Foundation Models @tf2m_workshop at #ICML2024 was a blast.. Particularly liked the audience question about the implications of Benchmark culture in LLM evaluations..

[Yuandong Tian @tydsh]

Thanks for inviting me! @tf2m_workshop I am surprised to see a large audience for an invited talk in the theoretical workshop! Maybe it is time to understand the models better in addition to blindly scaling up.

[Sanae Lotfi @LotfiSanae]

Excited and honored that our new work on token-level generalization bounds for LLMs won a Best Paper Award @tf2m_workshop at ICML!

We investigate generalization in LLMs, e.g., memorization vs. reasoning, through compression bounds at the LLaMA2-70B scale.

A 🧵, 1/8

[Ahmad Beirami @abeirami]

[#ICML2024]
Join us at 4:20 pm for an exciting panel to discuss theory and foundation models

[Nezihe Merve Gürel (nmervegurel.bsky.social) @nmervegurel]

Kamalika Chaudhuri’s talk is happening now in Straus 2! @kamalikac @tf2m_workshop

[Petar Veličković @PetarV_93]

A small sample of ICML Workshop (@GRaM_org_ @tf2m_workshop) presentations by Shiye, @kpetrovvic and @fedzbar -- great job all! 🚀

I also contributed a bit but have no pics so far 👀

[Theoretical Foundations of Foundation Models @tf2m_workshop]

Our panel will start at 4:20 pm with amazing panelists:

- @th33rtha
- @furongh
- @rzshokri
- @rao2z
- @tomgoldsteincs
- @tydsh

[Petar Veličković @PetarV_93]

"The great ICML poster bingo" makes a triumphant return on the last day of #ICML2024 🎲

Six posters, three workshops (@GRaM_org_, @DMLRWorkshop, @tf2m_workshop) and this time I don't have to present three at once 😅 Hope to see you there for some of them!

More details below! 🧵

[Ahmad Beirami @abeirami]

Join us at TF2M workshop at Strauss 2 with an amazing lineup of speakers and panelists!

[Federico Barbero @fedzbar]

We will be presenting this work tomorrow at the @tf2m_workshop in Vienna. Please feel free to come check it out or to DM/email me if interested. Looking forward to it!

Tagging co-authors that are on this app :) @AndreaBanino @_joaogui1 @PetarV_93

👓 👓 👓

[Theoretical Foundations of Foundation Models @tf2m_workshop]

Two poster sessions with 58 amazing papers and 4 contributed talks! See the list of accepted papers: https://t.co/wwXVgH4oFB

3/3

[Theoretical Foundations of Foundation Models @tf2m_workshop]

Join us for the Workshop on
Theoretical Foundations of Foundation Models @icmlconf tomorrow!

We have a fantastic list of invited speakers:
- @th33rtha
- @DAlistarh
- @jasondeanlee
- @kamalikac
- @tydsh

1/3

[Theoretical Foundations of Foundation Models @tf2m_workshop]

A panel discussion on theoretical approaches to efficiency, responsibility, and principled understanding of foundation models, with excellent panelists:
- @th33rtha
- @rzshokri
- @rao2z
- @tomgoldsteincs
- @tydsh

2/3

[Ziteng Sun @SZiteng]

Check out our TF2M workshop on Sunday with an amazing list of speakers, panelists, and contributed works: https://t.co/ztXiGfmN3N.

[Juno KIM @junokim_ai]

Also giving a contributed talk on the learning-theoretic complexity and optimality of ICL at the @tf2m_workshop happy to share our results with the ML theory and LLM community!

[Nirjhar Das @stochastic_nir]

📢 Excited to share our work "Active Preference Optimization for Sample Efficient RLHF" accepted at #ICML2024 Theoretical Foundations of Foundation Models (@tf2m_workshop) Workshop! Joint work with @Sayakrayc @SOURADIPCHAKR18 @aldopacchiano

https://t.co/l5ZCq42pRD
🧵(1/6)

[Nezihe Merve Gürel (nmervegurel.bsky.social) @nmervegurel]

Check out the list of accepted papers and program for our @icmlconf workshop @tf2m_workshop:
https://t.co/lsCFw4siIG

[Theoretical Foundations of Foundation Models @tf2m_workshop]

Grateful for the generous sponsorship by @GoogleAI 🙏

[Theoretical Foundations of Foundation Models @tf2m_workshop]

We are excited to announce that 58 excellent papers will be presented at the @icmlconf TF2M Workshop. List of accepted papers: https://t.co/Cwaebf8O3G

You can find the detailed schedule on our website (and below 👇): https://t.co/QGKBMvYw90

[Theoretical Foundations of Foundation Models @tf2m_workshop]

And a panel discussion on theoretical approaches to efficiency, responsibility, and principled foundations of foundation models.