Richard Saunders

Researcher

[Nat Friedman @natfriedman]

Our multi-model playground is coming together. Give it a try: https://t.co/dbsmteAqri

[Teknium 🪽 @Teknium]

OpenAI is creating an entirely new class of generative models for images.. https://t.co/UjXXQHIH6c

[Joanne Jang @joannejang]

🐱 Attention everyone! 🐱
🙀 Big news from OpenAI! 🙀
🤖 The API Playground now has a Chat mode! 🤖

😻 thanks to @nadipity @_chestercho 😻

[DY @DYtweetshere]

AI agents can now teach themselves HOW to use tools (ie. any API) in real time, completely automated!

Introducing: Self-Learning Agent for Performing APIs (SLAPA)

with @FinsamSamson

[Karan Goel @krandiash]

We built an interactive data frame powered by foundation models that can wrangle your unstructured data (images, videos, text docs...)

Introducing 🔮 Meerkat!

📃 https://t.co/daOhOZunvZ
💻 https://t.co/kzW28xlb1v
🌐 https://t.co/LP1cZaRdW7

[Tian Jin @jintian]

I've been organizing an MLSys discussion group at MIT where we discuss influential/interesting ideas for building machine learning systems. Our discussion is all over the place but I do my best to keep a record here: https://t.co/k6Lxz5bXy4.

[Zachary Nado @zacharynado]

Excited to announce our Deep Learning Tuning Playbook, a writeup of tips & tricks we employ when designing DL experiments. We use these techniques to deploy numerous large-scale model improvements and hope formalizing them helps the community do the same! https://t.co/vDhSwZyHJm

[Oriol Vinyals @OriolVinyalsML]

Chain ⛓️ Rule(s) rules! Appreciation thread of one of the most interesting coincidences in machine learning. Two rules, both named "Chain Rule", happen to be absolutely critical to recent advances in ML & AI. A 🧵 on the Chain Rule of Probability & the Chain Rule of Calculus👇

[MIT CSAIL @MIT_CSAIL]

MIT researchers found that massive neural nets (e.g. large language models) are capable of storing and simulating other neural networks inside their hidden layers, which enables LLM to adapt to a new task without external training: https://t.co/sValGb5S0S

[Jean de Nyandwi @Jeande_d]

Stanford CS 324 - Large Language Models - Lecture Notes 2022

A handy notes on various topics and techniques related to large language models. Notes are structured really well and there are pointers for recent/landmark papers in LLMs.

https://t.co/zhRBeu5CxH

[John Nay @johnjnay]

Very strong headwinds for any company producing low/mid-quality ML training data.

LLMs now quickly & flexibly produce high-quality synthetic data for training:

- Information retrieval ranking models
- Instruction fine-tuned LLMs
- CoT fine-tuned LLMs
- RL on LLMs (RLAIF)
- etc.

[Jason Wei @_jasonwei]

Yesterday I gave a lecture at @Stanford's CS25 class on Transformers!

The lecture was on how “emergent abilities” are unlocked by scaling up language models. Emergence is one of the most exciting phenomena in large LMs…

Slides: https://t.co/Bqht9OEw7m

[Jason Wei @_jasonwei]

I gave a version of this talk "Scaling unlocks emergent abilities in language models" today at USC ISI.

There is a video recording: https://t.co/ukHNiRXbUn

Thanks Justin Cho @HJCH0 for inviting me and organizing!

[Andrew Judson ♘ ♠ 🎮 @andrewljudson]

I made a small chrome extension that uses LLMs to help generate spaced repetition prompts while reading.

[Lilian Weng @lilianweng]

🚜 Cannot believe it is almost 3 years since my 2020 post on variations of Transformer. I spent some time and did a big refactoring of that old post with new section structure and new papers. Still missing a few items tho, will add them in slowly: https://t.co/tsHFbnd8hw

[Varun Shenoy @varunshenoy_]

Can LLMs extract knowledge graphs from unstructured text?

Introducing GraphGPT!

Pass in any text (summary of a movie, passage from Wikipedia, etc.) to generate a visualization of entities and their relationships.

A quick example:

[Chris Donahue @chrisdonahuey]

Excited to share SingSong, a system which can generate instrumental accompaniments to pair with input vocals!

📄https://t.co/1mRUaXvqVy
🔊https://t.co/8RGezPu5YQ

Work co-led by myself, @antoine_caillon, and @ada_rob as part of @GoogleMagenta and the broader MusicLM project 🧵

[Richard Saunders @OnChainResearch]

@eladgil 100% @ilyasut, he’s one of the clearest thinkers in the field.

[superphiz.eth @superphiz]

I didn't find a great listing of Ethereum-related information dashboards, so I started cobbling one together. Please feel free to point me to something better, submit PRs to this one, or just tell me what's missing.
https://t.co/sgs4C5Fazq

[Scroll @Scroll_ZKP]

Polynomial commitment schemes are critical to Ethereum’s scaling solutions.

These schemes will be used in Danksharding, as well as in the proof systems behind Scroll. What are polynomial commitment schemes? And how will they help scale Ethereum?

https://t.co/n66DaP6kOm