@marklevinshow I really appreciate the support that you provided to Iranian people during the uprising and aftermath. But there is UN security council resolution that says west bank is illegally occupied which is binding for all member nations. So I am not sure on what is basis for your claim.
Fond memories of discussing bandit optimization with @SebastienBubeck at NeurIPS/ICML/COLT 2012-13, inspired by his seminal PhD thesis. Sad to see such a brilliant scientist dragged into a controversy for leading on a line of research that has been core to his work since 2022.
XBridge came out a few weeks back and the mechanics are close to what we're doing at @mostik_ai
the sender runs a forward pass, its hidden states go through a trained bridge into a second model, and then the second model generates output (both models are also stay frozen, only the bridge trains)
the big difference is how far apart the two models sit: they pair models in the same size range, 7B and 8B in both directions, while we're running 753B into 4B
a continuous bridge on its own turns out to carry the context over and lose the entities that context is about, names and numbers especially
so they add a second input that maps the sender's tokens directly into the receiver's vocabulary, giving the receiver discrete anchors for the continuous signal to attach to
I'd expect that problem to get harder as the two models get further apart: at 753B into 4B there's a lot less shared structure between the two representation spaces than between two 7Bs -- it's a real failure mode and I think anyone building in this direction meets it
we found an elegant way of how to deal with it!
going to share the specifics soon, stay tuned ✨
https://t.co/h4Jr2NrNPP
two years ago the plan for my thirties was tenure-track, and now it's diagrams-covered whiteboard, the best team I could ever imagined, and a city where the sauna conversations are better than most conferences 😄
no conclusion, just noticing it on a Sunday ✨
@elonmusk Nice talk. But he got his facts wrongs. All Chinese laborers were banned from entering US by the act of congress since 1882. So there was no free immigration to USA before 1914. Also US newspapers at the time was full of hatred against Irish and Italians.
@elonmusk what? does destroying white race include himself . he looks pretty white to me himself. If I didn't know his name I would think he is French or Italian.
@elonmusk Socialists are hitler ...!? You know nothing Elon Snow and yet your dare to get into every sensitive discussions for which you are not qualified to talk about. And maybe that is why we still like you ;)
@IsraelPersian روحشان شاد و نامشان جاوید.در ضمن اسم محله آریا شهره. صادقیه اسمیه که جمهوری اسلامی روش گذاشته و اهل محل فقط از اسم آریاشهر استفاده می کنن. لطفا تصحیح کنین.
@SchmidhuberAI Does PMax loss contain stop gradient on teacher (target) network? In BYOL stop grad+exponential averaging on teacher network was very crucial to avoid collapse. Also I was wondering whether the objective in PMax is adversarial (MinMax) or it is only one optimization like BYOL.
Is it only me or Fable has geniunely has got worse compared to Opus in terms of research and following the instructions? It pretends it understand what you asked for while it is totally off track. Then it goes down the rabbit hole of doing what he think it is right without even doing simple checks on previous logs or web search or asking users that what it does make any sense.
رئیسجمهور ترامپ درباره اعتراضات مردم ایران:
«برای مردم بسیار دشوار است که دوباره به خیابانها برگردند. ممکن است بسیار شجاع باشند، ممکن است از رژیم متنفر باشند، ممکن است هر کاری بکنند، اما وقتی میبینید آدمها این طرف و آن طرف یکییکی نقش زمین میشوند... بسیار ترسناک است.»
Today, I’m excited to formally announce @mirendil with my amazing co-founders Harsh Mehta, Shayan Salehian, and Tara Rezaei!
We’re fortunate to work with @a16z and @kleinerperkins, who led our seed round of $200M, followed by a major investment from NVIDIA, among others.
Mirendil exists to accelerate science and technology, and through them, to help solve humanity's most pressing problems.
Self-accelerating AI R&D is the most direct path to delivering on AI's broader promise, which is why we believe the most important application of AI is AI itself. Get this loop right, and it compounds. It fundamentally changes the rate of progress itself across all domains.
We believe this capability should be democratized. It should be used to power all scientific efforts trying to innovate at the frontier. There are far more important problems—and broader ones—than any single lab can take on, so more groups should be able to pursue them.
This pulls concentration of power away from a few labs: businesses and science labs can own their AI and infrastructure, keep their margins, and control their own destiny instead of ceding it all to a single AI lab.
We’re a small team with a singular focus. Our founding team consists of 20 researchers and engineers from frontier institutions including Anthropic, xAI, Google DeepMind, and OpenAI, united by a passion for science and a drive to build the technologies that move it faster. If you want to build the system that builds systems, join us!
@HarshMeh1a, @shayan_, @tararezaeikh