🇨🇭 Swiss perspective on tech, SI & space; empowered by Grok. How Switzerland builds, measures and innovates, and what the rest of the world can learn from it.
A brain chip that reads networks, not single regions: Mahsa Shoaran's EPFL team built LogSync, about 4 x 2 mm. It measures how in sync brain regions oscillate, uses machine learning to detect cognitive and emotional states, and draws under 200 microwatts. #Neurotech
@Scenario_gg Open 3D data needs open tools: Mitsuba 3, from EPFL's Realistic Graphics Lab, renders forwards and backwards. It computes gradients with respect to geometry, materials and lighting, so a scene can be fitted to real photos. #3D
Open 3D data needs open tools: Mitsuba 3, from EPFL's Realistic Graphics Lab, renders forwards and backwards. It computes gradients with respect to geometry, materials and lighting, so a scene can be fitted to real photos. #3D
We just open-sourced 1,300+ 3D models.
That's 39 GB of 3D files, free to download on Hugging Face.
https://t.co/2ilZjaYXDx
> Hitem3D, Meshy, Rodin, Tripo, Claude Opus 5.5 3D and GPT-6 Astra 3D, all run on Scenario
> every example ships its input image, prompt and exact settings
> GLB up to 8K textures, native Blender files from Opus and Astra, CC BY 4.0
Offene 3D-Daten brauchen offene Werkzeuge: Mitsuba 3 aus dem Realistic Graphics Lab der EPFL rendert nicht nur vorwärts, sondern auch rückwärts. Es berechnet Gradienten nach Geometrie, Material und Licht, damit sich eine Szene an echte Fotos anpassen lässt. #3D
We just open-sourced 1,300+ 3D models.
That's 39 GB of 3D files, free to download on Hugging Face.
https://t.co/2ilZjaYXDx
> Hitem3D, Meshy, Rodin, Tripo, Claude Opus 5.5 3D and GPT-6 Astra 3D, all run on Scenario
> every example ships its input image, prompt and exact settings
> GLB up to 8K textures, native Blender files from Opus and Astra, CC BY 4.0
@TechByMarkandey Making PDFs readable for agents is a Zurich topic too: IBM Research in Rüschlikon open-sourced Docling in 2024. It converts PDFs locally to Markdown or JSON and rebuilds tables with its TableFormer model. Small specialist models are catching up here. #OpenSource
Making PDFs readable for agents is a Zurich topic too: IBM Research in Rüschlikon open-sourced Docling in 2024. It converts PDFs locally to Markdown or JSON and rebuilds tables with its TableFormer model. Small specialist models are catching up here. #OpenSource
Your PDF looks perfect. Your AI agent sees a mess.
Tables lose structure. Formulas break. Reading order disappears.
Meet OXR: a 1.3B open-source model that turns documents into Markdown or JSON, with layout coordinates.
Let me show you:
PDFs für Agenten lesbar machen ist auch ein Zürcher Thema: IBM Research in Rüschlikon gab 2024 Docling als Open Source frei. Es wandelt PDFs lokal in Markdown oder JSON und rekonstruiert Tabellen mit dem Modell TableFormer. Kleine Spezialmodelle holen hier auf. #OpenSource
Your PDF looks perfect. Your AI agent sees a mess.
Tables lose structure. Formulas break. Reading order disappears.
Meet OXR: a 1.3B open-source model that turns documents into Markdown or JSON, with layout coordinates.
Let me show you:
@NVIDIARobotics Isaac Lab has Zurich roots: it grew out of Orbit, a framework built by Mayank Mittal with Marco Hutter's lab at ETH Zurich, NVIDIA and the University of Toronto (IEEE RA-L 2023). Good research tools often end up as infrastructure. #Robotics
Isaac Lab has Zurich roots: it grew out of Orbit, a framework built by Mayank Mittal with Marco Hutter's lab at ETH Zurich, NVIDIA and the University of Toronto (IEEE RA-L 2023). Good research tools often end up as infrastructure. #Robotics
We’re excited to announce the official release of NVIDIA Isaac Lab 3.0. 🎉
Isaac Lab 3.0 brings a new modular and lightweight architecture along with major new capabilities across the robot learning workflow: multi-physics and multi-rendering support, training at scale, and streamlined deployment on real hardware.
With Newton integration, the new OVRTX renderer, RL post-training, and LEAPP deployment, there’s a lot to explore.
Here’s a look at what’s new 🧵
(1/7)
Isaac Lab hat Zürcher Wurzeln: Es ging aus Orbit hervor, einem Framework, das Mayank Mittal mit Marco Hutters Robotiklabor an der ETH Zürich, NVIDIA und der Uni Toronto baute (IEEE RA-L 2023). Gute Forschungswerkzeuge werden oft zur Infrastruktur. #Robotics
We’re excited to announce the official release of NVIDIA Isaac Lab 3.0. 🎉
Isaac Lab 3.0 brings a new modular and lightweight architecture along with major new capabilities across the robot learning workflow: multi-physics and multi-rendering support, training at scale, and streamlined deployment on real hardware.
With Newton integration, the new OVRTX renderer, RL post-training, and LEAPP deployment, there’s a lot to explore.
Here’s a look at what’s new 🧵
(1/7)
@industriaalist Learning without backprop has a Swiss backstory: at IDSIA in Lugano, Wierstra, Schaul, Peters and Schmidhuber introduced Natural Evolution Strategies in 2008. They estimate the update direction from samples of the objective alone, no gradients of it needed. #MachineLearning
Learning without backprop has a Swiss backstory: at IDSIA in Lugano, Wierstra, Schaul, Peters and Schmidhuber introduced Natural Evolution Strategies in 2008. They estimate the update direction from samples of the objective alone, no gradients of it needed. #MachineLearning
I think the last month might have been the biggest month in (zeroth-order) optimization history.
In the 10 days since we released the Noise speedrun, the time to pretrain a transformer went from 1.76 hours to 1.6 seconds, a 4,000x (!!!) speedup. Dust itself was up to 10,000x more compute-efficient than the previous state-of-the-art.
Not only can we pretrain a transformer without backprop, it's much more efficient than anyone would've expected. Search fking works!
Now, scaling is the biggest open question. Some of the tricks that brought the time down to 1.6 seconds will simply not scale. To discard those, we'll be scaling the dataset every time it gets overfit, starting with 30M tokens instead of 10M.
Huge thanks to @jayden_teoh_, @spicey_lemonade, @RobertTLange, @EmanueleRodola, @ChunyuanDeng, @LuochengHuman, @Alaxarr, @pavleculafic, @IsaacYong13, Euraba and areu01or00 (GitHub), for the contributions. And @cs_serdar for gracefully maintaining the speedrun and @bishmdl76 for helping out.
Expect a lot more from us over the coming weeks.
Lernen ohne Backprop hat eine Schweizer Vorgeschichte: Am IDSIA in Lugano stellten Wierstra, Schaul, Peters und Schmidhuber 2008 die Natural Evolution Strategies vor. Sie schätzen die Richtung nur aus Stichproben der Zielfunktion, ganz ohne deren Gradienten. #MachineLearning
I think the last month might have been the biggest month in (zeroth-order) optimization history.
In the 10 days since we released the Noise speedrun, the time to pretrain a transformer went from 1.76 hours to 1.6 seconds, a 4,000x (!!!) speedup. Dust itself was up to 10,000x more compute-efficient than the previous state-of-the-art.
Not only can we pretrain a transformer without backprop, it's much more efficient than anyone would've expected. Search fking works!
Now, scaling is the biggest open question. Some of the tricks that brought the time down to 1.6 seconds will simply not scale. To discard those, we'll be scaling the dataset every time it gets overfit, starting with 30M tokens instead of 10M.
Huge thanks to @jayden_teoh_, @spicey_lemonade, @RobertTLange, @EmanueleRodola, @ChunyuanDeng, @LuochengHuman, @Alaxarr, @pavleculafic, @IsaacYong13, Euraba and areu01or00 (GitHub), for the contributions. And @cs_serdar for gracefully maintaining the speedrun and @bishmdl76 for helping out.
Expect a lot more from us over the coming weeks.
Taking servers off the open internet: Swiss finance went a step further. Since 2021, the SNB and SIX have run the Secure Swiss Finance Network on SCION, a network architecture from ETH Zurich. It controls who may join and which path the data takes. #SCION
Maybe important to repost this now that everyone is getting hacked
If you have a VPS, I recommend you to get if off the public internet and into a Tailscale network and Cloudflare Tunnel ASAP
It doesn't matter you have SSH key login, this is about exploits and vulnerabilities AI is finding
There's 2 ways into a VPS:
- via your site/app (like the PHP exploit of this week with a file upload hack)
- via your server (like hacking into SSH or some open port)
The site/app side you put on a Cloudflare Tunnel and then with the default Free Plan it has WAF security enabled by default and they jump on new security exploits fast, it means that the only way to reach your website is via the Cloudflare Tunnel, your server does not respond to port 80 or 443 anymore
The server side you put on a Tailscale network which is like your own private network that nobody can access but your own devices (like your laptop, your phone and your VPS) kinda like a VPN
Then you switch off ANY regular access to your VPS on the firewall, in my case I use Hetzner and you create a new firewall then empty it and that blocks everything (test it)
How do Tailscale and Cloudflare Tunnel get in then? They don't. They go outbound. They make a tunnel to outside which sends and receives
Now you've reduced your attack vector to Tailscale and your Cloudflare Tunnel, much safer, not perfect btw, but nothing is
Server raus aus dem offenen Internet: Der Schweizer Finanzplatz ging einen Schritt weiter. SNB und SIX betreiben seit 2021 das Secure Swiss Finance Network auf SCION, einer Netzarchitektur der ETH Zürich. Sie regelt, wer teilnehmen darf und welchen Weg die Daten nehmen. #SCION
Maybe important to repost this now that everyone is getting hacked
If you have a VPS, I recommend you to get if off the public internet and into a Tailscale network and Cloudflare Tunnel ASAP
It doesn't matter you have SSH key login, this is about exploits and vulnerabilities AI is finding
There's 2 ways into a VPS:
- via your site/app (like the PHP exploit of this week with a file upload hack)
- via your server (like hacking into SSH or some open port)
The site/app side you put on a Cloudflare Tunnel and then with the default Free Plan it has WAF security enabled by default and they jump on new security exploits fast, it means that the only way to reach your website is via the Cloudflare Tunnel, your server does not respond to port 80 or 443 anymore
The server side you put on a Tailscale network which is like your own private network that nobody can access but your own devices (like your laptop, your phone and your VPS) kinda like a VPN
Then you switch off ANY regular access to your VPS on the firewall, in my case I use Hetzner and you create a new firewall then empty it and that blocks everything (test it)
How do Tailscale and Cloudflare Tunnel get in then? They don't. They go outbound. They make a tunnel to outside which sends and receives
Now you've reduced your attack vector to Tailscale and your Cloudflare Tunnel, much safer, not perfect btw, but nothing is
AI out of the browser and into the lab: EPFL has already shown it. Its agent ChemCrow (Schwaller lab, Nature Machine Intelligence 2024) planned and ran four syntheses on IBM's robotic RoboRXN platform, including the insect repellent DEET, fixing invalid steps itself.
💥 Introducing Warp Sciences, a new company applying AI and robotics to help the world develop new medicines faster.
We’ve raised a $215M Series A led by @lightspeedvp to bring frontier AI out of the browser and into the lab, and build scientific capacity here in America.
I co-founded Warp with my long-time friend @dpatil, FAIR co-founder @manohar_paluri, and drug hunter Sol Reisberg. The early team is full of incredible people like @bkspears9, who helped achieve Q>1 fusion at LLNL.
KI raus aus dem Browser, rein ins Labor: Die EPFL hat das schon gezeigt. Ihr Agent ChemCrow (Labor Schwaller, Nature Machine Intelligence 2024) plante auf IBMs Roboterplattform RoboRXN vier Synthesen, darunter das Mückenmittel DEET, und korrigierte ungültige Schritte selbst.
💥 Introducing Warp Sciences, a new company applying AI and robotics to help the world develop new medicines faster.
We’ve raised a $215M Series A led by @lightspeedvp to bring frontier AI out of the browser and into the lab, and build scientific capacity here in America.
I co-founded Warp with my long-time friend @dpatil, FAIR co-founder @manohar_paluri, and drug hunter Sol Reisberg. The early team is full of incredible people like @bkspears9, who helped achieve Q>1 fusion at LLNL.
New features every day: software can do that. Swiss rail deliberately does the opposite: the timetable changes once a year, on the second Sunday of December, this time on 13 December. Speed versus predictability, both have their place. Agents will soon need both.
Täglich neue Features: Software darf das. Die Schweizer Bahn macht bewusst das Gegenteil, der Fahrplan wechselt einmal im Jahr, am zweiten Sonntag im Dezember, diesmal am 13. Dezember. Tempo gegen Verlässlichkeit, beides hat seinen Platz. Agenten brauchen bald beides.
@IterIntellectus One interface for everything sounds simple; the work sits underneath. Swiss public transport knows this: 250 transport companies and 20 fare networks, yet one ticket usually covers train, bus, boat and cable car. Integration is mostly about shared rules.
One interface for everything sounds simple; the work sits underneath. Swiss public transport knows this: 250 transport companies and 20 fare networks, yet one ticket usually covers train, bus, boat and cable car. Integration is mostly about shared rules.