Ionel Gog

Machine learning infrastructure @GoogleDeepMind. Previously Postdoc @ucberkeley and PhD @Cambridge_CL.

[Arthur Douillard @Ar_Douillard]

The DiLoCo team at Google DeepMind and Google Research is proud to release Decoupled DiLoCo, the next frontier for resilient AI pre-training.

Decoupled DiLoCo enables training with datacenters across the world, using heterogeneous hardware, and never halting the system despite hardware failures.

[Arthur Douillard @Ar_Douillard]

I'm super excited to release DiPaCo, a new kind of mixture of experts, that can scale engineering-wise to data centers across the entire world!

A few words about it in this thread 🧵

[Google AI @GoogleAI]

Presenting Confident Adaptive Language Modeling (CALM), a novel method that allows language models to dynamically modify computational effort when generating text. Learn how CALM can accelerate text generation while preserving output quality → https://t.co/Nm7yyT8sMA

[Ionel Gog @ICGog]

Paper: https://t.co/WjFpRfF8DG
Execution Engine Code: https://t.co/hrq80VBhNK
Self-driving Car Stack Code: https://t.co/1jCTUuF5tn

[Ionel Gog @ICGog]

Excited to announce that @sukritkalra and @pschafhalter will be presenting at @EuroSys_conf on Thursday our work on developing a new execution model (D3), and an execution engine (ERDOS) that enables autonomous vehicles to adapt and to avoid collisions.

[Ionel Gog @ICGog]

Attend their talk to learn about how we validated our execution engine by building an open-source self-driving car stack, which we deployed both on simulated and real-world cars.
Joint work with the above, @mejoeyg and Ion Stoica.

[Ionel Gog @ICGog]

Our solution enables an application to pick the most appropriate fault-tolerance mechanism for each part of the application, and to combine the chosen fault-tolerance mechanisms such that the application recovers in a globally consistent state in the event of a failure.

[Ionel Gog @ICGog]

At SoCC today, I will be presenting our work (with @m_isard and Martin Abadi) on offering efficient fault-tolerance for complex dataflow applications that combine batch, stream, and iterative processing. #socc21
Paper: https://t.co/zjrfMfQuSN

[Ionel Gog @ICGog]

The paper is available here: https://t.co/c1vFo50HLL, and the code is https://t.co/1jCTUuF5tn in case you want to take Pylot for a spin.

[Ionel Gog @ICGog]

Today in the Unmanned Vehicle award session of #ICRA2021, @sukritkalra will present our work on Pylot, an adaptable platform for developing autonomous vehicles. Our platform provides plug and play modules to deploy AVs in simulation and real-world.

[Peter Schafhalter @pschafhalter]

Working on self-driving cars? Check out our paper on Pylot, a modular pipeline for exploring latency-accuracy tradeoffs in self-driving cars (accepted to ICRA 2021).
https://t.co/EPwnes9FrK

[Jason Karns @jasonkarns]

Bought a mechanical keyboard with more resistance so my code will be strongly typed.

[Ionel Gog @ICGog]

@frankmcsherry @N1R44 Unless you're Rust allergic, I would look into timely dataflow. Naiad hasn't received much care recently :).

[Malte Schwarzkopf @ms705]

Slides for our #osdi18 talk on Noria, a new data-flow system that makes web applications fast, are now available: https://t.co/LZYIm96WlM (joint work with @Jonhoo, @xexd and others). Will take no more than 17 minutes to view, promised!

[Ionel Gog @ICGog]

@siobhcroo I don't get it. Where's the challenge? Strawberry tart FTW.

[Ionel Gog @ICGog]

@JanaGiceva Yes! Maybe, let's try to organize something for next year :)

[Ionel Gog @ICGog]

Interested in AI and ML? Consider applying to the first Transylvanian Machine Learning Summer School, which has a great line-up of lecturers and instructions: https://t.co/r1Fk5s6HB4

[Ionel Gog @ICGog]

@mrry @frankmcsherry @dataArtisans @ApacheFlink Will I see you at the RISELab retreat? :)

[Ionel Gog @ICGog]

@frankmcsherry @dataArtisans @ApacheFlink I've tried to reproduce some of the experiments in the paper. After I configured Flink a bit I observed that Flink's recovery latency is roughly as high Drizzle's, and 10x smaller than the values in Figure 7.

[Ionel Gog @ICGog]

@frankmcsherry @mrry People are free to interpret the "L" however they wish, but they should not forget that Laptopman brings truth, justice, the scientific way!