Vadim Markovtsev

Founding engineer @poolsideai
Previously principal engineer @athenian and @sourcedtech
Google Developer Expert in ML (2021)

[Vadim Markovtsev @vadimlearning]

@JordanNanos 2/2
- ~100 perf metrics / rank / step to detect problems as early as possible on the application level, including NCCL ops bandwidth control.
- Distributed fault sim with ~30 different problems to test recovering from.

[Vadim Markovtsev @vadimlearning]

@JordanNanos Hey Jordan, we intentionally skipped many technical details from the report. Regarding fault tolerance:
1/2
- We do in-pod recovery. There is no in-process recovery yet, so we lose a few min to reinit.
- Checkpoint locally when we break (you call it just-in-time).

[Vadim Markovtsev @vadimlearning]

@eisokant @BenTheEgg @poolsideai Will be happy to talk about our modifications to adapt it to training LLMs with bf16!

[Eiso Kant @eisokant]

@BenTheEgg thank you from @poolsideai for your reversed mode code from Reformer! @vadimlearning worked on it and it led to 25% memory reduction with only a bit more data needed to converge. Next time you're in Paris, dinner is on us!

[Vadim Markovtsev @vadimlearning]

@viglovikov We are building one.

[Vadim Markovtsev @vadimlearning]

GitHub API sends a "gollum" notification when somebody edits a wiki page. Who knows why LOTR here?

[Vadim Markovtsev @vadimlearning]

I am pleased to announce that I will speak in Python devroom on @fosdem about our experience at @athenian doing low- and high-level Python performance optimizations. Will cover some CPython internals, Cython with C++20, arena allocations with mimalloc.

[Vadim Markovtsev @vadimlearning]

@TUXEDOComputers how about fixing BIOS of InfinityBook Pro Gen7 to repair waking from deep sleep? https://t.co/DGHXi2HmP7

[Vadim Markovtsev @vadimlearning]

I understood CPython arenas thanks to this post: https://t.co/Q1DiPGex3y

[Vadim Markovtsev @vadimlearning]

+1 https://t.co/FCmHKemoNE

[Vadim Markovtsev @vadimlearning]

Cool projects from the latest LinkedIn connections: https://t.co/RQSGrrMIb6 and https://t.co/3PILwlsqwn

[Vadim Markovtsev @vadimlearning]

Wrote a blog post about supercharged asyncpg: https://t.co/uaqPZnf6Su

[Eiso Kant @eisokant]

@jasoncwarner @ncantunes @devleadership_ Here's the full write up, with examples and links to the episode 👇
https://t.co/FmSBr1N3n2

[Vadim Markovtsev @vadimlearning]

Everybody who thinks that Python should ditch reference counting, read Chris Lattner's praise https://t.co/AzGOU203u4

[Justin Duke @jmduke]

congratulations to this google docs PM who is singlehandedly responsible for engendering more developer goodwill than any other individual at Alphabet in the past five years

[Vadim Markovtsev @vadimlearning]

Big thank you to @xkcd for granting permission to use the remixed image in my paywalled blog post https://t.co/OP2Zl5zOAZ

[Lou Marvin Caraig @LMCaraig]

It’s been a while since my last blog post, in the meantime I changed both UI and domain, and added support for comments! And this is my first post in the new blog! I hope you’ll like it!

https://t.co/PzuFw4KdsA

#devops #monitoring #kubernetes #prometheus

[Vadim Markovtsev @vadimlearning]

My new blog post is out! I focus on CI optimizations this time.

[Athenian @athenian]

"My Continuous Integration Takes Too Much Time. How Do I Fix It?" - @vadimlearning explains how to solve this very common issue... so you don't have to twiddle your thumbs (or read r/programming) while you wait for CI checks to finish! 👇
https://t.co/9ZsCZmVCji

[Angus Miller @all4miller]

Some real gold here 👏 "How we optimized PostgreSQL queries 100x" by @vadimlearning in @TDataScience https://t.co/cAWdACDrvR

[Vadim Markovtsev @vadimlearning]

New blog post in TDS that elaborates on my SQL performance tuning at @athenian: https://t.co/I0Mm9cRi0v