Marek Siarkowicz

Staff software engineer @Google, @etcdio tech lead in @kubernetesio.

Opinions are my own

[Marek Siarkowicz @serathius]

@Alfieri_Craig @GoogleOSS @AntithesisHQ I'd be thrilled to collaborate on putting etcd to the test. Let's connect and discuss how we can make this happen!

[Kubernetes @kubernetesio]

Final Update for v3.4, plus 3.5.31, 3.6.12 Released - https://t.co/EQFSRjtCH6 #Kubernetes

[Kubernetes @kubernetesio]

etcd v3.7.0-rc.0 Now Available for Testing - https://t.co/bralIUvi4h #Kubernetes

[Kubernetes @kubernetesio]

Announcing etcd 3.7.0-beta.0 - https://t.co/BMw0XV0tdh #Kubernetes

[Kubernetes @kubernetesio]

Kubernetes v1.36: Server-Side Sharded List and Watch - https://t.co/xL8ltDuUOv #Kubernetes

[Kubernetes @kubernetesio]

Kubernetes v1.36: Staleness Mitigation and Observability for Controllers - https://t.co/RfBehbmDHP #Kubernetes

[Google Open Source @GoogleOSS]

Kubernetes is going AI-first! 🚀 We’re proud to support the new Certified Kubernetes AI Conformance program, ensuring AI workloads remain portable and reliable through common, industry-wide standards.

Read more: https://t.co/OVhxOCmgKb #Kubernetes #AI

How is your team scaling AI today?

[Marek Siarkowicz @serathius]

@danielepolencic I would appreciate proper research.

While it is not always easy to get accurate information, open source maintainers don't bite. At least not all of them.

Each community has its own chat and public meetings, where you can ask questions. They would appreciate feedback too.

[Marek Siarkowicz @serathius]

@danielepolencic As a person that worked on 30k node GKE clusters based on etcd, I don't know what this refers to.

If you are interested in scalability topics by people working on the topic watch https://t.co/K7LIjfLIUX

We are also working on 15GB resource size on etcd https://t.co/bnsjF46PyV

[Marek Siarkowicz @serathius]

@danielepolencic Again, you didn't understand the motivation. It's not project A vs project B. It's the fact that AWS journal and Spanner use Atomic clocks for concensus. That allows for clean horizontal scaling of distributed system, don't expect something like this in open source.

[Marek Siarkowicz @serathius]

@danielepolencic Have you ever run etcd in production? Or are you collecting random complaints from the internet from people trying to use etcd with NFS?

Etcd is not perfect, but the fact that some people can struggle with 3 node K8s, while others run 30k without a problem is interesting.

[Marek Siarkowicz @serathius]

@danielepolencic What have watch events to the leader? Totally unrelated.

Watch events are distributed totally outside raft concensus. Also API server demuxes the watch request so that there is just one watch per resource. So number of controllers has no impact on etcd.

https://t.co/BI2UtqtEWx

[Marek Siarkowicz @serathius]

@danielepolencic Here we go again...
8GB is an old limit that was never revisited or updated. Most cloud providers run etcd with 20GB-30GB without much problem.

Usually it's Kubernetes that breaks when you put a lot of data in a single resource or namespace.

Read https://t.co/bnsjF46PyV

[Marek Siarkowicz @serathius]

@xu_paco Repo you linked was used as PoC, the etcd antithesis testing lives in https://t.co/w7takJA3sk

[The New Stack @thenewstack]

Learn how the etcd open source project overcame a significant knowledge drain and reliability issues by implementing deterministic simulation testing.

By @ha_joslyn, thanks to @AntithesisHQ, feat. @serathius https://t.co/xdL1EN0S9t

[Marek Siarkowicz @serathius]

@indygupta Pretty sure this fact was well established over 7 years ago in multiple Reddit posts. Fact that you can doesn't automatically means that you should set limits for all your containers.
Maybe we should give the discussion a rest and just put it in official documentation? @thockin

[Mischa van den Burg @mischavdburg]

I haven't been to an office in 2 years.

I work in my pajamas making multiple six figures.

Thank you, Kubernetes.

[paco xu @xu_paco]

KubeCon Keynote Day 2: etcd + Antithesis https://t.co/GC87VJ5XPc

[Antonio Ojea @Itsuugo]

The future is really collaborative and community driven

[Antithesis @AntithesisHQ]

Today our CEO, Will Wilson, announced a partnership with @CloudNativeFdn to provide free reliability testing for Graduated and Incubating projects. Stop by booth 457 to learn more. @etcdio maintainer @serathius is presenting at 12 today in the Project Pavilion about the work we did together to help advance etcd testing!

[The New Stack @thenewstack]

How do you make a foundational project like etcd truly robust? 🤔 @ha_joslyn sits down with @serathius (@Google) at #KubeCon to discuss how the etcd maintainer community used the challenge of DST to drive better, more rigorous testing.