EgorBo

Principal Engineer at Microsoft

[EgorBo @EgorBo]

A single .md file with tips & tricks for high-performance .NET/C# code, mostly meant for AI, and mostly aimed at benchmarks against the crustaceans 🙃 https://t.co/Z6UB7q8eip (no unsafe!)

Contributions welcome if anything's missing, cc @axeng200 @ben_a_adams

[EgorBo @EgorBo]

@ShareX I hope that account will be banned

[EgorBo @EgorBo]

@totoche

[EgorBo @EgorBo]

.NET does the right thing already:

[EgorBo @EgorBo]

Opened a small PR to make LLVM use SIMD for fixed-length memcmp calls on arm64. Current codegen is a bit suboptimal: https://t.co/uC3Kwwa20b (up to 2x slower than SIMD)

Not sure it'll get reviewed amid the flood of contributions, though 😅 PR: https://t.co/eompMNgO70

[EgorBo @EgorBo]

@SebAaltonen Mac have no fp4 acceleration and prefill is quite slow, I doubt you can get anything usable on 4 of them.

[Ben {chmark} Adams ⟠ @ben_a_adams]

C# is 4th in open source contributions (behind typescript, python, javascript)

#dotnet https://t.co/UouMSrjwCP

[EgorBo @EgorBo]

@voroninp @nietras1 I think it was nearly impossible to make it 100% secure and reliable

[EgorBo @EgorBo]

@mitchellh A tweet from Apr 28🤔

[EgorBo @EgorBo]

@4osp3l @JB_Hannibal Right, although, nowadays an average bug-hunter is just "hey glm, go find bugs", then "here are the 10 slop bugs I found, give me my 10000$"

[EgorBo @EgorBo]

Added a bonus prompt to check a library for safety issues before adding it as a dependency: https://t.co/tXqr7dfvR8

If it flags lots of issues in yet another blazing-fast lib full of unsafe code, consider a safer alternative 😐

[EgorBo @EgorBo]

@_neonsunset @neuecc @James_M_South It kind of makes sense, doesn't it? PGO allows jit to spend extra efforts in hot blocks and inline a lot less in cold ones. In NAOT without a profile (note: AOT fully supports PGO) there are no cold regions - we can't inline less to inline more 🤷

[EgorBo @EgorBo]

@aw0lid 🫡

[EgorBo @EgorBo]

@buybackoff @axeng200 @ben_a_adams You can make a helper that Slices a span to the point data is aligned (GC can move it & change the alignment, but it's a rare event and shouldn't be a correctness issue). But we might get the API eventually too. It's just that GC overall doesn't support custom alignment.

[EgorBo @EgorBo]

A single .md file with tips & tricks for high-performance .NET/C# code, mostly meant for AI, and mostly aimed at benchmarks against the crustaceans 🙃 https://t.co/Z6UB7q8eip (no unsafe!)

Contributions welcome if anything's missing, cc @axeng200 @ben_a_adams

[EgorBo @EgorBo]

@xoofx This one is quite unusual https://t.co/GiTByqHRyG (but I understand what you mean, hopefully one day it gets better)

[EgorBo @EgorBo]

@ben_a_adams @neuecc The first one is just the local harness listed as a co-author 😉 Does anybody still write code by hand?

[EgorBo @EgorBo]

@neuecc From my experience:
Making a faster STJ: 10% of efforts
Making it compliant, secure, extendable, handle all edge cases: 90% of efforts

[EgorBo @EgorBo]

@haefeledev https://t.co/GiTByqIpoe

[EgorBo @EgorBo]

@haefeledev I think the frontier model/harnesses are that good enough. The question is only the budget you're willing to spend (sometimes you can explicitly tell it how many and of what model subagents it should use)

[EgorBo @EgorBo]

@haefeledev Nothing smart, fairly simple prompt: https://t.co/h63AxoKyRK