Cooperative jfr sampling JDK-8321098 in JVM is like ABS in automobile. If we walk the stack at arbitary position, it is like we slide while wheels lock up. Resuming execution is just like we release brake shortly to avoid a crash (pun intended)
Triton is the 1st programming language I know that has 'blocking' as a language construct. Everybody can write cuda, the real change is how to optimize locality or arithmetic intensity. They will end up with blocking anyway. just think of it in the first place!
Java is a product. We only see a variety of vendors are selling it as technology or a solution. C++ is a region. that's why we see so many gurus are selling service package that help you digest C++.
To get the fixed amount of computation(C) done, $ = C / (perf/TCO) . The cost is directly proportional to TCO(W) and inversely proportional to perf. It's worth noting that we can't take performance for granted if we have custom design. We have to optimize the software stack.
All internet companies want to design their in-house ML accelerators in these days. One key lesson is 3⃣: "design for performance per TCO vs per CapEx". Your "cost-efficient" design should offset nvidia's margin.
if different passes are done by different team or personnel, it's very likely we observe miscommunication or misunderstanding. The number of bug combinatorially relates to the line of code.
Amazon is really good at building distributed systems. They usually use microservice and two-pizza teams. It's dubious that the muscle memory will work again on an optimizing compiler. A compiler pass has implicit interactions with almost downstream passes. Law of power here!
I think nvidia will be fine even this AI bubble busts. In the nutshell, NV is a company that sells parallelism. Parallelism is more cost efficient than concurrency. They excel in areas where they discover massive parallelism. Graphics/Crypto/ML/AI just happen to be the case.
I just realize this inconvenient truth: I am not building a compiler. I am a compiler from the perspective of leadership. We engineers are basically hand-pilers on steroids...