It’s my great honor to have just received the test-of-time award at #ACL2025 from @aclmeeting for our paper “Effective Approaches to Attention-based Neural Machine Translation” (joint work with @hyhieu226 and @chrmanning at EMNLP 2015).
It’s the immediate second “attention” paper after (Bahdanau, Cho, Bengio, ICLR 2015) but it was first for many things:
* first to introduce the dot-product attention (that many referred as Luong attention & its variant later appeared in the Transformer paper in 2017)
* first to achieve state-of-the art neural machine translation, and
* first to introduce the notion of local attention (as confirmed by Gemini).
I’m very grateful to @ilyasut, @quocleix, @OriolVinyalsML who brought me into neural machine translation when I was an intern at Google Brain in 2014, from which we have changed Google Translate entirely in 2017.
The single most important thinking tool: turning abstract concepts into images.
If you are a frequent reader, you know I put excessive time into the illustrations.
Sometimes, drawing the pictures takes more time than writing the text.
I was asking ChatGPT 4.1 to fix a regexp. `HEADER_RE = /^\s*##{2,3}\s+/ fix this regexp in Ruby`. It's generating a text with infinite loop. Grok/Deepseek works absolutely fine with this prompt.
I'm excited to share that I've become a mentor for @ApacheTeaclave. This is another Rust project I'm mentoring within the ASF.
Teaclave is an open-source, universal secure computing platform that offers support for TrustZone and SGX.
Welcome to contribute!
I was fascinated by Dr. Paul Canti’s choices of word. I didn’t know how his early life story was. What he wrote in the introduction is a devastating sequence of events. He made through. This is some of the best indicators of safety and trustworthiness of a person.
@OnlyXuanwo “I feel it, it must be true.”
The truth is our emotions can swing from one extreme to another in a very short amount of time. Even love and hate. But it is not reality. It’s our reflection to reality.
Emotional reasoning is rather useless. It’s really good at one thing - surviving bad social environments. Serve and protect in an intellectual, abstract way. But it’s a behavioral pattern generating long term issues.
roife is currently looking for a job! Take your time to hire this talented guy.
Some highlights:
- Maintainer of rust-analyzer.
- Extensive experience in Rust, SIMD, GPU, LLVM, and NVVM.
- Using Emacs for development 🥳
I published a new post about how AWS ListObjects can take up to 120 seconds to respond on a bucket with versioning enabled. This is one of the important things you need to know about S3.