RT @lilianweng: 🚜 Cannot believe it is almost 3 years since my 2020 post on variations of Transformer. I spent some time and did a big refa…