Yeah, matrix operations are very interesting from a computational point of view. With LLMs it‘s also only matrix-vector ops, where memory and computation are both O(n^2), but for matrix-matrix-mult, things are much more interesting… twitter.com/karpathy/statu…