This is a really fascinating topic. I remember that GotoBLAS, an implementation in handwritten assembly optimized for cache misses in the Translation-Lookaside-Buffer, that looks up addresses in virtual memory. There's this and much more in cs.utexas.edu/users/pingali/…