then it's a bit surprising that you cannot store a full disk worth of data, because you don't have enough mem for the index.