When the last tweet is stored, and the last cluster scaled to 10PB, you will realize that you don't want to batch process all that stuff.