The Essence of Memory