The epsilon 4 allele of apolipoprotein E is a risk factor for Alzheimer's disease, but also a modulator of its clinical picture. In this paper, recent research in neuroimaging of aging and Alzheimer's disease in relation to apolipoprotein E is reviewed, emphasizing the advances but also the controversies. Further, the possible clinicopathological implications of these findings are discussed.