Premorbid cognitive testing predicts the onset of dementia and Alzheimer’s disease better than and independently of APOE genotype
- 1Institute of Psychiatry, King’s College London, London, UK
- 2Department of Psychiatry, Royal Free and University College Medical School, London
- Correspondence to: Professor M Prince Epidemiological Psychiatry, Institute of Psychiatry, De Crespigny Park, London SE5 8AF, UK;
- Received 16 September 2003
- Accepted 14 November 2003
- Revised 9 November 2003
Objective: To determine whether a cognitive test package can predict the onset of dementia up to 11 years later, and the extent to which this prediction is independent of that provided by APOE genotype.
Methods: Prospective cohort study based on 54 general practices in the UK; 657 survivors of the 1088 participants in the MRC treatment trial of hypertension in older adults were followed for up to 11 years; 370 participants (57% of survivors) were traced, screened for dementia, and genotyped for APOE in 1994. Baseline assessments included trail making test A, paired associated learning test, Raven’s progressive matrices, and national adult reading test. At follow up, both mini-mental state examination and CAMCOG were used. Outcome measures were DSM-IIIR dementia and NINCDS-ADRDA possible and probable Alzheimer’s disease.
Results: All the cognitive tests completed in 1983 predicted onset of dementia and Alzheimer’s disease up to 11 years later, as did APOE genotype. Cognitive test performance was not associated with APOE genotype. Addition of cognitive tests increased the area under the ROC curve for the prediction of Alzheimer’s disease provided by age, family history, and APOE genotype (0.81 v 0.69, p = 0.048); addition of APOE genotype did not increase the area under the ROC curve for the prediction provided by age, family history, and cognitive tests (0.81 v 0.77, p = 0.28).
Conclusions: Simple tests of cognitive ability provide useful predictive information up to a decade before the onset of dementia. The predictive information provided is independent of, but not enhanced by, the addition of APOE genotype.
- AGECAT, aged geriatric examination computer-assisted taxonomy
- CAMCOG, Cambridge cognitive examination
- GMS, geriatric mental state
- MMSE, mini-mental state examination
- NART, new adult reading test
- NINCDS-ADRDA, National Institute of Neurological and Communicative Disorders and Stroke–Alzheimer’s Disease and Related Disorders Association
- PALT, paired associate learning test
- RPM, Raven’s progressive matrices
- ROC, receiver operating characteristic
- TMT, trail making test
True predictive tests for dementia and Alzheimer’s disease, which are the focus of the current analysis, differ from confirmatory or screening tests in that at the time when the tests are applied the disease is not diagnosable by standard procedures, and its clinical features cannot be discerned. However, the underlying pathological process may already have been set in train, markers of this process may be apparent, salient risk exposures may be measured, and the diagnosis may thus have the potential to be brought forward in time (fig 1). The clinical rationale for predictive tests is that, at least hypothetically, a critical period for intervention may lie between the earliest point at which the diagnosis can be made (point 1 in fig 1) and the time at which diagnosis is currently made (point 2). Of course if the critical period for intervention falls after point 2, or before point 1, then there would be no point in advancing the diagnosis. Evidence suggests that the pathological features of Alzheimer’s disease are already well advanced at the time when the diagnosis is made.1 Current pro-cholinergic pharmacotherapies appear to be purely symptomatic, but compounds with the potential to slow disease course may be developed in the future. Such compounds are likely to have maximum efficacy when applied before extensive and irremediable damage has occurred, and hence before the disease is clinically manifest. While several studies have indicated that cognitive tests can provide a moderate degree of prediction for dementia,2 few have investigated prediction over a longer period, within which the critical period for intervention may lie.3,4
In the Medical Research Council trial of treatment of hypertension in older adults5 (henceforward referred to as the MRC trial), a cognitive test battery was administered to all participants on recruitment in 1983 or 1984, and dementia was an exclusion criterion. We showed that a simple test package—derived from cognitive test performance, age, and a family history of dementia—was a useful predictor of dementia onset over the first eight years of follow up.6 Three years later we returned to the same cohort, aiming to identify newly incident cases of dementia and to determine the APOE genotype. The questions to be addressed were as follows:
Do cognitive tests completed in 1983 continue to predict onsets of dementia up to 12 years later?
Is the prediction by cognitive tests independent of APOE genotype?
Does knowledge of APOE genotype add usefully to the predictive power of a test package based upon age, family history of dementia, and cognitive test performance?
Study design and participants
The individuals included in this analysis had all been recruited into the MRC trial between 1983 and 1984.5 Dementia status was assessed in 1991 for the purposes of a dementia case–control study,7 and finally again in 1994.8 The methods used in each of these studies have already been described in the referenced publications. In brief, the MRC trial compared mortality and morbidity among 4396 subjects randomised to receive a β blocker, a thiazide diuretic, or placebo.5 Inclusion criteria were age 65 to 75 years and systolic blood pressure 160 to 209 mm Hg. Those with serious intercurrent illnesses, including dementia, were excluded. Participants were recruited in 226 United Kingdom MRC general practice research framework practices. Invitations for screening had been sent to all registered patients within the eligible age range. In 1991 we reviewed a subsample of 1545 participants from 71 of the 226 practices in an attempt to ascertain all cases of dementia and Alzheimer’s disease incident since the beginning of the MRC trial.7 In 1994 we updated this procedure by aiming to screen all surviving participants from the practices included in the earlier case–control study.7 In the event, 54 practices were still attached to the MRC GP framework and were willing to take part in the follow up.
As previously reported,8 of the initial cohort of 1088 subjects recruited in these 54 practices, 431 had died; of the 657 survivors, 158 (24%) declined to participate in the follow up survey, and 112 (17%) had moved away from their research practice; thus 387 subjects participated and blood samples were obtained from 370, constituting 56% of survivors and 34% of the entire cohort. Figure 2 shows a summary of the sampling process. Those successfully followed up in 1994 differed systematically from those who had refused to participate, who tended to have lower premorbid intelligence and poorer performance on cognitive tests at entry to the trial than did other groups. The mean (SD) age of the achieved sample was 80.1 (2.9) years (range 74.2 to 85.6) at the mid-point of the re-survey.
Dementia diagnosis in 1994
We used a standard three stage dementia diagnosis procedure. The MRC research nurse first administered the mini-mental state examination (MMSE)9 to all consenting participants. All those who scored less than 25/30, and all those educated beyond the age of 16 who scored less than 27/30, were selected for the second stage. A research psychiatrist visited the practice to make a dementia diagnostic assessment comprising the GMS/AGECAT clinical interview,10 the CAMCOG cognitive test battery,11 and a brief standardised neurological examination.12 A structured assessment of the onset and course of the disorder, consistent with current dementia subtype diagnostic criteria, was administered to an informant who knew the participant well. Diagnoses were allocated by a consensus panel of old age psychiatrists applying standard research diagnostic criteria for dementia,13 possible and probable Alzheimer’s disease,14 and vascular dementia.15 For the 370 participants with complete data, the consensus panel assigned diagnoses as follows: 18 (4.9%) probable Alzheimer’s disease, six (1.6%) possible Alzheimer’s disease, five (1.4%) vascular dementia, one (0.3%) mixed dementia (Alzheimer’s disease with vascular dementia), four (0.8%) dementia subtype unspecified, and seven (1.9%) borderline cases with no clear consensus on diagnosis. The prevalence of Alzheimer’s disease in this sample was therefore 6.5%, and the prevalence of dementia 9.0%, or 10.9% including borderline cases.
APOE genotype was determined from blood samples obtained from consenting survivors during the course of the 1994 follow up.8 The frequencies of the APOE genotypes in the whole sample were as follows: 2/2, three (0.8%); 2/3, 40 (10.8%); 3/3, 221 (59.7%); 2/4, seven (1.9%); 3/4, 97 (26.2%); and 4/4, two (0.5%). Therefore 28.6% had one or more ϵ4 alleles, 59.6% were ϵ3/3, and 11.6% were ϵ2/2 or 2/3. The APOE genotype was strongly associated with both dementia and Alzheimer’s disease diagnoses in 1994.8 The prevalence of all dementia rose from 4.7% among those with a 2/2 or 2/3 genotype to 9.0% for those with 3/3 and 17.0% for those with any e4 allele (χ2 = 6.3, p = 0.012). For NINCDS/ADRDA probable and possible Alzheimer’s disease, the association was even stronger, with a prevalence of 2.4% among those with a 2/2 or 2/3 genotype, rising to 4.7% for those with 3/3 and 12.9% for those with any e4 allele (χ2 = 7.6, p = 0.006).
The predictive test variables
Assessment of cognitive function at entry to the MRC trial
The following assessments were used:
The paired associate learning test (PALT).16 This tests the capacity to recall the second half of a pair of words cued by the first half of the couplet, thus addresses episodic memory.
The trail making test (TMT), part A.17 This tests attention, concentration, and psychomotor function. Subjects are timed while they join consecutive numbers, arranged at random.
The new adult reading test (NART).18 This is a stable measure of premorbid (crystallised) intelligence.
Raven’s progressive matrices (RPM) parts A and B.19 These are tests of non-verbal (fluid) intelligence, sensitive to age related cognitive decline.
All tests were administered by MRC general practice research framework research nurses who had been specifically trained for the purpose. The PALT and the TMT were administered repeatedly through the MRC trial; the mean of the entry and one month assessments was used in this analysis. The NART and RPM were measured at entry to the trial only.
Family history of dementia
Family history of dementia was assessed from a questionnaire administered both to the subject and to a reliable informant in the 1994 follow up study. Vital status, current ages or ages at death, and dementia histories were systematically ascertained for all first degree relatives. A family history of dementia loading was derived taking into account both the numbers of relatives affected and the family person-years at risk for the disease.8
To assess the likely independence of the prediction of dementia onset by the cognitive tests from that provided by APOE genotype, we first assessed the association between APOE and each of the four cognitive tests using one way ANOVA, with ξ2 as a measure of the effect size for the association. We used identical analyses to assess the associations between APOE genotype and both age and family history of dementia loading.
We then compared mean entry (1983) cognitive test scores for those who were and were not found to have dementia or Alzheimer’s disease at the 1994 follow up. Given the long follow up period, we explored heterogeneity of prediction by time of onset by stratifying 1994 dementia cases into two groups according to onset before or after the first 1991 follow up. Identical analyses were carried out for the family history of dementia loading and for age. To facilitate comparison of discrimination between tests, all mean differences were standardised, expressed as a proportion of the standard deviation of the relevant variable. Predicted standardised mean differences between dementia cases and non-cases are also presented after adjusting for APOE genotype, and after adjusting for years of education.
We next predicted probabilities of Alzheimer’s disease and dementia caseness for each participant from the following logistic regression models:
Age and family history of dementia loading
Age and family history of dementia loading and APOE genotype
Age and family history of dementia loading and cognitive tests
Age and family history of dementia loading and cognitive tests and APOE genotype
For the purposes of these analyses the distribution of each cognitive test, and of age and family history loading, was divided into thirds, and APOE genotype into 2/2 or 2/3, 3/3, and 4/*. The sample was divided into tenths according to subjects’ predicted probability of caseness, and the sensitivity and specificity for the diagnosis calculated at each decile cut off point. Sensitivity was then plotted against 1−specificity (false positive rate) to produce a receiver operating characteristic (ROC) curve. Using non-parametric procedures,20 the area under each curve was calculated, with 95% confidence intervals, as an overall measure of the discriminability of the test package. The discriminability of pairs of test packages was compared statistically using z tests.21 For both dementia and Alzheimer’s disease we compared test packages 2 v 1, 3 v 1, and 3 v 4. All ROC analyses were carried out using ROC Analyzer software.22
Association between APOE genotype and cognitive test performance in 1983
None of the cognitive tests completed in 1983 before any of the participants had gone on to develop dementia was associated to any degree with APOE genotype (table 1). There was also no association in subgroups consisting of those who did and did not go on to develop dementia. There was a non-significant trend for an association between APOE genotype and both age and family history of dementia loading in the direction 2/2 or 2/3 (oldest, and lowest family history loading), 3/3 (intermediate), and 4/* (youngest, and highest loading).
Associations between cognitive test performance in 1983 and dementia onset by 1994
Each of the cognitive tests completed at entry to the MRC trial in 1983 predicted onset of dementia and Alzheimer’s disease by 1994, with poorer test performance among those who went on to develop dementia (table 2). Patterns of prediction were similar for the 41 dementia cases and the subset of 24 Alzheimer’s disease cases. Likewise, patterns of prediction were similar for the seven cases of dementia with onset between 1983 and the 1991 follow up, and the 34 with onset between 1991 and 1994 (results not shown). The TMT-A gave the most marked discrimination, with around 0.6 SD difference between baseline times for test completion. Next came the two tests of general intelligence, the NART (crystallised intelligence) and RPM (fluid intelligence), each with around 0.5 SD difference, and the PALT with 0.25 SD difference. The difference on the PALT was not statistically significant at the 5% level. Given that PALT scores, unlike the other cognitive tests, were heavily negatively skewed, with 35% of subjects scoring the maximum of 18 at baseline and one month assessments, we also tested using the non-parametric Mann–Whitney procedure for associations with dementia onset (p = 0.26) and Alzheimer’s disease onset (p = 0.70).
The standardised mean differences on the four cognitive tests between those experiencing and those not experiencing a later onset of dementia were little altered after adjusting for APOE genotype (table 2). The findings for the adjusted mean differences between Alzheimer’s disease cases and non-cases were similar (results not shown). After adjusting for years of education, mean differences on the RPM and NART were somewhat attenuated and no longer statistically significant at the 5% level; TMT-A was little affected.
The odds ratios for the independent associations of the test variables with dementia outcome for three of the four predictive models are given in table 3. These three models form a hierarchy, and tests of statistical significance were done for each block. Family history and age were minimally predictive. The four cognitive tests made the largest contribution, with TMT-A predominating and PALT showing a very weak non-significant trend for higher risk with better test performance. APOE genotype still predicted dementia onset (χ2 = 6.8, 2 df; p = 0.03) after adjusting for age, family history of dementia, and cognitive test scores in 1983. Results for prediction of Alzheimer’s disease onset were similar and are not shown in detail: age and family history were again little associated (χ2 = 3.3, 4 df; p = 0.51); cognitive tests were strongly associated (χ2 = 19.7, 8 df; p = 0.01) although again the PALT made little independent contribution; and APOE genotype predicted Alzheimer’s disease onset (χ2 = 9.7, 2 df; p = 0.008) somewhat more robustly than it had predicted dementia onset. The ROC curves for each of the four predictive models are given for dementia (fig 3) and Alzheimer’s disease (fig 4).
While several studies2,23–28 have reported the ability of tests of cognitive ability to predict the onset of dementia in the short term, few have studied this phenomenon over a period of 10 years.3,4 The large majority of our dementia cases experienced an onset of the condition seven years or more after the tests were administered. This is also the first community based study to look at the combined effect of cognitive tests and APOE genotype in predicting dementia.
Cognitive tests completed in 1983, when all subjects were free of dementia, predicted robustly which among those who survived went on to develop dementia by 1994. We used APOE as a potential predictive factor not only for Alzheimer’s disease but for dementia too, given that in 1994 there was uncertainty about the specificity of the association between APOE and Alzheimer’s disease. In our previous report, we found that APOE associated increasingly strongly to dementia, possible Alzheimer’s disease, and probable Alzheimer’s disease, respectively.8 APOE genotype was also a strong predictor of dementia onset, and this prediction was independent of that provided by cognitive tests, and vice versa. All predictive models showed greater discriminability for the specific outcome of Alzheimer’s disease compared with all dementia. Despite the mutual independence of these predictive factors, the areas under the ROC curves—summarising the overall prediction provided by the tests (that is, the greater the area under the curve the better is the test)—were increased to a statistically significant degree when cognitive tests were added to a test package consisting of age and family history of dementia alone, but not when the same test package was extended by the inclusion of APOE genotype. Likewise the area under the ROC curve for age, family history of dementia, and APOE genotype was significantly increased by the addition of cognitive tests, but the ROC curve for age, family history of dementia, and cognitive tests was not significantly increased by the addition of APOE genotype. Thus APOE genotype, although an independent predictor, in practice added little if anything to the discriminability of a test package based upon simple tests of cognitive function administered well before the onset of dementia.
This was a relatively small sample, and an unusual one given the age and high blood pressure levels of all participants, so our results may not reflect the findings expected in a non-hypertensive population. The fact that our sample comprised subjects with mild hypertension may also explain the unexpected finding of an absence of an association between our episodic memory test (the PALT) and cases of dementia, although our finding replicates a previous study that also indicated such lack of association.29 Furthermore, the strength of the association that we observed between APOE genotype and both dementia and Alzheimer’s disease was consistent with that reported by many other previous studies; hence it is unlikely that our conclusions are undermined either by sampling error or by an unusually weak level of association in aged hypertensive subjects. Bias was also unlikely, given that the assessment of cognitive function was carried out blind to APOE status, and vice versa, and both assessments were carried out blind to dementia outcome. Additionally, we cannot rule out the possibility that our screening process may have resulted in false negatives—that is, people with dementia who were not detected by the screening procedure and who might have interfered with our final results. However, we did reinterview thoroughly all possible cases using a high MMSE cut off point of 25 (27 if highly educated) in order to minimise false negatives as a result of our screening.
Why do tests of cognitive ability predict dementia onset over 11 years, and why is this prediction independent of APOE genotype? It is tempting to conclude that subtle premorbid impairment of cognitive ability represents a decline from a previous level of functioning, and is an early marker of the pathological process of Alzheimer’s disease that begins well in advance of the clinical onset.1 However, if cognitive decline is an integral component of the dementia syndrome, how can APOE genotype be a direct risk factor for Alzheimer’s disease and yet not be associated with incipient cognitive decline? Our findings in this respect concur with other evidence—many studies have failed to find an association between APOE and global cognitive decline.30–32 Positive reports for such an association do exist but they have been found to be weak33,34 or circumscribed to specific areas of cognitive decline, mostly semantic memory.35 The model that we have posited, which supposes a continuum between cognitive decline and dementia, cannot be made to fit these observations. An alternative and perhaps more parsimonious explanation is that premorbid tests of cognitive ability are stable markers of early intellectual development—a process that, at least in infants, seems not to be influenced by APOE.31,32
Intellectual development may be related to risk for dementia by one of two processes. First, well developed brains with a richly complex cortical synaptic architecture may be intrinsically less likely to sustain Alzheimer’s disease pathology and the precipitous decline in cognitive ability that accompanies it.36 This theory is supported by the findings from the nuns’ study, in which idea density ascertained from biographies written at the age of 18 was negatively associated not only with late life cognitive impairment in vivo, but also with the density of neurofibrillary tangles at necropsy.37 Second, in the course of the pathological process of Alzheimer’s disease, cognitive or neuronal reserve may delay the onset of clinically relevant cognitive and functional impairment, a theory advanced to explain the consistent observation of a lower risk of dementia among intelligent and well educated people.38 This “reserve hypothesis” predicts more advanced Alzheimer’s disease pathology among the better educated for any given clinical stage of dementia, and is lent support by the finding of increased mortality in better educated persons with dementia, after adjusting for clinical dementia staging.39 APOE genotype might then exert its effect through a different pathway, for example modifying the cumulative impact of a variety of brain insults sustained across the life course.40
Our research suggests that predictive tests for Alzheimer’s disease and other dementias may be an achievable objective, even with existing technologies. Ascertainment of APOE genotype seems to confer no advantage over lower technology cognitive test packages, and earlier cautions against the indiscriminate use of genotyping as a diagnostic or predictive procedure are well founded.41,42 Computed tomography or magnetic resonance imaging, particularly if applied sequentially,43–45 may add usefully to the discriminability of a cognitive test package, but this possibility has not been formally explored. There is as yet no clinical application for a predictive test package with the level of discriminability reported here (50–60% sensitivity with a 10% false positive rate), but this conclusion would change in the event of the introduction of a treatment with the ability to modify the disease course. Epidemiological studies have suggested that both non-steroidal anti-inflammatory drugs46,47 and hormone replacement therapy48,49 might substantially protect against Alzheimer’s disease. New compounds designed to interfere with the amyloid cascade process are also in an advanced stage of development.50 Further research to refine predictive test packages is therefore an urgent priority.
The United Kingdom Medical Research Council supported this study. We thank the MRC Working Party and the MRC Epidemiology and Medical Care Unit (Director Professor T Meade) for allowing us to continue to investigate trial participants, and the MRC General Practice Research Framework general practitioners and research nurses (coordinator Mrs W Browne) for collecting much of the data. APOE genotyping was undertaken at the Institute of Psychiatry by Dr John Powell and Mr Carsten Russ.