Article Text

PDF

Evaluation of the NINCDS-ADRDA criteria in the differentiation of Alzheimer’s disease and frontotemporal dementia
  1. A R Varmaa,
  2. J S Snowdena,
  3. J J Lloydb,
  4. P R Talbota,
  5. D M A Mannc,
  6. D Nearya
  1. aDepartment of Neurology, bDepartment of Medical Physics, Manchester Royal Infirmary, Manchester, UK, cDepartment of Pathological Sciences, Manchester Medical School, Manchester, UK
  1. Dr AR Varma, Cerebral Function Unit, Neurology Department, Manchester Royal Infirmary, Oxford Road, Manchester M13 9WL, UK. Telephone 0044 161 276 4138; fax 0044 161 276 4681.

Abstract

OBJECTIVES The diagnosis of Alzheimer’s disease (AD) is now reliant on the use of NINCDS-ADRDA criteria. Other diseases causing dementia are being increasingly recognised—for example, frontotemporal dementia (FTD). Historically, these disorders have not been clearly demarcated from AD. This study assesses the capability of the NINCDS-ADRDA criteria to accurately distinguish AD from FTD in a series of pathologically proved cases.

METHODS The case records of 56 patients (30 with AD, 26 with FTD) who had undergone neuropsychological evaluation, brain imaging, and ultimately postmortem, were assessed in terms of whether at initial diagnosis the NINCDS-ADRDA criteria were successful in diagnosing those patients who had AD and excluding those who did not.

RESULTS (1) The overall sensitivity of the NINCDS-ADRDA criteria in diagnosing “probable” AD from 56 patients with cortical dementia (AD and FTD) was 0.93. However, the specificity was only 0.23; most patients with FTD also fulfilled NINCDS-ADRDA criteria for AD. (2) Cognitive deficits in the realms of orientation and praxis significantlyincreased the odds of a patient having AD compared with FTD, whereas deficits in problem solving significantlydecreased the odds. Neuropsychological impairments in the domains of attention, language, perception, and memory as defined in the NINCDS-ADRDA statement did not contribute to the clinical differentiation of AD and FTD.

CONCLUSION NINCDS-ADRDA criteria fail accurately to differentiate AD from FTD. Suggestions to improve the diagnostic specificity of the current criteria are made.

  • Alzheimer’s disease
  • frontotemporal dementia
  • NINCDS-ADRDA criteria

Statistics from Altmetric.com

Accurate clinical diagnosis of the dementias is critical for proper management and assessment of prognosis. With recent advances in therapy and availability of new drugs (for example, donepezil) this exercise is no longer merely academic. The two principal causes of “cortical” dementias are Alzheimer’s disease (AD) and frontotemporal dementia (FTD). FTD is characterised by profound alteration in personality and social conduct and cognitive impairments predominantly in frontal lobe “executive” functions.1 2 By contrast, in AD prominent impairments in the domains of memory, visuospatial functions, and language typically occur in the context of well preserved social skills.3 4 Despite striking differences in their neuropsychological profile there is evidence that clinical differentiation remains poor. For example in a study of 21 patients with pathological confirmation of Pick’s disease (one of the causes of FTD), 85% were misdiagnosed during life, their condition misattributed to AD.5 In another pathological study of 170 patients with a clinical diagnosis of AD, 12% of patients were misdiagnosed during life, of whom 19% were found to have FTD.6

The NINCDS-ADRDA criteria7 have been widely adopted and relied upon for the diagnosis of AD. It is not known whether the use of these criteria alone would effectively exclude FTD. The purpose of the study was to determine the ability of the criteria to specify at initial presentation “probable” AD and to exclude non-AD (FTD) from within a group of those two conditions.

Methods

The case records of 56 consecutive patients with pathological confirmation of either AD or FTD were analysed. All of these patients had been assessed and reviewed systematically during life in the Cerebral Function Unit, Neurology Department at the Manchester Royal Infirmary as part of a prospective longitudinal study of dementia. The findings of neuropsychological assessments8 performed at initial patient presentation were documented by a neurologist (ARV) who was unaware either of the diagnosis or the patient. Information was carefully recorded on standardised forms with respect to (a) mini mental state examination (MMSE)9 test scores and (b) the presence or absence of deficits in each of the neuropsychological domains detailed in the NINCDS-ADRDA statement (table 1)—namely, memory, orientation, language, praxis, attention, perception, problem solving, and activities of daily living and social function. In determining impairment, the rater adhered as closely as possible to definitions of impairment given in the criteria statement. Failure on one or more of the specific cognitive tests recommended by the criteria statement to tap a particular cognitive domain was recorded as evidence of impairment in that domain. For example, a deficit in language was scored as present if failure occurred on any of the specified language tests including verbal fluency and naming tasks. The scoring was conservative. If there was not well established documented deficit then it was scored absent. Whenever possible the reason for the failure was also detailed.

Table 1

Patients showing deficits in individual cognitive domains specified by NINCDS-ADRDA criteria

In addition to the broad domains outlined by the criteria, patients were scored with respect to the more narrowly defined variables of primary language, primary perception, and spatial domains (table 2). A deficit in primary language was defined as impairment in one or more of the linguistic domains of phonology, orthography, morphology, syntax, or lexical semantics. Evidence for impairment was based on the presence of phonemic or semantic paraphasias in conversational speech, repetition or naming tasks, of grammatical errors in spontaneous speech, of impaired syntactic comprehension, or paralexias in reading and spelling errors in writing. Impoverished verbal fluency or word retrieval, in the absence of phonological or semantic errors, was not construed as primary language impairment. The primary language variable was designed to tap impairments attributable to dysfunction in primary cortical language areas and exclude impairments on language tasks secondary to other cognitive deficits. Primary perceptual deficit was defined as a problem in perceptual recognition of objects, line drawings, or faces. Difficulty arising only on complex perceptual tasks such as the Hooper visual test10 involving mental integration of visual information would be excluded as difficulties on such complex tasks could arise for reasons outside the realm of primary perception. Patients were designated to have a spatial deficit if they had observable spatial disorientation as evidenced by difficulty in negotiating the environment, orienting clothing when dressing, localisation of objects, or they failed in spatial tasks (tracking a maze, copying hand postures and line drawings, dot location, and dot counting tasks).

Table 2

Patients showing deficits in cognitive domains not specified by NINCDS-ADRDA criteria

Twenty records were analysed by two independent raters (ARV and JSS) to assess interrater reliability. There was good interrater agreement (κ range 0.6–0.8 for various domains). Missing values were generally low (median 2); this factor is therefore unlikely to affect the interrater reliability scores. The data from a total of 56 case records were available for final analysis. A record was judged to fulfil NINCDS-ADRDA criteria for probable AD if (a) the MMSE score was ⩽ 24 and (b) there were demonstrable deficits in memory and at least one other area of cognition as defined by the criteria statement.

STATISTICS

For the NINCDS-ADRDA criteria and each cognitive domain the sensitivity, specificity, and positive likelihood ratio (LR) (with 95% confidence intervals) for probable AD were calculated.

The sensitivity is the true positive fraction, the fraction of subjects with AD that have a positive test result (have a deficit in that cognitive domain). The specificity is the fraction of subjects that do not have AD and have a negative test result (do not have that particular deficit). The LR11 for a positive test result (+LR) is defined as the ratio of the fraction of subjects having a positive test result who have the disease to the fraction having a positive test result who do not have the disease. This can be expressed as:

+LR= sensitivity   1−specificity

Sensitivity and specificity are commonly used indices of the usefulness of diagnostic tests. However, they have the drawback that they cannot be easily applied to an individual patient. LRs, by contrast, can be applied to an individual patient and have an easily understood meaning—that is, modifying the pretest odds of disease. An LR of 1 indicates that no information has been provided by the test. A value> 1 indicates that the test increases the probability of disease prevalence whereas a value >1 decreases the probability of disease presence. LRs have the advantage that they relate the post-test odds of a disease to the pretest odds in a simple way; post-test odds = +LR × pre-test odds. Odds of a disease is defined as the ratio of the probability of having disease (P) to the probability of lack of disease; odds = P/(1-P). LRs were considered significant only if they differed from 1 with 95% confidence.

Results

Of the 56 patients with pathological confirmation of diagnosis, 30 had AD and 26 FTD. The neuropathological characteristics of these patients have been described previously.12-14 The mean age of onset and duration of illness at initial referral were similar in the two groups (table 3). The mean age of the two groups in this study reflect the referral pattern to a neurological unit. The sex distribution was roughly equal in the AD group whereas males outnumbered females in the FTD group. The mean MMSE score was significantly higher in the FTD group. In the AD group 29 of the 30 patients had an MMSE score ⩽ 24 at the time of initial diagnosis; one of these patients had no demonstrable impairment of his memory. Hence, 28 of 30 patients were considered to fulfil NINCDS-ADRDA criteria for probable AD. In the FTD group 21 of the 26 patients had an MMSE score ⩽24; one of these patients had no demonstrable memory impairment. Hence, 20 of 26 patients were considered to fulfil NINCDS-ADRDA criteria for probable AD. All patients were impaired in their activities of daily living and social function, which had led to their medical referral.

Table 3

Demographic data

The overall sensitivity of the NINCDS-ADRDA criteria in diagnosing AD in this population of patients with cortical dementia (AD or FTD) was 0.93; the specificity 0.23; the LR 1.21 (table 4). The sensitivity, specificity, and LRs for individual cognitive domains are shown in tables 1 and 2. The LR is significantly different from 1 if the value of 1 does not lie within the 95% confidence interval. The five domains for which this was significantly greater than 1 were orientation, praxis, primary language, and spatial and primary perception. For the domain of problem solving the LR was significantly less than 1. All the 20 patients with FTD who fulfilled NINCDS-ADRDA criteria for probable AD would also fulfil current Lund-Manchester criteria for FTD.15

Table 4

Patients fulfilling NINCDS-ADRDA criteria for probable AD

Discussion

The NINCDS-ADRDA Work Group was set up to establish and describe clinical criteria for the diagnosis of AD.7 The authors warned that these criteria were not yet fully operational and that the criteria were to be regarded as tentative and subject to change. Fourteen years later these criteria are still widely used in their original form. Patients who fulfil the NINCDS-ADRDA criteria are accepted as having a clinical diagnosis of probable AD, a practice witnessed in most research publications. Undoubtedly these research practices permeate from published literature to clinical practice.

The validation of these criteria at necropsy have been attempted in several studies, with varying results.6 16-18 The accuracy rate (ratio of the number of pathologically confirmed correct cases of AD to the number of clinically diagnosed cases of AD, expressed as the percentage of clinical diagnosis of probable AD using NINCDS-ADRDA ranges between 65% and 92%.6 However, these accuracy rates have been derived in all these studies for the diagnosis of pathological AD, which includes AD alone and mixed cases (AD pathology plus vascular or Lewy bodies or Parkinson’s disease pathology or other pathology). The rates fall if they are calculated using AD alone pathology as the gold standard, and then vary between 56% and 63%. Needless to say the accuracy rates are even lower for the clinical diagnosis of possible AD. NINCDS-ADRDA criteria are widely applied in the diagnosis of AD. However, the application of these criteria in the differentiation of two cortical dementias, AD and FTD, has never been studied before.

Both Mendez et al 5 and Litvanet al 19 have found that Pick’s disease is often underdiagnosed, the clinical misdiagnosis mainly attributable to AD. It is clear, therefore, that FTD is underdiagnosed and that AD is the commonest misdiagnosis. The diagnostic difficulty is compounded because in both of these disorders the patients are physically well and have few differentiating neurological signs in the early stages of the illness.20 The diagnosis mainly depends on a comprehensive neuropsychological evaluation. However, such assessment also requires a careful qualitative analysis of cognition and behaviour because patients can fail quantified psychometric tests for various reasons.

This study shows that the NINCDS-ADRDA criteria have high sensitivity (0.93), but low specificity (0.23) in the diagnosis of AD among a group of patients with cortical dementias (AD and FTD)—that is, although most patients with AD fulfil clinical diagnostic criteria for AD, so too do most patients with FTD. Furthermore, whether or not a patient fulfils the criteria does not significantly change the odds of that patient having AD as opposed to FTD (the LR is not different from 1 with 95% confidence). These findings suggest that the ability of the criteria to discriminate AD and FTD is relatively poor. However, this study has also shown that the identification of deficits in certain cognitive domains can contribute to the clinical differentiation of AD and FTD; deficits in the realm of orientation in time and place and praxis increase the odds of a patient having AD as compared to FTD, whereas deficits in problem solvingdecrease the odds of a patient having AD as opposed to FTD (table 1). Deficits in the domains of attention, perception, language, and memory (as broadly defined by the NINCDS-ADRDA statement) do not significantly change the odds of a patient having either condition (table 1).

Our patient groups (AD and FTD) were similar for their age of onset and duration of illness at presentation (table 3). Thus any differences found in their neuropsychological deficits could not be accounted for by these factors. The patient population is young, reflecting the referral pattern to a neurological centre. FTD is a disorder more commonly seen in the presenium.20 The clinical features seen in our patients are indistinguishable from those patients referred to a psychogeriatric centre.1 Patients with FTD had a significantly higher MMSE score than the patients with AD (table 3). It is the more striking, given the lesser overall severity of dementia as assessed by this score, that such a high percentage of patients with FTD fulfil criteria for AD (table 4). Failures in individual cognitive domains (tables 1 and 2) across the two study groups (AD and FTD) are discussed below.

Memory impairment is virtually ubiquitous in dementing illnesses.21 The NINCDS-ADRDA criteria do not draw a distinction between memory impairments due to a retention disorder22 and those secondary to problems in retrieval and organisation.23 The neural substrates and hence the underlying causes for these two types of memory dysfunction are distinct. Patients with AD have a retention disorder from pathology within their limbic structures, whereas patients with FTD commonly have memory impairment due to retrieval and organisational problems due to frontal lobe deficits. Both groups (AD and FTD) have memory deficit (as witnessed in this study), defined by impairment in memory tests, but failure arises for widely different reasons. These differences can be uncovered by appropriate neuropsychological assessment and would improve the diagnostic specificity of the criteria.

The apparently poor discriminating power of language impairment is probably a reflection of the relatively broad definition of linguistic disorder outlined in the criteria statement. The criteria document suggests a wide range of verbal tasks potentially suitable for eliciting a language deficit, including verbal fluency and the Boston naming test. It is well established that patients with FTD show reduced verbal fluency and naming test performance as part of a general adynamia and impoverishment in motor responses. Indeed, verbal fluency is commonly viewed as a test of frontal lobe executive function.24 Such broad criteria for language disturbance will therefore inevitably incorporate patients with FTD. When more narrowly defined criteria for language impairment are adopted based on the presence of impairments in primary linguistic processes then the differentiating value of this cognitive domain increases substantially (tables 1 and 2).

Failure in attention tasks also has poor discriminating value (table 1) between AD and FTD. This is not surprising because deficits in attention are a characteristic feature of FTD. The frontal lobes, primarily involved in FTD are known to have an important role in attention.25

The criteria statement suggests various tasks that might be used to detect deficits in visual perception including Gollin incomplete pictures test and the Hooper test.10 Patients may fail the Hooper complex perceptual tasks for reasons that are not primarily perceptual but arise for reasons of frontal lobe executive dysfunction such as attentional deficits or failure in the ability to manipulate information mentally. When more stringent criteria were adopted to reflect a primary perceptual impairment, the LR improved fivefold (table 2), although few patients overall showed a deficit in this domain.

The identification of deficits in the realm of praxis significantly increases the odds of a patient having AD as opposed to FTD. The NINCDS-ADRDA criteria indicate that failure on drawing and block assembly tasks should be considered a disorder of praxis. However, patients may fail these tests due to deficits in praxis or spatial function, or due to poor strategic and organisational skills (frontal deficit). Although it is recognised that spatial abilities are commonly affected in AD3 and strikingly preserved in FTD,15 20 26 the criteria do not consider spatial function as a separate cognitive domain. Of the 11 (42%) patients with FTD who failed in tests of praxis as defined by the criteria, most failed due to deficits in strategy and organisation; only two (8%) patients failed specific spatial tasks (one failed dot counting tasks interpreted as secondary to poor sustained attention; the other did not track a maze due to impaired attention). By contrast 22 (73.3%) patients with AD had spatial impairment (LR 9.53, table 2), indicating high discriminating value for this domain. The identification of a disorder of spatial function as strictly defined increases considerably the odds of a patient having AD as opposed to FTD (table 2).

Twenty (77%) patients with pathological confirmation of FTD in this study fulfilled NINCDS-ADRDA criteria for AD. Eighteen (70%) of these patients fulfilled criteria on the basis of failure in the domains of memory, attention, and problem solving only. In view of the fact that the criteria require deficits in only two cognitive domains (one of which is memory) and the finding that failure in problem solving tasks significantly decreases the odds of a patient having AD as opposed to FTD, it would seem reasonable to consider the exclusion of problem solving tasks from the criteria.

It has been suggested that formal psychometric testing is rarely necessary for the diagnosis of AD even though NINCDS-ADRDA criteria called for confirmation of the dementia by neuropsychological testing.3 The findings from the present study suggest, on the contrary, the need for more careful documentation of cognitive impairments. Such an exercise should be aimed at identifying not merely test failure, but in discerning the nature of the cognitive deficits underlying such failure, as this has implications for its neural substrate and for clinical diagnosis. A revision of existing NINCDS-ADRDA criteria involving more narrowly defined definitions of cognitive deficits ought to improve diagnostic specificity without loss of overall sensitivity. It is suggested that memory be considered impaired only if the patient is also disoriented in time and place. The amalgamation of memory and orientation into one cognitive domain would improve specificity (table 1). A further characterisation of language and perception as primary language and primary perception will improve specificity too. The addition of spatial function and removal of problem solving and attention should also strengthen the criteria. Because a majority of patients with FTD fulfil the NINCDS-ADRDA criteria it is further suggested that those patients who fulfil the diagnosis of probable AD, but who, in addition, fulfil the published criteria for FTD,15 should be viewed with diagnostic caution and not confidently considered to have probable AD.

FTD is normally the only non-AD form of dementia that can lead to diagnostic confusion. It has been shown that patients with Lewy body dementia (LBD) may also fulfil NINCDS-ADRDA criteria for AD.27 The advent of neuroimaging including SPECT,28 and better histopathological and immunocytochemical techniques have led to the awareness of different neurodegenerative disorders causing dementia and which have characteristic neuropsychological profiles. When the NINCDS-ADRDA criteria were first formulated their main aim was to differentiate between AD and vascular dementia. Any future revisions and refinements of the present criteria will need to take into account the diversity of neurodegenerative disorders leading to dementia which have neither the neuropsychological profile nor the characteristic pathology of AD.

Acknowledgments

We are grateful to the carers of our patients for donating the brains of their relatives for research.

References

View Abstract

Request permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.