Article Text


Medial temporal structures relate to memory impairment in Alzheimer’s disease: an MRI volumetric study
  1. Etsuro Moria,
  2. Yukihiro Yonedab,
  3. Hikari Yamashitaa,
  4. Nobutsugu Hironoa,
  5. Manabu Ikedaa,
  6. Atsushi Yamadoric
  1. aDepartment of Clinical Neurosciences, Hyogo Institute for Aging Brain and Cognitive Disorders, bNeurology Service, Hyogo Brain and Heart Center at Himeji, cSection of Neuropsychology, Division of Disability Science, Tohoku University Graduate School of Medicine
  1. Dr Etsuro Mori, Clinical Neurosciences, Hyogo Institute for Aging Brain and Cognitive Disorders, 520 Saisho-ko, Himeji, 670, Japan.


OBJECTIVES Memory impairment is not only the earliest clinical symptom but a central and prominent feature throughout the course of Alzheimer’s disease. Alzheimer related pathological alterations in the medial temporal structures may account for the memory impairments in patients with Alzheimer’s disease. The aim of this study was to elucidate the role of the medial temporal structures in memory impairment caused by Alzheimer’s disease.

METHODS Using high resolution MRI and a semiautomated image analysis technique, volumes of the medial temporal structures (amygdaloid complex, hippocampal formation, subiculum, and parahippocampal gyrus) were measured, and correlations between atrophy of each structure and memory dysfunction in patients with Alzheimer’s disease were examined.

RESULTS Patients with Alzheimer’s disease showed poor performance on verbal and non-verbal memory tests, and MRI volumetry showed a significant volume reduction of the medial temporal lobe structures. Volumes of the amygdaloid complex and of the subiculum correlated with memory performance. Stepwise regression analyses disclosed that the volume of the right amygdaloid complex specifically predicted visual memory function and to some extent verbal memory function, and that the volume of the left subiculum specifically predicted verbal memory function. Atrophy of the hippocampus did not predict severity of memory impairment.

CONCLUSIONS The presence of perihippocampal damage involving the amygdala proper, its surrounding cortex, and the subiculum further increased the severity of memory impairment attributable to hippocampal damage in Alzheimer’s disease.

  • Alzheimer’s disease
  • magnetic resonance imaging
  • memory
  • medial temporal lobe

Statistics from

Neuropathological changes in Alzheimer’s disease include neurofibrillary tangles, senile plaques, and neuronal and synaptic loss and predominantly affect regions of the limbic and paralimbic medial temporal structures and association areas of the neocortex.1-3 There is a significant correlation between severity of dementia in Alzheimer’s disease and these postmortem neuropathological findings.4-6 The neuropathological changes in the medial temporal lobe may account for memory impairment in Alzheimer’s disease7; this is not only the earliest clinical symptom but a central and prominent feature throughout the course of the disease. In vivo neuroimaging techniques have shown a relation between memory impairment and the degree of medial temporal damage expressed as atrophy on MRI and hypoperfusion or hypometabolism shown by PET.8 The hippocampus is a central component of the medial temporal lobe memory system, and its structural integrity is necessary for declarative memory.9 The cortex adjacent to the hippocampus, including entorhinal, perirhinal, and parahippocampal cortices, is not simply a conduit for connecting the neocortex to the hippocampus, but is actively involved in storage of information from the neocortex before reaching the hippocampus itself.9Destruction restricted to the bilateral hippocampi is known to produce memory deficits in animals10 and in humans.11There is neuroimaging evidence for loss of hippocampal tissue in human diseases associated with memory impairments.12 13Furthermore, the perirhinal cortex and the closely associated parahippocampal cortex provide the major source of cortical input to the hippocampal formation,9 and CA1 pyramidal cells send efferent fibres to the subiculum, entorhinal cortex, and several subcortical areas.14 Bilateral lesions limited to these areas produce severe memory impairment in monkeys.15 16Although the amygdala is not a part of the medial temporal lobe memory system for the processing of declarative memory,9 there is evidence indicating that lesions in the amygdala produce memory deficits in humans and animals.17-21 However, there is a controversy over whether damage to the amygdala contributes to the severity of memory loss. Recent studies have indicated that the additive effect of damage to the amygdala on hippocampal damage is not a consequence of damage to the amygdala itself but is due to involvement of the adjacent cortices (periamygdala, entorhinal, and perirhinal cortices) covering the surface of the amygdala and parahippocampal gyrus.9 15 22 23 The role of the amygdaloid complex, hippocampus, subiculum, and parahippocampal gyrus in memory impairment in patients with Alzheimer’s disease remains unestablished.

Medial temporal atrophy is present on CT and MRI in most patients with Alzheimer’s disease, and in vivo direct measurement of brain volume with MRI has emerged as the best method to quantify it.24-31 Volumetric studies have examined the relation between medial temporal lobe atrophy and memory impairments in diseases and aging.13 24-36 In the present study, to elucidate the structural determinants of severity of impairment of memory within the medial temporal structures in patients with Alzheimer’s disease, we directly measured the volume of these structures (amygdaloid complex, hippocampal formation, subiculum, and parahippocampal cortex) using semiautomated image processing of high resolution MRI, and analysed the relation between atrophy of each structure and memory dysfunction.



Forty six Japanese patients with mild to moderate Alzheimer’s disease were selected among those admitted to our hospital for investigation between July 1993 and March 1995. All patients were examined by neurologists and psychiatrists. Routine laboratory tests, standard neuropsychological examinations, EEG, MRI of the brain, magnetic resonance angiography of the neck and head, and cerebral perfusion and metabolism studies by PET or single photon emission computed tomography (SPECT) were performed in all patients. The inclusion criteria comprised (1) a diagnosis of probable Alzheimer’s disease according to the NINCDS/ADRDA criteria,37 (2) age younger than 80 years, and (3) mild to moderate functional impairment (grades 0.5, 1, and 2 on the clinical dementia scale38). Patients were excluded if; (1) other neurological or systemic diseases were present, (2) a mini mental state examination (MMSE)39 40 score less than 11 suggested the presence of severe language, attention, and behavioural disorders that would make the neuropsychological assessment difficult, (3) evidence of focal brain lesions on MRI, and (4) inability to obtain informed consent from patients and their relatives. Twenty seven women and 19 men were selected; the mean (SD) age was 70.3 (7.1) years (range 44 to 79); the mean educational attainment was 8.7 (2.3) years (range 6–16); and the mean MMSE score was 19.6 (3.5) (range 12–26). All patients were right handed.

To obtain normative data for comparison, 12 age and sex matched (seven women and five men), right handed normal subjects (mean age 66.2 (4.9) years and mean educational attainment of 10.1 (2.7) years) were recruited from the community. Controls had no abnormal findings on MRI and scored 28 or more on the MMSE.

The study followed the clinical study guidelines of the ethics committee of Hyogo Institute for Aging Brain and Cognitive Disorders, Himeji Japan, and was approved by the internal review board in 1993. After a complete description of the study to the subjects and their relatives, written consent was obtained.


Brain MRI was performed on a 1.5 T MRI scanner (Signa Advantage 5x, General Electric) with the use of a circularly polarised head coil as both transmitter and receiver. Coronal 3D spoiled gradient echo (SPGR) images (field of view of 220 mm, matrix of 256 × 256, 124 × 1.5 mm contiguous sections, TR 14 ms, TE 3 ms, flip angle 20°) perpendicular to the anterior-posterior commissure plane covering the whole calvarium were used for the volumetric study.41Axial T2 weighted proton density, and T1 weighted images were also obtained for diagnosis.

The MRI data sets of all images were directly transmitted to a personal computer (Power Macintosh 8100/80, Apple) and analysed using the public domain NIH Image version 1.59 program (written by Wayne Rasband at the US National Institutes of Health and available from the internet by anonymous ftp from or on floppy disk from NTIS, 5285 Port Royal Rd, Springfield, VA 22161, part number PB93–504868) with residential macroprograms developed in our institute after an appropriate data conversion.

All volume measurements were performed by a segmentation technique with a combination of tracing and thresholding. The volume of a given structure in each slice was obtained by automatically counting the number of pixels within the segmented regions and multiplying the number by a voxel size (220/2562 × 1.5 = 1.108 mm3). One investigator (YY) measured the volume of the medial temporal structures and one (EM) the intracranial volumes. We used a semiautomatic segmentation technique through density thresholding, thereby avoiding the partial voluming and observer’s bias. The test-retest reliability, measured using an intraclass correlation coefficient derived from three repeated measurements by one rater under blind conditions in 10 randomly selected subjects, was 0.990 for the intracranial volume, 0.868 for the right amygdaloid complex, 0.912 for the right hippocampal formation, 0.810 for the right subiculum, and 0.909 for the right parahippocampal cortex. In a validity experiment that used phantoms filled with copper sulphate solution, accuracies of 99.4% (average) for a 2664 ml sphere and 98.3 % (average) for a 5 ml cylinder were achieved, indicating that measurements resulted in a slight underestimation of volume.41

For the total intracranial volume measurement, the cranial cavity was semiautomatically segmented with a density threshold set above the minimum value of the CSF in the lateral ventricle. When density thresholding resulted in insufficient segmentation, manual outlining was performed following the inner table of the skull and the basal margins of the cerebral hemispheres.41

Volumetry of the medial temporal structures was done with a combination of tracing and thresholding techniques. The outline of each structure including white matter and CSF was first traced with a manually driven mouse cursor, and subsequently the grey matter of each structure was extracted by density thresholding set within a range of values. The maximum value was the mean pixel value of the grey matter (represented by the caudate head), and the minimum value was the median value between the mean value of the grey matter and the mean value of the CSF (represented by the lateral ventricle).

Boundaries for the amygdaloid complex, hippocampal formation, subiculum, and parahippocampal cortex were defined in the following manner (fig 1). The amygdaloid complex was considered to include the amygdala proper (the deep/basolateral and superficial/corticomedial nuclei, and other nuclei and area), gyrus semilunaris, and the gyrus ambiens which constitutes the olfactory portion of the entorhinal cortex.13 42 The amygdaloid complex is an ovoid shaped mass of grey matter. Its anterior boundary was defined as the plane including the most anterior part of the temporal stem, where the amygdaloid complex appears as a thickening of the anterior grey matter.28 Anteriorly, the amygdaloid complex was separated from the hippocampal head as a marker of the alveus hippocampi, the semianular (amygdaloid) sulcus, or the uncal recess of the inferior horn of the lateral ventricle.13 Posteriorly, a medioinferior part of the amygdaloid complex is covered by the superior medial part of the parahippocampal gyrus. At this level, the separation of the amygdaloid complex was done by drawing a line from the tentorial indentation (uncal notch) to the uncal recess of the lateral ventricle.13 31 The inferior and lateral borders were formed by the uncal recess of the lateral ventricle or white matter, and the superior border was defined as the choroidal fissure.

Figure 1

Boundaries of medial temporal structures on MRI. Selected slices from a 59 year old female patient with mild Alzheimer’s disease and atrophic medial temporal structures for volume measurement. The most rostral slice intersects the anterior border of the amygdaloid complex (panel 1) and the most caudal slice intersects the posterior border of the hippocampal formation/parahippocampal gyrus (panel 6). A=amygdaloid complex; H=hippocampal formation; S=subiculum; P=parahippocampal cortex.

The hippocampal formation was defined as comprising the pes hippocampi, digitationes hippocampi, alveus hippocampi, and dentate gyrus.13 The most posterior boundary was the section on which the crus of the fornix was seen in full profile.43The outline boundary was manually guided along the hippocampal sulcus, medially to the inferior horn of the lateral ventricle, and turned up laterally along the choroidal fissure.13 43 When the hippocampal digitations were fused to the amygdala, the thin line formed by the alveus served as a useful landmark.

The subiculum was defined separately from the hippocampal formation and parahippocampal gyrus. The boundary between the subiculum and hippocampal formation was the line from the hippocampal sulcus horizontally to the inferior horn of the lateral ventricle.13 36 The inferior border of the subiculum was the grey and white matter junction between the subiculum and the white matter in the parahippocampal gyrus, which was detected by density thresholding. The limit between the subiculum and parahippocampal cortex was arbitrarily defined by a line in continuation with the inferior border of the subiculum. The anteroposterior boundaries for the subiculum were similar to those for the hippocampal formation.

The parahippocampal cortex was defined as including grey matter in the parahippocampal gyrus. The separation between the amygdaloid complex and the anterior parahippocampal gyrus was mentioned above. The anterior boundary was the plane including the most anterior part of the temporal stem, and the posterior boundary for the parahippocampal gyrus was similar to that for the hippocampal formation. The internal boundary was the grey-white matter junction, which was detected by density thresholding.


Neuropsychological and MRI studies were performed within a one month interval. Memory functions were assessed using the following tests for verbal memory: (1) the word recall subtest of the Alzheimer’s disease assessment scale (ADAS),44 45 (2) the logical memory subtest of the Wechsler memory scale-revised (WMS-R),46 and (3) the verbal paired associates subtest of the WMS-R. For visuospatial memory examination, the following tests were used: (1) the visual paired associates subtest of the WMS-R, (2) the visual reproduction subtest of the WMS-R, and (3) the figure memory subtest of the WMS-R. In all WMS-R subtests, non-delayed recall measures were considered. The ADAS word recall subtest is equivalent to a verbal learning test, in which the retention of a written 10 word list was measured by free immediate recall after each of three learning trials. The score is expressed as the mean number of words recalled in three trials. We analysed each measure separately.


To adjust for between subject variability in cranium size, the right and left volumes of the temporal lobe structures were normalised by covariance42 47 as calculated by the following equation:

Normalised volume = observed volume − B × (patient’s total intracranial volume − mean total intracranial volume for normal subjects)

where B is the regression coefficient in the normative linear object volume-total intracranial volume regression. The normative relation was determined by simple regression analysis. The difference in each memory test score between the controls and patients was analysed by two tailed Student’s t test. Analysis of variance (ANOVA) with one between subject factor, groups (patients and normal subjects), and one within subject factor, side (left and right), was used to compare volume of each medial temporal structure, followed by Tukey’s test for post hoc analysis.

The relation between the scores on each memory test and volume of each medial temporal structure in patients was explored by Pearson’s correlation coefficients. Because of the inconclusive and exploratory nature of this analysis, no correction for multiple comparisons was applied. To find out the specific structural predictors of memory performance while controlling for age, sex, and education, we carried out a stepwise linear regression analysis with those confounding factors forced into the model, and with each memory test score as the dependent variable and volumes of the structures as the independent variables. The significant level was set at P<0.05. All statistical analyses were carried out on SAS release 6.10 (SAS Institute Inc, Cary, NC, USA).



Table 1 summarises the volume measurements. The right and left mean volumes of the amygdaloid complex, hippocampal formation, subiculum, and parahippocampal cortex in patients with Alzheimer’s disease were significantly smaller than those in normal subjects. The mean (SD) total intracranial volume was comparable between the patients with Alzheimer’s disease (1463 (120) ml) and controls (1458 (100) ml). For patients with Alzheimer’s disease, the volumes of each medial temporal structure did not correlate with age and educational attainment, and were not significantly different between women and men.

Table 1

Volumes of medial temporal structures in normal subjects and patients with Alzheimer’s disease


The performance on memory tests was severely impaired in patients with Alzheimer’s disease (table 2). Memory performance did not correlate with age and educational attainment, and no significant differences were found between women and men.

Table 2

Performance of memory tests in normal subjects and patients with Alzheimer’s disease


Table 3 shows the results of correlation analysis. The right and left amygdala volume and the left subicular volume were significantly correlated with memory test performance. Word recall and logical memory scores correlated with left subicular volume. Verbal paired associates score correlated with right amygdala volume, as did figure memory score with right and left amygdala volumes. Visual reproduction score correlated with the volumes of the right amygdaloid complex and of the left amygdaloid complex. A significant correlation was also found between right hippocampal volume and the visual reproduction score.

Table 3

Correlation (Pearson correlation coefficient matrix) between performance on memory tests and volumes of medial temporal structures

Table 4 summarises the volumetric predictors of memory test performance in the stepwise regression analysis with all the confounding variables forced into the equations. The left subicular volume predicted the scores of the word recall and of logical memory, and the right amygdala volume predicted the scores of the verbal paired associates, figure memory, and visual reproduction. Figures 2 and 3 illustrate the linear volume-test performance relations

Table 4

Volumetric predictors of performance on memory tests and partial correlation coefficients in stepwise linear regression analysis

Figure 2

Linear univariate regressions of volume of the right amygdaloid complex on figure memory score (r = 0.342, P=0.020), on visual reproduction score (r = 0.454, P=0.002), and on verbal paired associates score (r = 0.309, P=0.037). These relations remained significant after partialling out variance due to age, sex, and education.

Figure 3

Linear univariate regressions of volume of the left subiculum on word recall score (r=337, P=0.022) and on logical memory score (r=0.374, P=0.010). These relations remained significant after partialling out variance due to age, sex, and education.


Before discussing the impact of medial temporal atrophy on memory impairment in Alzheimer’s disease, the limitations of the present study need to be mentioned. Neurodegenerative changes in Alzheimer’s disease are followed by brain atrophy, which is the main gross pathological feature of Alzheimer’s disease.1-3Pathological studies on the surgically resected hippocampus of epileptic patients have shown a high correlation between neuronal cell loss and MRI volume measurements.48 49 Studies on necropsied cases of advanced Alzheimer’s disease have also shown that atrophy of the amygdala is related to Alzheimer’s pathology.3 These facts give a rationale for our MRI volumetric study. The ability to separate two adjacent brain structures is a function of the inherent spatial resolution of the images, and this is particularly important when considering slice depth as this voxel dimension is greater than the dimensions in the plane of the imaging slice. The imaging voxels must therefore be of a size that is appropriate to the object being measured, and it is particularly important for volumetric studies to use thin slices.36 The three dimensional 1.5 mm slice MRI we used in this study was that recommended for reliable and valid volumetry.36Nevertheless, it is difficult to separate subdivisions within a structure even with the best technique currently available. To maintain a reliable segmentation on MRI, we had to include different anatomical structures within a single region (for example, the amygdaloid complex, which contained both the amygdala proper and its surrounding cortices). Although we made use of a stereotaxic technique based on anatomical landmarks to segment structures the outline of which cannot be delineated with contrast alone (for example, the parahippocampal cortex), individual anatomical variation may have influenced the results. We must, therefore, take these limitations into consideration when interpreting the results of this study.

The present study showed that the volumes of the medial temporal lobe structures were reduced in Alzheimer’s disease. This finding is consistent with those in previous MRI volumetric studies.24-31 34 35 In the correlational analysis, the volumes of the right amygdaloid complex and the left subiculum were significantly correlated with several memory scores. Although it is impossible to exclude type I error in the multiple comparisons, it is reassuring that the volumes of the same structures were repeatedly seen as significant correlates. Moreover, stepwise regression analyses disclosed that, independent of age, sex, and educational attainment, the right amygdala volume specifically predicted visual and verbal memory test performance, and the left subicular volume verbal memory test performance.

Atrophy of the hippocampus was not seen as a significant predictor of severity of memory impairment. However, this does not necessarily disagree with the view of the central role of the hippocampus in the memory process. Although bilateral lesions restricted to the hippocampi produce memory impairment in animals9 10 and in humans,11 the deficits are limited. Our previous volumetric study in amnesic patients after herpes simplex encephalitis indicated that hippocampal damage resulting in less than 50% volume loss did not result in severe, lasting amnesia.13 As the Alzheimer’s disease pathology invariably affects the hippocampal formation, damage to the hippocampus might be an indispensable condition for occurrence of memory deficits in patients with Alzheimer’s disease. The damage to the amygdala proper, its surrounding cortices, and the subiculum exacerbates further the memory impairment after hippocampal damage.

Our results indicate the involvement of the left subiculum in verbal memory. In previous studies, Laakso et al 35found a significant correlation between hippocampal volume and verbal memory performance in 32 patients with Alzheimer’s disease, and Deweeret al 34 also noted significant correlations between verbal memory variables and hippocampal volume in a study with 18 patients with Alzheimer’s disease. However, in both studies, the hippocampal volumetry included the subiculum, which is a main locus of involvement in Alzheimer’s disease pathology. The association of the hippocampal volume with memory test performance shown in those studies could therefore be explained by subicular atrophy. The subiculum is one of the few major output zones for the hippocampus projecting to numerous other brain areas, and is one of the major sources of cortical input to the hippocampal formation.9 12 Alzheimer’s disease pathology affects the subiculum and CA1 zone of the hippocampus as well as layers II and IV of the entorhinal cortex, and this focal pattern of pathology is likely to isolate the hippocampal formation from much of its input and output and probably contributes to the memory disorder in Alzheimer’s disease.1 7 50 Our findings support this view, and suggest that the subiculum is a more critical site for memory impairment in Alzheimer’s disease than the hippocampus proper. The dominance of the left side in verbal memory is in agreement with many previous studies reporting verbal material specific memory deficits in patients with the left medial temporal lobe lesions including unilateral temporal lobectomy.51

On the other hand, we found a significant involvement of the right amygdaloid complex in memory impairment in Alzheimer’s disease. Soininen et al,33 in a study of age associated memory impairment, showed significant correlations of the amygdala volumes with the performance on visual memory tests but not with performance on the verbal memory tests. Whereas two previous volumetric studies on Alzheimer’s disease failed to show each correlation.34 35 Deweer et al,34 using 5 mm slice thick MRI, inadequate for volumetry of the amygdala, also failed to find an association between the volume of the amygdala and memory function. Laakso et al 35 failed to find a significant difference in the volume of the amygdala between patients with Alzheimer’s disease and age matched controls, and no mention was made in that study of the correlation between volume of the amygdala and memory performance.

There are many controversies about the role of the amygdala in memory function; whether lesions restricted in the amygdala can cause memory deficits in humans and animals and whether additional lesions in the amygdala exacerbate the memory impairment caused by hippocampal lesions. The amygdala and hippocampal formation are anatomically interconnected, several amygdaloid nuclei contribute projections to the hippocampus, subiculum, and entorhinal cortex, and receive hippocampal innervation.52 An active role for the amygdala in human memory is supported by the studies of patients with bilateral damage to the amygdala due to Urbach-Wiethe disease, in particular a significant defect in visual memory has been reported.18 19Mishkin20 discussed the discrepancy between animal and human amnesia; the profound anterograde amnesia attributed to damage of the hippocampus in human patients has not been reproduced in animals with such lesions. He showed that combined but not separate removal of the amygdala and hippocampus impaired memory in monkeys, and she stressed the importance of damage to both the hippocampus and amygdala in severe memory impairment. Based on their studies of rhesus monkeys, Murray and Gaffan21 found that the amygdala, its underlying cortices, or both, play a part in crossmodal and intramodal associative memory in animals. It has been suggested that the amygdala plays a part in integrating the memory modulating effects of systems activated by learning experiences in rodents.53 However, Zola-Morgan and his coworkers, based on a series of studies on monkeys with discrete lesions in the medial temporal lobe, have suggested that damage to the cortical regions surrounding the amygdala contributes to memory impairment. In their experiments, circumscribed bilateral lesions of the amygdala sparing the surrounding cortex (the periamygdaloid, entorhinal, and perirhinal cortices) did neither impair performance on memory tasks nor exacerbate the memory impairment that followed isolated hippocampal lesions,15 whereas the addition of lesions in the anterior entorhinal cortex and perirhinal cortex, sparing amygdala, exacerbated the memory deficit produced by the lesions in the hippocampus and its adjacent cortex.23They also showed that lesions of perirhinal and parahippocampal cortices that spared the amygdala and hippocampal formation produced severe memory impairment.22 Because in our study we measured both the amygdala proper and its adjacent cortical regions together, the crucial lesion producing severe amnesia remains to be determined. Further studies with more refined techniques are necessary to resolve this issue.

The present study indicates that the right amygdaloid complex was more critically involved in memory than the left. Experiments with rats have suggested that the right amygdala contributes more to the expression of memory,54 55 although it is not always possible to extrapolate findings obtained in animals to humans. The functional lateralisation of the amygdaloid complex in humans needs to be investigated further.

We conclude that perihippocampal damage, involving the amygdala proper, its surrounding cortices, and the subiculum, added to the memory impairment caused by hippcampal damage in Alzheimer’s disease. Our results also support the view that these structures play an active part in human memory.


This study was supported by a grant from the Ministry of Health and Welfare, Japan. We thank our colleagues, Drs Toru Imamura, Yoshitaka Ikejiri, and Tatsuo Shimomura, Department of Clinical Neuroscience, and Hajime Kitagaki, Department of Neuroimaging Research, for their help in various parts of the study, and Kazuhiro Toso, Medical Informatics and Misato Fujimori, Neuropsychology unit, for their technical assistance.


View Abstract

Request permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.