The Relationship Between Cognitive Performance Using Tests Assessing a Range of Cognitive Domains and Future Dementia Diagnosis in a British Cohort: A Ten-Year Prospective Study

INTRODUCTION

There has been an increased interest in the prevention or delay of the onset of dementia [1] and of the early identification of individuals who are at high risk [2]. For the purpose of primary prevention, we need a better understanding of the natural progression of the disease to allow targeting of specific risk factors to potentially modify early biological changes that may be an indication of future dementia [3]. Although early diagnosis of dementia is recommended in individuals displaying symptoms of the condition [4], current policies do not support screening or risk prediction at an individual level among apparently healthy individuals [3]. This is due to uncertainty of clinical outcomes and effective interventions [5], with insufficient evidence of benefits over the harms of screening for cognitive impairment and dementia [4, 6]. Arguments against screening highlight these uncertainties, including unnecessary investigation and treatment with no evidence of any benefit for the individual [7, 8].

Dementia for most has a long prodromal period, whereby individuals who go onto develop dementia, exhibit cognitive deficits many years before any symptoms or receiving a clinical diagnosis [9]. Though difficult to discriminate dementia in its early stages from normal cognitive ageing [10–12], there is evidence from large cohort studies that, in general, those who developed dementia after follow-up exhibited poorer cognitive performance compared to those who did not develop the disease [13], although differences have been insufficient to translate into accurate individual risk prediction [3]. The increased risks have been observed for tests both at a global and domain specific level [14, 15]. This includes episodic memory, executive functioning, verbal ability, visuospatial skill, attention, and processing speed [16, 17].

Dementia risk reduction has been identified one of the top research priorities in reducing the global burden of dementia [18]. Though not clinically applied, numerous dementia risk models have been developed and are widely used for research. These models have a number of uses, such as to examine factors that are associated with increased or reduce risk of dementia, or to classify individuals into different risk categories and in particular, identify those with high risk [19] in order to and identify target populations for intervention and prevention trials [3]. The accuracy of dementia prediction models have been reported as variable among different cohorts [19, 20].

Neuropsychological testing provides information on the nature and extent of cognitive deficits, and has been a core measure included in models of dementia in addition to age [19, 21]. Many studies have been limited either by small cognitive batteries assessing few cognitive domains or using tools such as the widely used Mini-Mental State Examination [22] (MMSE) or the Montreal Cognitive Assessment (MoCA), both known to be less sensitive to milder levels of cognitive dysfunction [23–25]. It is necessary to evaluate the utility of tests and to identify tests that are sensitive to early changes [26].

Variability across tasks also indicates neurological dysfunction [27]. Greater variability across different cognitive domains has been associated with poorer performance and dementia [28] and has been said to be a good predictor of cognitive impairment over and above the mean level of performance in individual cognitive tasks [29]. Furthermore, there is also evidence of more pervasive cognitive deficits across domains in earlier stages of decline, and not just memory alone [13, 30, 31]. Dementia is characterized by severe deficits across a range of fluid cognitive abilities, which worsens and affects more domains as the disease progresses [32]. However, it is still unclear, whether the cognitive performance is associated with dementia across all cognitive functions or whether it is specific to one or more key functions. Further research with a wider range of neuropsychological tests is needed [33, 34].

As well as the limitation of studies with cognitive tests that are sensitive and broad-ranging [35], there are fewer longitudinal studies [36] with sufficient follow-up time [37]. Investigating the utility of cognitive tests in individuals free of cognitive impairment or dementia at the time of testing, across a wider age range merits further investigation. Although large prospective cohort studies have shown an association between pre-clinical cognitive capability and increased risk of dementia [21], there is little in the current literature, on the level of impairment by cognitive domain, and in studies with follow-ups of more than 10 years [37]. The purpose of this study is to provide additional insight, that is has not been clear in previous studies, into the extent of impairment in natural history of dementia to further inform potential primary prevention strategies. A greater understanding of the role of specific risk factors associated with dementia is needed not only to understand the natural history of dementia, but also to better inform future risk prediction models when selecting components to be included [20].

We examine the utility of a range of cognitive tests (both global and domain specific), that are more sensitive to earlier changes of decline as potential key components, for risk of future dementia. We investigate whether early signs of impairment across a number of cognitive tasks influences the associations with incident dementia over and above cognitive performance on individual tasks, in a relatively healthy ageing prospective cohort study of mid to later life.

METHODS

RESULTS

Of the 8,623 individuals who took part in the 3HC, 8,585 had cognitive measures with a total of 537 with a dementia diagnosis (based on the ICD codes in Supplementary Table 1) after a maximum of 14.8 years of follow up (mean of 9.6 and median of 9.8 years). Four of these participants were excluded from the analyses as they received their dementia diagnosis prior to their cognitive assessment resulting in a total of 533 dementia cases in the final analytical sample of 8,581 men and women who were aged 48–92 at the time of their cognitive assessment. Figure 1 summarizes the participation level at each phase of the study from baseline and the selection of the analytical sample. The total number of incident dementia in EPIC-Norfolk participants from the 25,639 individuals who attended the baseline health check at the censor date was 3,187.

Fig. 1

Selection of study participants in the EPIC-Norfolk third health check (including pilot phase 2004–2006) for all-cause ‘definite’ dementia, followed until 31 March 2019.

Table 2 shows the means and proportions of the variables included in this analysis by dementia status. As expected, there were differences between the two groups for almost all the variables examined. Those with dementia were more likely to be older, have no qualifications, be physically inactive and non-drinkers, less likely to be current smokers, and have higher blood pressure. They were also more likely to have reported suffering from stroke, hypertension, diabetes, and memory and hearing problems. Those with subsequent dementia scored lower on all the cognition tests at the 3HC, except the short-NART, which is a test of reading ability and crystallized knowledge. Of the 8,581 participants with cognitive data, 6,152 participants had data for all the cognitive tests with 2,391 having some of the test measures and 38 participants having none. In the healthier cohort, over half the participants did not exhibit poor performance in any of the eight cognitive measures, 26.1% exhibited poor performance in one test, 17.1% in 2-3 tests, and 4.8% in 4–8 tests (Fig. 2).

Fig. 2

Distribution of poor performance across the eight measures in the EPIC-Norfolk cohort.

Hazard ratios for dementia, adjusted for age (at the time of the invitation to the 3HC) per 5 years, sex, education, and social class for those who attended the health check and those who were invited but did not attend (N = 9,605 –as shown in Fig. 2) were examined. Using the group who had attended 3HC and had data on all 8 tests as reference, the dementia risk (adjusted for age, sex, education, and social class) were as follows: with data on 5–7 tests, HR = 1.12 (95% CI 0.93, 1.35 p = 0.2); 1–4 tests HR = 1.38 (95% CI 0.95, 2.00 p = 0.1); attended 3HC, but with no cognition data HR = 2.35 (95% CI 1.21, 4.57 p = 0.01), and for those who were invited for the 3HC but did not attend HR = 1.83 (95% CI 1.61, 2.08 p≤0.001). Data shown in Supplementary Table 2.

Table 3 shows the results of the Cox proportional hazards analysis for all the tests separately and for the composite score. For the age and sex adjusted models, there was an increased risk of dementia in those obtaining a poor performance score as compared to those who did not for all the cognitive tests other than the short-NART. Further adjustments for education and social class (Model 2) and then for co-variates, smoking, body mass index, physical activity, and comorbidities (Model 3) made little difference to the hazard ratios. The magnitude of the association varied slightly across tests, with the association with the composite as the strongest. Of the individual tests, the HVLT, a test for verbal episodic memory was comparable to the association observed for the composite.

In the sensitivity analysis, imputing missing into the poor performance or reference group, other than some slight attenuation made little difference to the hazard ratios (Supplementary Table 3). The analyses based on quartiles on cognitive performance showed no dose association in the quartile analyses, particularly at the top end of performance scores. (Supplementary Table 4). Therefore, using the more stringent cut-off in this cohort of healthier and higher functioning individuals is appropriate as presented in the main analysis. Repeating the multivariable analysis after excluding individuals who died or received a dementia diagnosis within five years of follow-up after cognitive testing (Number of dementia cases = 426), resulted in slight attenuation of the hazard ratios (Supplementary Table 5).

Associations based on the proportion with poor level of function across the cognitive abilities showed a steep linear increase in risk of dementia, in individuals with increasing numbers of abilities with a poor performance score (Table 4). Compared to those who did not have a poor performance score in any test, those with poor performance in one test had double the risk of dementia, poor performance in 2-3 tests had a four-fold increase, and those with poor performance in 4–8 tests, had over a ten-fold increased risk of dementia, HR = 10.82 (95% CI 6.85, 17.1 p = 0.001).

Those with poor cognition in 4–8 tests showed more variability across domains than those with poor cognition in fewer domains. Controlling for each of the cognitive test as well as the composite score made little difference to the associations, as shown diagrammatically in Fig. 3 (with the data presented in Supplementary Table 6); however, adjusting for HVLT (episodic memory) did attenuate the association more than the other cognitive measures. Those who with poor performance in 4–8 tests were more likely to be older, have no qualifications, have higher reporting rate of heart attack, hypertension, stroke, diabetes, and memory and hearing problems. The mean score for all the cognition tests were substantially lower for this group, including a much higher NART error score. (Supplementary Table 7).

Fig. 3

Diagrammatic representation of association of level of cognitive impairment and dementia controlling for each of the cognitive test.

The supplementary analysis of the ROC curves as shown in Supplementary Figure 1 show the accuracy of the models presented in this study. The AUC successively improved from the basic model with addition of the covariates (Model 3), further with cognitive measure (shown here with the composite score); with the greatest predictive power of the final model which included ‘number of tests’. AUC values for these models for the individual tests (with the odds ratios from the multiple logistic regression used to generate the predicted probabilities) are presented in Supplementary Tables 8 and 9. These findings need to be examined in further studies

DISCUSSION

We report on eight simple cognitive measures for which poor performance is associated with increased future risk of dementia in individuals with almost fifteen years of follow up. Impairment occurs in multiple domains several years prior to any clinical symptoms, and the more pervasive and greater the variability, the higher the risk of dementia. Our study presents additional evidence on the utility of a range of cognitive tests and the risk of dementia in this cohort of men and women in mid to later life who were free of dementia at the time of cognitive testing.

Impairment in multiple domains independently were associated with an increased risk of dementia over and above performance score of individual tests or a composite score. Poor cognition in four or more tests is associated with a ten-fold increased risk of developing dementia compared to those not performing poorly in any test. To our knowledge, no other study has examined associations with future incident dementia in detail, across a broad range of cognitive tests. Previous studies have either used a global composite or standardized score and not examined the relationship to include extent of impairment, nor a longer follow-up time as we have done here.

We have added to the current knowledge that extent of dysfunction, even at an earlier and milder level, has a substantial increased risk of future dementia. Adding cognition score to the multivariable adjusted model alone, showed an improvement in the accuracy of the model (AUC = 0.83 and 0.81, respectively), a finding that is comparable to other studies of risk prediction models [19, 21]. However, by incorporating the number of tests with impaired cognition, the model improved even further (AUC = 0.85). These findings provide further insight to cognitive predictors commonly included as components in risk prediction and could potentially inform future dementia prediction models. This is a novel and important finding and warrants further investigation. Although examining risk prediction is beyond the scope of this current study, the impact of adding level of impairment to accuracy of the model for a future risk prediction study should be examined in other studies.

There are a number of limitations to this study. The first is of healthy volunteer bias of those individuals attending the 3HC phase. However, our study included a wide range of individuals in terms of age, education, social class, and both men and women as in the general population [42]. Although EPIC-Norfolk was originally initiated as a general health study, the focus of the 3HC was on aspects of ageing, and so participants attending could have had concerns about their cognition. Those who did not attend this interview but had given permission to track medical records had 83% higher risk of dementia than those who attended and did all eight cognitive test HR = 1.83 (95% CI 1.61, 2.08 p≤0.001). While the absolute rates of dementia in the participants who undertook the cognitive function testing may not reflect those of a more general population, nevertheless there was still a wide range of ability in terms of cognitive performance.

The use of a self-report measure of many of the factors may also be criticized as prone to recall biases or not accurate as an objective measure. Conducting this study in this healthier population has the advantage of less confounding from co-morbidities. Although we adjusted for a wide range of factors, due to the nature of an observational study, we cannot exclude residual confounding. Given that this study is in relatively healthy older adults, we used a relatively stringent cut-off (even though the more stringent cut-off will still include cognitively poor but healthy individuals).

Using medical records allows a more complete follow-up, limiting attrition as a bias and is widely used method in epidemiological research [21]. The downside of this is the dependence on medical records, prone to inconsistencies across time, with changes in policy and practice raising concerns over the accuracy and changing completeness of dementia recording [44, 45]. Also, medical records are known to underestimate the number of individuals with dementia, as not all individuals receive a formal diagnosis. Nevertheless, even though less sensitive, medical record diagnosis is likely to be highly specific such that when an individual has a diagnosis or death certification with dementia recorded this is highly likely to be accurate [45].

Although we found minimal change in associations when omitting in sensitivity analyses those who had died or had a dementia diagnosis within 5 years of cognitive testing, we cannot rule out reverse causation as dementia has such a long preclinical phase [46]. Further follow-up time is needed. However, determining temporality for dementia will always be challenging. Also, having a wide age range at baseline, we were able to observe the different influence of factors and how their relationship varied with dementia as midlife or later life exposures.

Substantial cognitive changes occur with healthy ageing. Previous studies have shown that there are milder or pre-symptomatic stages of dementia, not limited to memory [30, 31]. We have confirmed these findings in this larger cohort with a wider age range. It is quite possible to misclassify milder symptoms or asymptomatic without memory concerns as normal cognitive ageing. Our findings show the magnitude of the association between a wide range of cognitive tests from the same cohort, with some tests more strongly associated than others. In particular, we show tests of processing speed are not as strongly related as the other tests. These points are important to consider in future work.

Variation in methodology, characteristics of the population, the timing and nature of cognitive test will all influence the association. It is essential to disentangle confounding to get a better understanding of the causal pathways and those at greatest risk. In our study, the future relative risk was ten-fold greater in those with pervasive impairment. Other cohort studies examining dementia risk should consider impairment across multiple domains to examine the association within their settings.

It is important to highlight, that even with a ten-fold increased risk of dementia in those with more pervasive impairments, there is insufficient evidence to advocate screening or use of predictive modelling for diagnostic use for dementia. There is still much to understand in terms of to provide further insight into the different domains cognitive function commonly used for assessment as components in dementia risk modelling. These findings may be used to develop future prediction models to identify earliest phases of impairment across cognitive domains, to inform the design of trials of preventive or modifying interventions [5] and identify target populations greatest at risk who can then also be included in such trials.