User Tools

Site Tools


cogstate

This is an old revision of the document!


CogState

The CogState is a battery of computerized cognitive tests used in Lifelines to broadly assess cognitive functioning of participants (section: mental health). The test battery was performed in ~68,000 able participants aged 13 years and older during 2A Visit 1, and is used again in the ongoing assessment 3A.
The Cogstate is used in conjunction with other cognition tests in Lifelines, i.e. the RFFT and the MMSE. Raw data of the Cogstate was used to calculate the Cogstate Speed Composite (CSC).

Protocol

Lifelines uses the brief battery of CogState tests. Measuring different cognitive function domains which were completed in the following order:

  1. Detection task (psychomotor function / speed of processing) (2 min)
  2. Identification task (visual attention/vigilance) (2 min)
  3. One back (working memory) (2 min)
  4. One Card Learning task (visual learning & memory) (5 min)

NB: The Groton Maze Learning Task, which is part of the full CogState battery, was not used in Lifelines.

All subtests are based on playing card formats, with little reliance on assessment of verbal abilities. The Brief Battery can be administered un-supervised.
Written instructions are presented on the screen. Responses are made on a computer keyboard represented on the screen, with responses by using the “k” key for yes and “d” key for no. Outcome measures are:

  1. number of errors/correct responses
  2. reaction time

The participant should be able to use a computer keyboard or mouse with one hand and should be able to see the computer screen (i.e. normal vision observation). If participants use reading glasses, they are recommended to use them during this task.

cogstate_sop_in_dutch.pdf

Validation

Content validity: Content validity of the CogState can be considered good because it includes a broad range of cognitive functioning domains. The Cogstate testing method has been validated in international peer-reviewed journals. It targets a wide range of cognitive domains, including simple reaction time, attention, executive function and social-emotional cognition. The tests are designed to maximize the signal and minimize the noise from cognitive recordings taken in research trials. They have a proven ability to detect both improvement and decline in cognition.

Criterion/construct validity: No gold standard is currently available to measure cognitive functioning. However, The MMSE is a widely used screening instrument for cognitive function and measures global cognitive functioning 1). Based on a case control study including 21 subjects with mild cognitive impairment and 98 healthy controls (age > 60 year), the CogState had a sensitivity of 78% and specificity of 90%. This was much higher compared to the Mini Mental State examination (MMSE) (sensitivity: 44%, specificity: 69%). The study also investigated the sensitivity and specificity of the Hopkins Verbal Learning Test (HVLT) and this test had a slightly better sensitivity (79%) and specificity (95%) compared to the CogState 2). However, the HVLT is based on a paper-and-pencil test, which needs to be conducted under guidance of an assistant which may influence sensitivity and specificity. In this case-control study, participants performing the CogState were supervised by one of three psychologists through a practice session on the CogState (to maximize good performance), followed by the test battery with minimal supervision/assistance.

The test-retest reliability of different CogState subtests has been described in various studies 3) 4) 5).

Responsiveness of the instrument has been assessed by measuring decline in cognitive performance of patients with mild Alzheimer’s Disease on the International Shopping List Test (ISLT); a subtest of the CogState6). Results show that compared to controls, patients with Alzheimer’s Disease show deterioration in verbal memory over a period of one year. We would expect similar results on all other subtests of the CogState suggesting that the CogState is sensitive to changes in cognitive functioning in persons with Alzheimer’s disease. A longer period of follow-up would be needed to be able to say something about responsiveness among the general population (i.e. persons without cognitive impairments).

CogState in Lifelines: correlations between the CogState and RFFT scores are described in a paper by Kuiper et al. 7)

Versions

The Cogstate was measured during 2A Visit 1 and 3A Visit 1. During the third assessment (3A) the test was redesigned by the Cogstate research group. The test and protocol stayed the same for the participants, however more variables were measured during the test. For this reason the variables below are split between the 2A and 3A assessments.

Variable suffixes

  • To reflect the difference between the variables of 2A and 3A please pay attention to how the variables are written in the columns named 'Code'.
  • Most variables listed in the below tables are test specific. For this reason a '_XX' will be added to the variable name in data releases. Due to a database variable continuity the '_XX' suffixes per test are as followed:
Task Suffix
Detection task _01
Identification task _02
One back task _04
One Card Learning task _03


Variables 2A

Label English Code Variable Assessment Age
Test Code TCODE 2A Visit 1 13+
Total presentations or trials. cogstate_presentations_all_m_1 PRESNT 2A Visit 1 13+
Total correct responses cogstate_correct_all_m_1 COR 2A Visit 1 13+
Total error responses (includes FPos, FNeg, anticipations and max outs). cogstate_errors_all_m_1 ERR 2A Visit 1 13+
Speed measure - mean of the log10 transformed reaction time for correct responses cogstate_speedtransf_all_m_1 LMNTRANS 2A Visit 1 13+
Speed measure - mean of reaction time for correct responses cogstate_speed_all_m_1 LMNUNTRANS 2A Visit 1 13+
Speed measure - standard deviation of the log10 transformed reaction time for correct responses cogstate_logstdev_all_m_1 LSD 2A Visit 1 13+
Accuracy measure - arcsine square root transformed - hitrate (correct responses divided by total responses (total includes TPos, TNeg, FPos, FNeg, anticipations and max outs) cogstate_hitratetransf_all_m_1 ACCTRANS 2A Visit 1 13+
Accuracy measure - hit rate (correct responses divided by total responses (total includes TPos, TNeg, FPos, FNeg, anticipations and max outs) cogstate_hitrate_all_m_1 ACCUNTRANS 2A Visit 1 13+
CPAL and ISLT specific - “Stimuli”. For CPAL is total filled markers, and for ISLT is total words in the presented list. cogstate_stimuli_all_m_1 STI 2A Visit 1 13+
1)
Folstein, M. F., Folstein, S. E., & McHugh, P. R. (1975). “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research, 12(3), 189-198
2)
de Jager, C. A., Schrijnemaekers, A. C., Honey, T. E., & Budge, M. M. (2009). Detection of MCI in the clinic: Evaluation of the sensitivity and specificity of a computerised test battery, the hopkins verbal learning test and the MMSE. Age and Ageing, 38(4), 455-460
3)
Darby, D., Maruff, P., Collie, A., & McStephen, M. (2002). Mild cognitive impairment can be detected by multiple assessments in a single day. Neurology, 59(7), 1042-1046
4)
Lim, Y. Y., Jaeger, J., Harrington, K., Ashwood, T., Ellis, K. A., Stoffler, A., . . . Maruff, P. (2013). Three-month stability of the CogState brief battery in healthy older adults, mild cognitive impairment, and alzheimer's disease: Results from the australian imaging, biomarkers, and lifestyle-rate of change substudy (AIBL-ROCS). Archives of Clinical Neuropsychology : The Official Journal of the National Academy of Neuropsychologists, 28(4), 320-330
5)
Falleti, M. G., Maruff, P., Collie, A., & Darby, D. G. (2006). Practice effects associated with the repeated assessment of cognitive function using the CogState battery at 10-minute, one week and one month test-retest intervals. Journal of Clinical and Experimental Neuropsychology, 28(7), 1095-1112
6)
Lim, Y. Y., Pietrzak, R. H., Snyder, P. J., Darby, D., & Maruff, P. (2012). Preliminary data on the effect of culture on the assessment of alzheimer's disease-related verbal memory impairment with the international shopping list test. Archives of Clinical Neuropsychology : The Official Journal of the National Academy of Neuropsychologists, 27(2), 136-147
7)
Kuiper, J.S., Oude Voshaar, R.C., Verhoeven, F.E.A., Zuidema, S.U., and Smidt, N. (2017). Comparison of cognitive functioning as measured by the Ruff Figural Fluency Test and the CogState computerized battery within the LifeLines Cohort Study. BMC Psychol. 5, 15
You could leave a comment if you were logged in.
cogstate.1675440303.txt.gz · Last modified: 2023/02/03 17:05 by flip