- Research article
- Open Access
- Open Peer Review
This article has Open Peer Review reports available.
A short tool to screen HIV-infected patients for mild neurocognitive disorders – a pilot study
© Fasel et al.; licensee BioMed Central Ltd. 2014
Received: 6 June 2013
Accepted: 10 July 2014
Published: 18 July 2014
We aimed to evaluate the accuracy and acceptability of a short screening test battery for mild neurocognitive deficits.
HIV-infected individuals with a suppressed viral load were examined at the University Hospital Basel with a screening test consisting of a questionnaire and selected cognitive tests, administered by trained nurses, followed by an in-depth neuropsychological examination. Test acceptance was evaluated with a questionnaire.
30 patients were included in this study (median age of 52.5 years (interquartile range (IQR) 47–64), prior AIDS-defining condition in 37%, median CD4 cell count 658 (IQR 497–814) cells/μl). Overall, 25 (83%) patients were diagnosed with HIV-associated neurocognitive disorders (HAND) on in-depth neuropsychological assessment (16 patients had asymptomatic neurocognitive impairment (ANI), 8 a mild neurocognitive disorder (MND) and 1 patient HIV-associated dementia (HAD). Among 25 patients with HAND, only 9 patients (36%) were complaining of memory loss. The screening battery revealed neurocognitive deficits in 17 (57%) patients (sensitivity 64%, specificity 80%, positive predictive value 94% and negative predictive value 31%). Most patients (83%) estimated the screening test as valuable and not worrisome.
A questionnaire combined with selected neuropsychological tests is a short, easy-to-perform very well accepted screening tool for mild neurocognitive disorders in asymptomatic HIV-infected individuals.
Combined antiretroviral therapy (cART) has dramatically changed the prognosis of HIV-infection (Mocroft et al. 2003; Weber et al. 2012; Stöckle et al. 2012; Jaggy et al. 2003; Egger et al. 2002). Given a timely diagnosis and treatment, life expectancy is most likely only marginally decreased compared to the general population (The Antiretroviral Therapy Cohort Collaboration 2008). Therefore, with increasing age of HIV patients, long-term aspects such as neurotoxic effects of the virus and possibly of treatments gain importance (Robertson et al. 2009). Losses in memory function, psychomotor speed and/or executive functions may occur at a higher frequency in HIV-infected compared to HIV-negative individuals (Robertson Robertson et al. 2009). Cognitive disorders may negatively impact behaviour (Hinkin et al. 2002), autonomy in everyday life, and risk behaviour (Gonzalez et al. 2005; Vance & Struzick 2007), leading to a diminished quality of life, lower adherence to cART and increased mortality. An early diagnosis of cognitive impairment is important for the initiation of cART which can then lead to improvements of neurocognitive symptoms (Cysique & Brew 2009; Joska et al. 2010; Tozzi et al. 2007).
Definition of HIV-associated neurocognitive disorders (HAND) include three conditions: asymptomatic neurocognitive impairment (ANI), HIV-associated mild neurocognitive disorder (MND) and HIV-associated dementia (HAD). The prevalence of HAND was estimated to be 69% in HIV-infected persons in Switzerland who have been successfully treated for many years (Simioni et al. 2010). In a US study (Robertson et al. 2007), 21% of asymptomatic HIV-infected individuals fulfilled the criteria for ANI. Subjective reports about cognitive symptoms seem to be unreliable as up to 64% of asymptomatic patients were found to have cognitive impairment on neuropsychological assessment (Simioni et al. 2010). A patient’s underestimation of his own cognitive deficits is possibly due to a deficit in meta-memory, i.e. an executive dysfunction (Woods et al. 2009). On the other hand, overestimation of one's own cognitive deficit is frequently seen in patients with depressive disorders (Rourke et al. 1999; Carter et al. 2003). Various screening tests like the HIV dementia scale (HDS) (Power et al. 1995), the EXIT interview (Berghuis et al. 1999), the Mental Alternation Test (Jones et al. 1993), the modified Memorial Sloan-Kettering Scale (Marder et al. 2003) or the International HIV Dementia Scale (IHDS) (Sacktor et al. 2005) are used to identify HIV associated dementia, but these tests are not sensitive enough to detect the milder forms of HAND, i.e. ANI and MND, which are more prevalent in the HIV population (Singh et al. 2010; Carey et al. 2004). Recently, a score ≤ 14 points on the HDS (Power et al. 1995) was found to yield a positive predictive value of HAND of 92% in complainers and 82% in non-complainers (Robertson et al. 2007).
A useful screening test must have acceptable psychometric properties. Carey et al. (Carey et al. 2004) were able to show that a combination of only two validated and standardised neuropsychological tests was better at classifying patients with cognitive disorders than the HDS alone. The neuropathological changes caused by the HIV infection mainly affect the fronto-striato-thalamo-cortical circuit, deficits in processing speed, executive functions and verbal episodic memory (Robertson et al. 2009; Woods et al. 2009). The most frequently used tests which are viewed as sensitive are the verbal memory tasks (Singh et al. 2010; Carey et al. 2004; Skinner et al. 2009), the Trail Making Test part A and B (1944; Tombaugh et al. 1998), the Grooved Pegboard Test (Ruff & Parker 1993), the Digit Symbol Test (Härting et al. 2000; Aster et al. 2006), and the Digit Span forwards and backwards (Härting et al. 2000). Combination of the Hopkins Verbal Learning Test – Revised (HVLT-R) (Benedict et al. 1998) with the Digit Symbol Test (Härting et al. 2000; Aster et al. 2006) or with the Grooved Pegboard Test (Ruff & Parker 1993) non-dominant hand yielded a sensitivity of 75-78% and a specificity of 85-92%, respectively, in detecting mild cognitive disorders in HIV-infected individuals (Carey et al. 2004).
Taking the above mentioned findings into account, the aims of this study were to evaluate the performance and to assess the acceptability of a German-language screening battery consisting of a short questionnaire and seven brief neuropsychological tests administered by trained nurses to screen for neurocognitive deficits in treated HIV-infected patients.
The protocol was approved by the local Ethics Committee “Ethikkommission beider Basel”. All patients gave written informed consent.
Study participants were 30 HIV-infected individuals in care at the HIV Clinic of the University Hospital Basel, Switzerland meeting the following inclusion criteria: age ≥18 years, cART since ≥6 months, an undetectable HIV viral load (<50 copies/mL) for ≥3 months, and to be a German native speaker. Exclusion criteria were auditory, visual or motor deficits, clinical signs of disorientation, current injecting drug use, current major depression according to Diagnostic and Statistical Manual of Mental Disorders (Trull et al. 2012), neurologic or severe psychiatric conditions that affect cognition, and a history of opportunistic infection of the central nervous system within the last 2 years. The following data were collected at the time of the screening test and obtained from the prospective data collection of the Swiss HIV Cohort Study: age, education, gender, CDC stage, CD4 cell count, HIV viral load, co-infection with hepatitis C, co-medication, drug and alcohol consumption, history for cART, opportunistic diseases and syphilis. Medical history of thyroid or vitamin B12 deficiency was not reviewed.
Study procedures and examination tools
Two study nurses were trained by a neuropsychologist on how to perform the screening battery according to standard procedures. The screening test consisted of a short questionnaire and seven selected neuropsychological tests based on theory-led principles and psychometric criteria, and it has already proven its value in a similar form in HIV-infected individuals (Carey et al. 2004). The time needed to perform the short examination was recorded and its acceptance was evaluated by a feedback questionnaire for both patients and nurses.
Our screening battery comprised a questionnaire and a short examination of selective cognitive functions.
Following questions were asked to investigate cognitive functions: Do you frequently experience memory loss (e.g. do you forget the occurrence of special events even the more recent ones, appointments, etc.)? Do you feel that you are slower when reasoning, planning activities, or solving problems? Do you have difficulties in paying attention (e.g. to a conversation, a book, or a movie)? Patients could answer with ‘never’ , ‘rarely’ , ‘sometimes’ , ‘often’ or ‘always’.
As individuals may overestimate or underestimate their own deficits when making subjective statements on cognitive losses (Hinkin et al. 2002), we added two questions to increase the robustness of the subjective statements: one on everyday memory complaint because memory losses are frequently reported in this area (Woods et al. 2009): Do you intend to do something and then you forget what it was (e.g. do you go into another room to fetch something and then forget what you wanted to get)? The second refers to whether friends or family made remarks on the individual’s diminished cognitive skills: Do friends and/or members of your family tell you that your brain power has deteriorated?
The following two questions were asked to estimate whether there was a clinically relevant depression (Sacktor et al. 2005): How often did you note little interest or pleasure in doing things over the past 2 weeks? How often did you experience feeling down, depressed or hopeless over the past 2 weeks? Patients could answer with ‘not at all’ , ‘several days’ , ‘more than half the days’ or ‘nearly every day’.
2. Examination of selected cognitive functions
List of the seven tests used to evaluate the four domains (cognitive speed, memory, executive function and motor speed)
number of seconds to complete part A and part B
number of correct items
wordlist from the Multiple Sclerose Inventarium Cognition (Calabrese et al. 2004)
number of correct items on 10 items learning and delayed recall
number of seconds to complete part B
number of correct items
Grooved Pegboard (Ruff & Parker 1993) with dominant and non-dominant hand
number of seconds needed for completion
number of seconds to complete part A and part B
Following the above some tests counted for more than one domain, e.g., if the result in TMT part A was below 1 standard deviation, it counted in the domains "cognitive speed" and "motor speed".
The domains were considered as pathological, if one result in this domain was pathological, ie, a standard score below -1.0. The cognitive screening was considered pathological if the patient had deficits in two or more domains.
Nurses who administered the screening test were provided with a table indicating pathological performance. For example, a TMT part A result of more than 40 seconds from a subject aged between 40 and 49 years was considered pathological.
Acceptance of the screening battery
A feedback questionnaire was filled out by each patient and the study nurse to evaluate the acceptance of the screening test. The questionnaire for patients comprised the following questions: Is the test too difficult? Are the instructions clear? Does the test respect your privacy? Is the screening reasonable? Is the test burdening? Are you interested in the results of the examination? Is the test too long? The questionnaire for study nurses included following questions: Is the test too difficult for patients? Is the screening reasonable? Is the test burdening for the study nurse? Is the test too long?
The patients and nurses could answer on a scale of 1–5 (not at all – totally).
The questionnaire for nurses comprised also the following questions: Were there any ambiguities or uncertainties in the instructions? Were there any ambiguities or uncertainties in the evaluation? Were there any ambiguities or uncertainties in the interpretation?
The nurses were also able to attach comments or suggestions.
In-depth neuropsychological assessment
Within one month, study participants were examined at the Basel Memory Clinic by a neuropsychologist using a comprehensive test battery to evaluate HAND. The examining neuropsychologist had no access to the results of the screening test.
The comprehensive neuropsychological examination, lasting for two hours, covered the following tasks: German version of the California Verbal Learning Test (Delis et al. 1987) (when age ≥ 50 years) or the Verbal Learning and Memory Test (Helmstadter et al. 2001) (when age < 50 years); Figural Fluency (Regard et al. 1982), modified Wisconsin Card Sorting Test (Nelson 1976); Rey-Osterrieth Complex Figure (Rey 1941); verbal fluency (semantic and phonemic) (Morris et al. 1989), Color Trails 1 and 2 (D’Elia et al. 1996); Boston Naming Test, 15 items (Nelson 1976); Digit Span (Härting et al. 2000; Aster et al. 2006), Color Word Interference Test (Stroop 1935) and Test of Attentional Performance (divided attention and alertness) (Fimm & Zimmermann 2009).
Basic socio-demographic characteristics, CD4 cell count, and cART were compared using the Chi-square test or Fisher’s exact test for categorical variables, and the Mann–Whitney test for continuous variables. All analyses were performed using STATA software version 11 for Windows (STATA Corp, College Station, Texas, USA).
A total of 30 patients were included in this study between January 2011 and July 2011 at the HIV-Clinic of the University Hospital Basel. The median age was 52.5 years (interquartile range (IQR) 47–64) and most patients (87%) were males. One patient had a HIV viral load of 58 copies/mL, another one 65 copies/mL. Five patients had an elevated HIV viral load (range 86–3594 copies/mL) within 6 months before this investigation. The median CD4 cell count was 658 cells/μL (IQR 497–814); 11 patients (37%) had previously been diagnosed with an AIDS-defining infection, one of these suffering from cerebral toxoplasmosis 12 years before without clinically obvious neurological sequelae. Among co-morbidities, 3 patients (10%) had co-infection with hepatitis C, one patient had a history of transient ischemic attack many years before, and 5 patients (16.7%) had previously been treated for syphilis (stage I-II). Lumbar puncture yielding a negative syphilis serology of CSF was only done in one patient. We did not routinely carry out a lumbar puncture when patients had no clinical signs of involvement of the central nervous system between 6 months and 9 years before this investigation.
Prevalence of HAND
Overall, 25 (83%) patients were diagnosed with HAND based on in-depth neuropsychological assessments. Of these, 16 patients (64%) had ANI, 8 (32%) MND, and 1 patient HAD. Among the 25 patients with HAND, only 9 patients (36%) were complaining of memory loss or difficulties to concentrate. The patient with HAD had HIV-infection CDC B3 with no relevant co-morbidity, in particular no obvious neurological disease. He was treated with an efavirenz-containing antiretroviral regimen. One of the 8 patients (13%) with MND and 5 (31%) of the 16 patients with ANI were also treated with an efavirenz-containing regimen. The 5 patients with a treated syphilis were diagnosed with ANI (n = 3), MND (n = 1), and no cognitive impairment (n = 1).
ANI was also diagnosed in one patient with stroke and in another patient with a history of cerebral toxoplasmosis. Also, two patients with occasional drug consumption (inhalative cocain, ketamin, methadon) had ANI. One patient with daily cannabis consumption had MND.
Raw scores of the in-depth neuropsychological assessment
California Verbal Learning Test (n = 18):
Learning (trial 1–5)
Short Delay Free Recall
Long Delay Free Recall
Recognition Discriminability (%)
Verbal Learning and Memory Test (n = 12):
Learning (trial 1–5)
Modified Wisconsin Card Sorting Test:
Rey-Osterrieth Complex Figure:
Semantic Fluency (Animals), 1’
Phonemic Fluency (S-Words), 1’
Color Trails 1
Color Trails 2
Boston Naming Test
Digit Span forward
Digit Span backward
Color Word Interference Test Time 1 (s)
Color Word Interference Test Time 3/1
Test of Attention Performance:
Divided Attention Auditive (ms), Median
Divided Attention Visual (ms), Median
Alertness (ms), Median
Validity of questions addressing subjective cognitive impairment (SCI)
Twenty-five of the 30 patients were diagnosed with HAND based on the in-depth neuropsychological assessment. Among those, nine had reported a SCI (ie, sensitivity of SCI = 36%). Five patients had received a diagnosis of normal cognition after the in-depth neuropsychological assessment. Two of those had not reported SCI (ie, specificity of SCI = 40%). Thus, questions addressing SCI did not separate between those with and those without HAND.
Screening test battery
Performance of the screening battery according to the presence of HAND at the in-depth neuropsychological examination
In-depth neuropsychological assessment
sensitivity = 64%
PPV = 94%
specificity = 80%
NPV = 31%
General characteristics of the study population (n = 30) according to results of the screening battery
Pathological screening test N = 17
Normal screening test N = 13
Median Age, IQR
Prior AIDS-defining condition
Median CD4 cell count, IQR
Median years of education, IQR
cART containing efavirenz
Co-medication with psychotropic drugs (antidepressants, antipsychotics)
Memory loss or difficulties to concentrate reported by the patient*
Median duration of screening battery, minutes, IQR
Acceptance of the screening battery
The overall acceptance of the screening battery was excellent. Most patients (83%) estimated the screening test as valuable and not worrisome, and were interested in the results. Most participants (97%) considered the instructions for the test given by the study nurses as clear and the test battery as not difficult or partly difficult in 43% and 57% of patients, respectively. Privacy was not affected by the test according to 93% of patients, and nobody reported that the test was too long. Study nurses also judged the screening battery as not too difficult for patients, valuable and not worrisome, and not too long.
In this study, investigating a specific combination of tests comprising a short questionnaire and a battery of selected neuropsychological tests for mild neurocognitive deficits in 30 HIV-infected individuals receiving cART, we found a moderate sensitivity and specificity when comparing to the in-depth neuropsychological examination serving as the criterion standard. Importantly, we found a high acceptance rate by patients and nurses. The sensitivity and specificity for this screening battery was increased in patients not complaining of memory loss or difficulties in concentration. If we combined results of the screening battery with those from the questionnaire (either one or both tests positive) we reached a sensitivity of 84% with a PPV of 88% and a NPV of 33%, making this screening strategy, administered by nurses, a simple, well accepted tool to screen treated HIV-infected individuals for mild neurocognitive disorders.
The prevalence of HAND in our study population was high (83%). This is in agreement with other studies (Simioni et al. 2010). This is remarkable since all patients were not of older age, had no major psychiatric diseases and were not currently injecting drug users. Also, almost all patients had experienced a long school and professional education. Furthermore, nearly all patients had a suppressed viral load and were immunologically stable under continuous cART.
We consider the two viral load measurements in two patients (58 copies/mL and 65 copies/mL, respectively) as technical blips, however, we cannot rule out a low level viral replication. Five patients had an elevated HIV viral load (range 86–3594 copies/mL) within 6 months before this investigation. The patient with 3594 copies/ml did not take his medication at this time. Within the last 3 months before the examination, however, the viral load was suppressed.
Importantly, we could neither find any association with a cART regimen, in particular with efavirenz-based cART, nor with co-morbidities possibly affecting the neurocognitive performance. Interestingly, objective evidence of HAND was slightly more frequent in patients without complaints suggesting that an easy screening tool is very valuable before neuropsychological examination with more sophisticated instruments. Complaints about memory loss and difficulties to concentrate are difficult to interpret and also frequently reported by HIV-negative individuals (20-70%) without objective cognitive impairment (St John & Montgomery 2002; Reid & Maclullich 2006).
One of the problems encountered with investigating a new screening battery is the lack of a clear criterion standard. However, the in-depth neuropsychological examination has been well validated for cognitive assessment. The search for a good, easy-to-perform screening test is still justified, as the international HDS (Sacktor et al. 2005) and the HDS (Power et al. 1995) that are widely used as screening tests to identify individuals at risk for HAD (Sacktor et al. 2005), are not enough sensitive to detect mild forms of neurocognitive deficits. However, the HIV dementia scale with a cut-off of 14 points was shown to have a sensitivity of 83%, specificity of 63% and a PPV of 92% to detect HAND in patients with complaints and a sensitivity of 88%, specificity of 67% and PPV of 82% in non-complaining patients (Simioni et al. 2010). As a preliminary but encouraging result of this pilot study, our screening battery showed a similar accuracy as the HDS. An advantage may be that our screening battery does not comprise the anti-saccadic eye movement task, which can be challenging for the examiner. In addition to using cognitive tests only it incorporates the information about the patient's subjective cognitive impairment. Importantly, our approach to improve the screening for HAND requires a great deal of further work. In line with the suggestions outlined by Kamminga et al. (2013), at least the following points need to be addressed: (a) use of a representative sample of the HIV population, (b) inclusion of a control (HIV-) group with similar characteristics to optimally assess HAND specificity, (c) a more explicit rationale for screen impairment criteria, (d) reporting of all standard criterion validity indexes, (e) reporting of construct validity, and (f) assessing the longitudinal validity of the screening tool including correction for practice effects. Moreover, acceptability was excellent by patients and nurses.
We acknowledge some limitations: First, the number of patients was too small to draw conclusions regarding specific associations for neurocognitive deficits and cART regimen, e.g. efavirenz-based treatment that may impact on the central nervous system, or specific co-morbidities. Second, we did not perform MRI examinations of the brain nor lumbar punctures to exclude other causes of neurocognitive impairment than HIV. Third, the HIV dementia scale (Sacktor et al. 2005) was not performed in our study population, so that a direct comparison with our screening test was not possible. Forth, the use of the same variable to assess different cognitive domains is problematic. This variable receives an unjustified importance and may lead to invalid results. Furthermore, combining the results of a screening battery with a questionnaire for subjective cognitive impairment is not in line with the Frascati criteria (Antinori et al. 2007). However, this more comprehensive screening approach will allow the medical staff to detect not only patients with HAND, but also others, who might be in need of medical care, which in our view is an advantage.
In our study the prevalence of HAND was high. This may be due to the fact that patients with HCV co-infection, history of ischemic stroke, drug use and previous cerebral opportunistic infections were included in this study.
Drug use was assessed by self-report. We acknowledge self-report and potential interference of drug use as a limitation. Future research should also exclude patients with occasional drug consumption.
This study also has several strengths: First, this is the first study investigating a short screening battery with selected neuropsychological tests that were administered by nurses. Second, all 30 patients were underwent comprehensive neuropsychological assessments. Third, the fact that all patients were participating in the prospective Swiss HIV Cohort Study enabled us to assess important co-morbidities such as depression or syphilis and the corresponding treatments.
In conclusion, our study demonstrates that screening for neurocognitive deficits is likely to identify milder forms of cognitive disorders even in non-complaining patients. A short questionnaire combined with a small battery of selected neuropsychological tests is a short, easy-to-perform screening tool for HIV-infected individuals.
We acknowledge all patients and study nurses who participated in this study. The authors wish to thank Prof. Dr. Manfred Berres for the statistical support and the Swiss HIV Cohort Study for support of the data collection.
This study was in part presented at the 11th International Conference on HIV drug therapy 2012, Glasgow, UK.
This study was supported by a research grant by Abbott Switzerland and by the Stiftung Forschung Infektionskrankheiten (SFI project #37).
- Antinori A, Arendt G, Becker JT, Brew BJ, Byrd DA, Cherner M, Clifford DB, Cinque P, Epstein LG, Goodkin K, Gisslen M, Grant I, Heaton RK, Joseph J, Marder K, Marra CM, McArthur JC, Nunn M, Price RW, Pulliam L, Robertson KR, Sacktor N, Valcour V, Wojna VE: Updated research nosology for HIV-associated neurocognitive disorders. Neurology. 2007, 69 (18): 1789-1799.View ArticlePubMedPubMed CentralGoogle Scholar
- Aster M, Neubauer A, Horn R: Wechsler Intelligenztest für Erwachsene (WIE). Manual. 2006, Frankfurt: Harcourt Test ServicesGoogle Scholar
- Benedict RHB, Schretlen D, Groninger L, Brandt J: The Hopkins verbal learning test-revised: normative data and analysis of inter-form and test-retest reliability. Clinical Neuropsychology. 1998, 12: 43-55.View ArticleGoogle Scholar
- Berghuis JP, Uldall KK, Lalonde B: Validity of two scales in identifying HIV-associated dementia. Journal of Acquired Immune Deficiency Syndromes. 1999, 21: 134-140.PubMedGoogle Scholar
- Calabrese P, Kalbe E, Kessler J, Calabrese P, Kalbe E, Kessler J: Ein neuropsychologisches screening zur Erfassung kognitiver Störungen bei MS-Patienten – Das Multiple Sklerose Inventarium Cognition (MUSIC). NeuroPsychol. 2004, 30: 384-388.Google Scholar
- Carey CL, Woods SP, Rippeth JD, Gonzalez R, Moore DJ, Marcotte TD, Grant I, Heaton RK, HNRC Group: Initial validation of a screening battery for the detection of HIV-associated cognitive impairment. Clinical Neuropsychology. 2004, 18: 234-248.View ArticleGoogle Scholar
- Carter SL, Rourke SB, Murji S, Shore D, Rourke BP: Cognitive complaints, depression, medical symptoms, and their association with neuropsychological functioning in HIV infection: a structural equation model analysis. Neuropsychology. 2003, 17: 410-419.View ArticlePubMedGoogle Scholar
- Cysique LA, Brew BJ: Neuropsychological functioning and antiretroviral treatment in HIV/AIDS: a review. Neuropsychology Review. 2009, 19: 169-185.View ArticlePubMedGoogle Scholar
- D’Elia LF, Satz P, Uchiyama CL, White T: Color Trails Test. Professional manual. 1996, Odessa, FL: Psychological Assessment ResourcesGoogle Scholar
- Delis DC, Kramer JH, Kaplan E, Ober BA: The California Verbal Learning Test. 1987, New York: The Psychological CorporationGoogle Scholar
- Egger M, May M, Chêne G, Phillips AN, Ledergerber B, Dabis F, Costagliola D, D'Arminio Monforte A, de Wolf F, Reiss P, Lundgren JD, Justice AC, Staszewski S, Leport C, Hogg RS, Sabin CA, Gill MJ, Salzberger B, Sterne JA: Prognosis of HIV-1-infected patients starting highly active antiretroviral therapy: a collaborative analysis of prospective studies. Lancet. 2002, 360: 119-129.View ArticlePubMedGoogle Scholar
- Fimm B, Zimmermann P: Test zur Aufmerksamkeitsprüfung (TAP) Version 2.2. 2009, Herzogenrath: PsytestGoogle Scholar
- Gonzalez R, Vassileva J, Bechara A, Grbesic S, Sworowski L, Novak RM, Nunnally G, Martin EM: The influence of executive functions, sensation seeking, and HIV serostatus on the risky sexual practices of substance-dependent individuals. Journal of the International Neuropsychological Society. 2005, 11: 121-131.View ArticlePubMedGoogle Scholar
- Härting C, Markowitsch HJ, Neufeld H, Calabrese P, Deisinger K, Kessler J: Deutsche Adaption der revidierten Fassung der Wechsler Memory Scale (WMS- R). 2000, Göttingen: Hans Huber- VerlagGoogle Scholar
- Helmstadter C, Lendt M, Lux S: Verbaler Lern- und Merkfähigkeitstest: VLMT, Manual. 2001, Gottingen: Beltz Test GmbHGoogle Scholar
- Hinkin CH, Castellon SA, Durvasula RS, Hardy DJ, Lam MN, Mason KI, Thrasher D, Goetz MB, Stefaniak M: Medication adherence among HIV + adults: effects of cognitive dysfunction and regimen complexity. Neurology. 2002, 59: 1944-1950.View ArticlePubMedPubMed CentralGoogle Scholar
- Jaggy C, von Overbeck J, Ledergerber B, Schwarz C, Egger M, Rickenbach M, Furrer HJ, Telenti A, Battegay M, Flepp M, Vernazza P, Bernasconi E, Hirschel B: Mortality in the Swiss HIV Cohort Study (SHCS) and the Swiss general population. Lancet. 2003, 362: 877-878.View ArticlePubMedGoogle Scholar
- Jones BN, Teng EL, Folstein MF, Harrison KS: A new bedside test of cognition for patients with HIV infection. Annals of Internal Medicine. 1993, 119: 1001-1004.View ArticlePubMedGoogle Scholar
- Joska JA, Gouse H, Paul RH, Stein DJ, Flisher AJ: Does highly active antiretroviral therapy improve neurocognitive function? A systematic review. Journal of Neurovirology. 2010, 16: 101-114.View ArticlePubMedGoogle Scholar
- Kamminga J, Cysique LA, Lu G, Batchelor J, Brew BJ: Validity of cognitive screens for HIV-associated neurocognitive disorder: a systematic review and an informed screen selection guide. Current HIV/AIDS Reports. 2013, 10 (4): 342-355. 10.1007/s11904-013-0176-6View ArticlePubMedPubMed CentralGoogle Scholar
- Marder K, Albert SM, McDermott MP, McArthur JC, Schifitto G, Selnes OA, Sacktor N, Stern Y, Palumbo D, Kieburtz K, Cohen B, Orme C, Epstein LG: Inter-rater reliability of a clinical staging of HIV-associated cognitive impairment. Neurology. 2003, 60: 1467-1473.View ArticlePubMedGoogle Scholar
- Mocroft A, Ledergerber B, Katlama C, Kirk O, Reiss P, d'Arminio Monforte A, Knysz B, Dietrich M, Phillips AN, Lundgren JD: Decline in the AIDS and death rates in the EuroSIDA study: an observational study. Lancet. 2003, 362: 22-29.View ArticlePubMedGoogle Scholar
- Morris JC, Edland S, Clark C, Galasko D, Koss E, Mohs R, van Belle G, Fillenbaum G, Heyman A: The Consortium to Establish a Registry for Alzheimer’s Disease (CERAD). Part I. Clinical and neuropsychological assessment of Alzheimer’s disease. Neurology. 1989, 39: 1159-1165.View ArticlePubMedGoogle Scholar
- Nelson HE: A modified card sorting test sensitive to frontal lobe defects. Cortex. 1976, 12: 313-324.View ArticlePubMedGoogle Scholar
- Power C, Selnes OA, Grim JA, McArthur JC: HIV Dementia Scale: a rapid screening test. Journal of Acquired Immune Deficiency Syndromes and Human Retrovirology. 1995, 8: 273-278.View ArticlePubMedGoogle Scholar
- Regard M, Strauss E, Knapp P: Children’s production on verbal and non-verbal fluency tasks. Perceptual and Motor Skills. 1982, 55: 839-844.View ArticlePubMedGoogle Scholar
- Reid LM, Maclullich AMJ: Subjective memory complaints and cognitive impairment in older people. Dementia and Geriatric Cognitive Disorders. 2006, 22: 471-485.View ArticlePubMedGoogle Scholar
- Rey A: L’examen psychologique dans les cas d’encephalopathie traumatique. Archives of Psychology. 1941, 28: 286-340.Google Scholar
- Robertson KR, Smurzynski M, Parsons TD, Wu K, Bosch RJ, Wu J, McArthur JC, Collier AC, Evans SR, Ellis RJ: The prevalence and incidence of neurocognitive impairment in the HAART era. AIDS. 2007, 21: 1915-1921.View ArticlePubMedGoogle Scholar
- Robertson K, Liner J, Heaton R: Neuropsychological assessment of HIV-infected populations in international settings. Neuropsychology Review. 2009, 19: 232-249.View ArticlePubMedPubMed CentralGoogle Scholar
- Rourke SB, Halman MH, Bassel C: Neurocognitive complaints in HIV-infection and their relationship to depressive symptoms and neuropsychological functioning. Journal of Clinical and Experimental Neuropsychology. 1999, 21: 737-756.View ArticlePubMedGoogle Scholar
- Ruff RM, Parker SB: Gender- and age-specific changes in motor speed and eye-hand coordination in adults: normative values for the Finger Tapping and Grooved Pegboard Tests. Perceptual and Motor Skills. 1993, 76: 1219-1230.View ArticlePubMedGoogle Scholar
- Sacktor NC, Wong M, Nakasujja N, Skolasky RL, Selnes OA, Musisi S, Robertson K, McArthur JC, Ronald A, Katabira E: The International HIV Dementia Scale: a new rapid screening test for HIV dementia. AIDS. 2005, 19: 1367-1374.PubMedGoogle Scholar
- Simioni S, Cavassini M, Annoni JM, Rimbault Abraham A, Bourquin I, Schiffer V, Calmy A, Chave JP, Giacobini E, Hirschel B, Du Pasquier RA: Cognitive dysfunction in HIV patients despite long-standing suppression of viremia. AIDS. 2010, 24: 1243-1250.PubMedGoogle Scholar
- Singh D, Joska JA, Goodkin K, Lopez E, Myer L, Paul RH, John S, Sunpath H: Normative scores for a brief neuropsychological battery for the detection of HIV-associated neurocognitive disorder (HAND) among South Africans. BMC Research Notes. 2010, 3: 28-View ArticlePubMedPubMed CentralGoogle Scholar
- Skinner S, Adewale AJ, DeBlock L, Gill MJ, Power C: Neurocognitive screening tools in HIV/AIDS: comparative performance among patients exposed to antiretroviral therapy. HIV Medicine. 2009, 10: 246-252.View ArticlePubMedGoogle Scholar
- St John P, Montgomery P: Are cognitively intact seniors with subjective memory loss more likely to develop dementia?. International Journal of Geriatric Psychiatry. 2002, 17: 814-820.View ArticlePubMedGoogle Scholar
- Stöckle M, Elzi L, Rockstroh JK, Battegay M: Morbidity and mortality in HIV infection. Internist (Berl). 2012, 53: 1151-1156.View ArticleGoogle Scholar
- Stroop JR: Studies of interference in serial verbal reactions. Journal of Experimental Psychology. 1935, 18: 643-662.View ArticleGoogle Scholar
- The Antiretroviral Therapy Cohort Collaboration: Life expectancy of individuals on combination antiretroviral therapy in high-income countries: a collaborative analysis of 14 cohort studies. Lancet. 2008, 372: 293-299.View ArticlePubMed CentralGoogle Scholar
- Tombaugh TN, Rees L, McIntyre N: Normative data for the Trail Making Test. Personal communication cited in Spreen and Strauss. A compendium of neuropsychological tests: Administration, norms and commentary (2nd ed.). 1998, New York: Oxford University PressGoogle Scholar
- Tozzi V, Balestra P, Bellagamba R, Corpolongo A, Salvatori MF, Visco-Comandini U, Vlassi C, Giulianelli M, Galgani S, Antinori A, Narciso P: Persistence of neuropsychologic deficits despite long-term highly active antiretroviral therapy in patients with HIV-related neurocognitive impairment: prevalence and risk factors. Journal of Acquired Immune Deficiency Syndromes. 2007, 45: 174-182.View ArticlePubMedGoogle Scholar
- Trail Making Test: Army Individual Test Battery. Manual of directions and scoring. 1944, Washington, DC: War Department, Adjutant General’s OfficeGoogle Scholar
- Trull TJ, Vergés A, Wood PK, Jahng S, Sher KJ: The structure of Diagnostic and Statistical Manual of Mental Disorders (4th edition, text revision) personality disorder symptoms in a large national sample. Personal Disorder. 2012, 3: 355-369.View ArticleGoogle Scholar
- Vance DE, Struzick TC: Addressing risk factors of cognitive impairment in adults aging with HIV: a social work model. Journal of Gerontological Social Work. 2007, 49: 51-77.View ArticlePubMedGoogle Scholar
- Weber R, Ruppik M, Rickenbach M, Spoerri A, Furrer H, Battegay M, Cavassini M, Calmy A, Bernasconi E, Schmid P, Flepp M, Kowalska J, Ledergerber B: Decreasing mortality and changing patterns of causes of death in the Swiss HIV Cohort Study. HIV Medicine. 2012, Published Online First: 24 September 2012. doi:10.1111/j.1468-1293.2012.01051.xGoogle Scholar
- Woods SP, Moore DJ, Weber E, Grant I: Cognitive neuropsychology of HIV-associated neurocognitive disorders. Neuropsychology Review. 2009, 19: 152-168.View ArticlePubMedPubMed CentralGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://0-www.biomedcentral.com.brum.beds.ac.uk/2050-7283/2/21/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited.