Home › Research › Risk factors
Diagnostic accuracy of virtual cognitive assessment and testing: Systematic review and meta-analysis
Watt JA, Lane NE, Veroniki AA, Vyas MV, Williams C, Ramkissoon N, Thompson Y, Tricco AC et al.. Journal of the American Geriatrics Society, 2021-05-04
Topic: Risk, prevention and care in population studies
Plain-language summary
Background/objectives Virtual (i.e., telephone or videoconference) care was broadly implemented because of the COVID-19 pandemic. Our objectives were to compare the diagnostic accuracy of virtual to in-person cognitive assessments and tests and barriers to virtual cognitive assessment implementation. Design Systematic review and meta-analysis. Setting MEDLINE, EMBASE, CDSR, CENTRAL, PsycINFO, and gray literature (inception to April 1, 2020). Participants and interventions Studies describing the accuracy or reliability of virtual compared with in-person cognitive assessments (i.e., reference standard) for diagnosing dementia or mild cognitive impairment (MCI), identifying virtual cognitive test cutoffs suggestive of dementia or MCI, or describing correlations between virtual and in-person cognitive test scores in adults. Measurements Reviewer pairs independently conducted study screening, data abstraction, and risk of bias appraisal. Results Our systematic review included 121 studies (15,832 patients). Two studies demonstrated that virtual cognitive assessments could diagnose dementia with good reliability compared with in-person cognitive assessments: weighted kappa 0.51 (95% confidence interval [CI] 0.41-0.62) and 0.63 (95% CI 0.4-0.9), respectively. Videoconference-based cognitive assessments were 100% sensitive and specific for diagnosing dementia compared with in-person cognitive assessments in a third study. No studies compared telephone with in-person cognitive assessment accuracy. The Telephone Interview for Cognitive Status (TICS; maximum score 41) and modified TICS (maximum score 50) were the only virtual cognitive tests compared with in-person cognitive assessments in >2 studies with extractable data for meta-analysis. The optimal TICS cutoff suggestive of dementia ranged from 22 to 33, but it was 28 or 30 when testing was conducted in English (10 studies; 1673 patients). Optimal modified TICS cutoffs suggestive of MCI ranged from 28 to 31 (3 studies; 525 patients). Sensory impairment was the most often voiced condition affecting assessment. Conclusion Although there is substantial evidence supporting virtual cognitive assessment and testing, we identified critical gaps in diagnostic certainty.
Cite this study APA, Vancouver, BibTeX · download .bib or .ris
APA 7th
Watt, J. A., Lane, N. E., Veroniki, A. A., Vyas, M. V., Williams, C., Ramkissoon, N., et al. (2021). Diagnostic accuracy of virtual cognitive assessment and testing: Systematic review and meta-analysis. Journal of the American Geriatrics Society. https://doi.org/10.1111/jgs.17190
Vancouver
Watt JA, Lane NE, Veroniki AA, Vyas MV, Williams C, Ramkissoon N, et al. Diagnostic accuracy of virtual cognitive assessment and testing: Systematic review and meta-analysis. Journal of the American Geriatrics Society. 2021. doi:10.1111/jgs.17190. PMID: 33948937.
BibTeX
@article{watt2021-33948937,
author = {Watt, J. A. and Lane, N. E. and Veroniki, A. A. and Vyas, M. V. and Williams, C. and Ramkissoon, N. and Thompson, Y. and Tricco, A. C. and others},
title = {{Diagnostic accuracy of virtual cognitive assessment and testing: Systematic review and meta-analysis}},
journal = {Journal of the American Geriatrics Society},
year = {2021},
doi = {10.1111/jgs.17190},
pmid = {33948937},
url = {https://doi.org/10.1111/jgs.17190}
}
Built from the record alzhub holds for this paper, not looked up. Volume, issue and page numbers are not held in the record. The record's author list ends in “et al.”, so not every author is named. Check the citation against the original before you use it.
Key findings
- Participants and interventions Studies describing the accuracy or reliability of virtual compared with in-person cognitive assessments (i.e., reference standard) for diagnosing dementia or mild cognitive impairment (MCI), identifying virtual cognitive test cutoffs suggestive of dementia or MCI, or describing correlations between virtual and in-person cognitive test scores in adults.
- Results Our systematic review included 121 studies (15,832 patients).
- Two studies demonstrated that virtual cognitive assessments could diagnose dementia with good reliability compared with in-person cognitive assessments: weighted kappa 0.51 (95% confidence interval [CI] 0.41-0.62) and 0.63 (95% CI 0.4-0.9), respectively.
- Videoconference-based cognitive assessments were 100% sensitive and specific for diagnosing dementia compared with in-person cognitive assessments in a third study.
- The Telephone Interview for Cognitive Status (TICS; maximum score 41) and modified TICS (maximum score 50) were the only virtual cognitive tests compared with in-person cognitive assessments in >2 studies with extractable data for meta-analysis.
New to this subject? Start with our plain-English guide: Risk factors, ranked →
Study details
- Study designsystematic review
- Participants121
- Evidence strengthHigh
How this study scored 76/100
Published in a peer-reviewed journal, and it is a systematic review of all the studies on the question. Scored zero for effect reported because the record does not state it. We have no data on journal's citation record, times cited, citations per year, impact for its field and year, cited by studies here, still being cited, senior author's track record, institution's track record and multicenter collaboration, so those were left out: it earned 44 of the 58 points we could judge it on, which is 76 out of 100.
| Component | Points | Why |
|---|---|---|
| Journal tier | 7 / 10 | Tier 3 — peer-reviewed journal (Journal of the American Geriatrics Society) |
| Journal's citation record | — / 4 | No journal record from OpenAlex — left out of this score |
| Study design | 12 / 12 | A systematic review of all the studies on the question |
| Strength of evidence | 5 / 5 | Rated “high” in our summary |
| Peer-review validation | 10 / 10 | Peer-reviewed. Published as an article in a named peer-reviewed journal. |
| How recent | 3 / 5 | 2021 — within 6 year(s) of the newest study here |
| Sample size | 2 / 4 | 121 participants |
| Effect reported | 0 / 3 | No effect size reported — scores zero (not stated in the record — scored 0) |
| Studied in people | 3 / 3 | Studied in people (participant count stated) |
| Randomized / blinded | 0 / 2 | A review of other studies — randomization is not credited here |
| Times cited | — / 7 | No citation count (not found in OpenAlex) — left out of this score |
| Citations per year | — / 5 | No citation count or no year — left out of this score |
| Impact for its field and year | — / 6 | No field-weighted citation impact (OpenAlex has none yet) — left out of this score |
| Cited by studies here | — / 6 | Not yet checked against this library's citation graph — left out of this score |
| Still being cited | — / 4 | No yearly citation counts — left out of this score |
| Senior author's track record | — / 4 | Senior author's record not available — left out of this score |
| Institution's track record | — / 3 | No institution listed in OpenAlex — left out of this score |
| Multicenter collaboration | — / 3 | Institutions not listed — left out of this score |
| Indexed in PubMed | 2 / 2 | Indexed in PubMed (PMID 33948937) |
| Free to read | 0 / 2 | Behind a paywall — scores zero |
| Points | 44 / 58 | Scored on 11 of 20 parts. We have no data for the rest, so they are left out: 44 of the 58 points we could judge it on is 76 out of 100. |
| Total | 76 / 100 | — |
What each of these 20 components measures, and what this score is not →
Read the original
Free copy unknown: no free-copy check has an answer for this record yet. That does not mean it is paywalled.
Related
Studies in the library that share something with this one. The line above each title says what.
Related studies in Risk factors from nearby years
Also tagged “diagnostic-accuracy”
3 studies in the library carry the topic tag “diagnostic-accuracy”; these are this study's neighbours in a fixed, alphabetical-by-hash tour of them, not the closest in content. All 3 tagged studies.