Home › Research › Cognitive tests and assessment
Unsupervised high-frequency smartphone-based cognitive assessments are reliable, valid, and feasible in older adults at risk for Alzheimer disease
Nicosia J, Aschenbrenner AJ, Balota D, Sliwinski M, Tahan M, Adams S, Stout SH, Wilks H et al.. PsyArXiv, 2022-01-05
Topic: Risk, prevention and care in population studies
Smartphones have the potential for capturing subtle changes in cognition that characterize preclinical Alzheimer disease (AD) in older adults. The Ambulatory Research in Cognition (ARC) smartphone application is based on principles from ecological momentary assessment (EMA) and administers brief tests of associative memory, processing speed, and working memory up to 4 times per day over 7 consecutive days. ARC was designed to be administered unsupervised using participants’ personal devices in their everyday environments. We evaluated the reliability and validity of ARC in a sample of 268 cognitively normal older adults (ages 65-97) and 22 individuals with very mild dementia (ages 61-88). Participants completed at least one 7-day cycle of ARC testing and conventional cognitive assessments; most also completed cerebrospinal fluid, amyloid and tau PET, and structural MRI studies. First, results indicated that ARC tasks were reliable as between person reliability across the 7-day cycle and test-retest reliabilities at 6-month and 1-year follow-ups all exceeded 0.85. Second, ARC demonstrated construct validity as evidenced by correlations with conventional cognitive measures (r = 0.53 between composite scores). Third, ARC measures correlated with AD biomarker burden at baseline to a similar degree as conventional cognitive measures. Finally, the intensive 7-day cycle indicated that ARC was feasible (86.50% approached chose to enroll), well tolerated (80.42% adherence, 4.83% dropout), and was rated favorably by older adult participants. Overall, the results suggest that ARC is reliable and valid and represents a feasible tool for assessing cognitive changes associated with the earliest stages of AD.
Cite this study APA, Vancouver, BibTeX · download .bib or .ris
APA 7th
Nicosia, J., Aschenbrenner, A. J., Balota, D., Sliwinski, M., Tahan, M., Adams, S., et al. (2022). Unsupervised high-frequency smartphone-based cognitive assessments are reliable, valid, and feasible in older adults at risk for Alzheimer disease. PsyArXiv. https://doi.org/10.31234/osf.io/wtsyn
Vancouver
Nicosia J, Aschenbrenner AJ, Balota D, Sliwinski M, Tahan M, Adams S, et al. Unsupervised high-frequency smartphone-based cognitive assessments are reliable, valid, and feasible in older adults at risk for Alzheimer disease. PsyArXiv. 2022. doi:10.31234/osf.io/wtsyn.
BibTeX
@article{nicosia2022-6d687263,
author = {Nicosia, J. and Aschenbrenner, A. J. and Balota, D. and Sliwinski, M. and Tahan, M. and Adams, S. and Stout, S. H. and Wilks, H. and others},
title = {{Unsupervised high-frequency smartphone-based cognitive assessments are reliable, valid, and feasible in older adults at risk for Alzheimer disease}},
journal = {PsyArXiv},
year = {2022},
doi = {10.31234/osf.io/wtsyn},
url = {https://doi.org/10.31234/osf.io/wtsyn}
}
Built from the record alzhub holds for this paper, not looked up. Volume, issue and page numbers are not held in the record. The record's author list ends in “et al.”, so not every author is named. Check the citation against the original before you use it.
Key findings
- First, results indicated that ARC tasks were reliable as between person reliability across the 7-day cycle and test-retest reliabilities at 6-month and 1-year follow-ups all exceeded 0.85.
- Second, ARC demonstrated construct validity as evidenced by correlations with conventional cognitive measures (r = 0.53 between composite scores).
- Finally, the intensive 7-day cycle indicated that ARC was feasible (86.50% approached chose to enroll), well tolerated (80.42% adherence, 4.83% dropout), and was rated favorably by older adult participants.
- Overall, the results suggest that ARC is reliable and valid and represents a feasible tool for assessing cognitive changes associated with the earliest stages of AD.
Study details
- Participants22
- Effect size86.50%; 80.42%; 4.83%
- Evidence strengthLow
How this study scored 16/100
Preprint — not yet peer-reviewed. It scored 27 on the same rubric, but non-peer-reviewed sources are capped at 16, so it shows as 16. Scored zero for study design and randomised / blinded because the record does not state it. We have no data on times cited, citations per year, impact for its field and year, cited by studies here, still being cited, senior author's track record, institution's track record and multi-centre collaboration, so those were left out: it earned 17 of the 62 points we could judge it on, which is 27 out of 100.
| Component | Points | Why |
|---|---|---|
| Journal tier | 2 / 10 | Tier 4 — not a peer-reviewed journal (PsyArXiv) |
| Journal's citation record | 0 / 4 | Not a journal article, so the journal's record does not count |
| Study design | 0 / 12 | No study design recorded — scores zero, not guessed (not stated in the record — scored 0) |
| Strength of evidence | 1 / 5 | Rated “low” in our summary |
| Peer-review validation | 4 / 10 | Preprint — not yet peer-reviewed. Hosted on a preprint server. |
| How recent | 3 / 5 | 2022 — within 6 year(s) of the newest study here |
| Sample size | 1 / 4 | 22 participants |
| Effect reported | 2 / 3 | Effect reported as a number, without an interval or test |
| Studied in people | 3 / 3 | Studied in people (participant count stated) |
| Randomised / blinded | 0 / 2 | No randomisation or blinding stated — scores zero (not stated in the record — scored 0) |
| Times cited | — / 7 | No citation count (not found in OpenAlex) — left out of this score |
| Citations per year | — / 5 | No citation count or no year — left out of this score |
| Impact for its field and year | — / 6 | No field-weighted citation impact (OpenAlex has none yet) — left out of this score |
| Cited by studies here | — / 6 | Not yet checked against this library's citation graph — left out of this score |
| Still being cited | — / 4 | No yearly citation counts — left out of this score |
| Senior author's track record | — / 4 | Senior author's record not available — left out of this score |
| Institution's track record | — / 3 | No institution listed in OpenAlex — left out of this score |
| Multi-centre collaboration | — / 3 | Institutions not listed — left out of this score |
| Indexed in PubMed | 1 / 2 | Not in PubMed, but has a DOI |
| Free to read | 0 / 2 | Behind a paywall — scores zero |
| Points | 17 / 62 | Scored on 12 of 20 parts. We have no data for the rest, so they are left out: 17 of the 62 points we could judge it on is 27 out of 100. |
| Total | 27 / 100 | Capped to 16 because this is not a peer-reviewed article. |
What each of these 20 components measures, and what this score is not →
Read the original
Free copy unknown: no free-copy check has an answer for this record yet. That does not mean it is paywalled.
Related studies in Cognitive tests and assessment
Also tagged “cognitive-assessment”
4 studies in the library carry the topic tag “cognitive-assessment”; these are this study's neighbours in a fixed, alphabetical-by-hash tour of them, not the closest in content. All 4 tagged studies.