Home › Research › Cognitive tests and assessment
Reliability and Validity of Smartphone Cognitive Testing for Frontotemporal Lobar Degeneration
Staffaroni AM, Clark AL, Taylor JC, Heuer HW, Sanderson-Cimino M, Wise AB, Dhanam S, Cobigo Y et al.. JAMA network open, 2024-04-01
Topic: Brain imaging, connectivity and assessment
Results In the 360 participants (mean [SD] age, 54.0 [15.4] years; 209 [58.1%] women), smartphone tests showed moderate-to-excellent reliability (intraclass correlation coefficients, 0.77-0.95). Preclinical participants who carried pathogenic variants performed significantly worse than noncarrier family controls on 3 app tasks (eg, 2-back β = -0.49 [95% CI, -0.72 to -0.25]; P < .001) but not a composite of traditional neuropsychological measures (β = -0.14 [95% CI, -0.42 to 0.14]; P = .32). Conclusions and relevance The findings of this cohort study suggest that smartphones could offer a feasible, reliable, valid, and scalable solution for remote evaluations of FTLD and may improve early detection. Future research should validate these results in diverse populations and evaluate the utility of these tests for longitudinal monitoring.
Key findings
- Results In the 360 participants (mean [SD] age, 54.0 [15.4] years; 209 [58.1%] women), smartphone tests showed moderate-to-excellent reliability (intraclass correlation coefficients, 0.77-0.95).
- Preclinical participants who carried pathogenic variants performed significantly worse than noncarrier family controls on 3 app tasks (eg, 2-back β = -0.49 [95% CI, -0.72 to -0.25]; P < .001) but not a composite of traditional neuropsychological measures (β = -0.14 [95% CI, -0.42 to 0.14]; P = .32).
- Conclusions and relevance The findings of this cohort study suggest that smartphones could offer a feasible, reliable, valid, and scalable solution for remote evaluations of FTLD and may improve early detection.
- Future research should validate these results in diverse populations and evaluate the utility of these tests for longitudinal monitoring.
Study details
- Study designcohort study
- Participants258
- Effect size59.3%; 20.1%; 20.7%
- Evidence strengthModerate
How this study scored 76/100
Published in a leading specialty journal, and it is a cohort study following people over time. Scored zero for randomised / blinded because the record does not state it. We have no data on journal's citation record, times cited, citations per year, impact for its field and year, cited by studies here, still being cited, senior author's track record, institution's track record and multi-centre collaboration, so those were left out: it earned 44 of the 58 points we could judge it on, which is 76 out of 100.
| Component | Points | Why |
|---|---|---|
| Journal tier | 9 / 10 | Tier 2 — leading specialty journal (JAMA network open) |
| Journal's citation record | — / 4 | No journal record from OpenAlex — left out of this score |
| Study design | 7 / 12 | A cohort study following people over time |
| Strength of evidence | 3 / 5 | Rated “moderate” in our summary |
| Peer-review validation | 10 / 10 | Peer-reviewed. Published as an article in a named peer-reviewed journal. |
| How recent | 4 / 5 | 2024 — within 3 year(s) of the newest study here |
| Sample size | 2 / 4 | 258 participants |
| Effect reported | 2 / 3 | Effect reported as a number, without an interval or test |
| Studied in people | 3 / 3 | Studied in people (participant count stated) |
| Randomised / blinded | 0 / 2 | No randomisation or blinding stated — scores zero (not stated in the record — scored 0) |
| Times cited | — / 7 | No citation count (not found in OpenAlex) — left out of this score |
| Citations per year | — / 5 | No citation count or no year — left out of this score |
| Impact for its field and year | — / 6 | No field-weighted citation impact (OpenAlex has none yet) — left out of this score |
| Cited by studies here | — / 6 | Not yet checked against this library's citation graph — left out of this score |
| Still being cited | — / 4 | No yearly citation counts — left out of this score |
| Senior author's track record | — / 4 | Senior author's record not available — left out of this score |
| Institution's track record | — / 3 | No institution listed in OpenAlex — left out of this score |
| Multi-centre collaboration | — / 3 | Institutions not listed — left out of this score |
| Indexed in PubMed | 2 / 2 | Indexed in PubMed (PMID 38558141) |
| Free to read | 2 / 2 | Free to read |
| Points | 44 / 58 | Scored on 11 of 20 parts. We have no data for the rest, so they are left out: 44 of the 58 points we could judge it on is 76 out of 100. |
| Total | 76 / 100 | — |
What each of these 20 components measures, and what this score is not →
Read the original
Free copy unknown: no free-copy check has an answer for this record yet. That does not mean it is paywalled.
Cite this study APA, Vancouver, BibTeX · download .bib or .ris
Built from the record alzhub holds for this paper, not looked up. Volume, issue and page numbers are not held in the record. The record's author list ends in “et al.”, so not every author is named. Check the citation against the original before you use it.
APA 7th
Staffaroni, A. M., Clark, A. L., Taylor, J. C., Heuer, H. W., Sanderson-Cimino, M., Wise, A. B., et al. (2024). Reliability and Validity of Smartphone Cognitive Testing for Frontotemporal Lobar Degeneration. JAMA network open. https://doi.org/10.1001/jamanetworkopen.2024.4266
Vancouver
Staffaroni AM, Clark AL, Taylor JC, Heuer HW, Sanderson-Cimino M, Wise AB, et al. Reliability and Validity of Smartphone Cognitive Testing for Frontotemporal Lobar Degeneration. JAMA network open. 2024. doi:10.1001/jamanetworkopen.2024.4266. PMID: 38558141.
BibTeX
@article{staffaroni2024-38558141,
author = {Staffaroni, A. M. and Clark, A. L. and Taylor, J. C. and Heuer, H. W. and Sanderson-Cimino, M. and Wise, A. B. and Dhanam, S. and Cobigo, Y. and others},
title = {{Reliability and Validity of Smartphone Cognitive Testing for Frontotemporal Lobar Degeneration}},
journal = {JAMA network open},
year = {2024},
doi = {10.1001/jamanetworkopen.2024.4266},
pmid = {38558141},
url = {https://doi.org/10.1001/jamanetworkopen.2024.4266}
}