Psychometric properties

Reliability and validity scores are good to adequate for most tests and comparable to results for equivalent traditional tests as reported in the literature in samples of cancer patients and healthy controls (Feenstra et al., 2017; Feenstra et al., 2018).

Correcting for computer experience

Correcting computerized neuropsychological tests for users’ (lack of) of computer experience could be useful. A dedicated study showed that correction is best done using a self-report measure on computer use, rather than a performance-based measure of computer skills (Lee Meeuw Kjoe et al., 2020).

Normative data

Currently, normative data is readily available from Dutch (N=635) and British (N=710) populations for the Dutch and British English versions of the ACS, respectively. Using these normative data, test scores can be converted to demographically-corrected norm scores, adjusted for age, sex, educational level, and computer use.

We are in the process of obtaining data from American, Canadian, and Australian populations to establish norms for the American English version of the ACS, as well as from Swedish, Danish, Spanish, and French populations for their respective translations. We are also extending our Dutch normative database.

The norms are established using an advanced regression-based statistical approach. More details about the procedure will become available in the near future, as the manuscripts are still in progress.

References

Feenstra, H.E., Murre, J.M., Vermeulen, I.E., Kieffer, J.M., & Schagen, S.B. (2017). Reliability and validity of a self-administered tool for online neuropsychological testing: the Amsterdam Cognition Scan. J Clin Exp Neuropsychol, 40(3), 253-273. [doi: 10.1080/13803395.2017.1339017] [Medline: 28671504].

Feenstra, H. E., Vermeulen, I. E., Murre, J. M., & Schagen, S. B. (2017). Online cognition: factors facilitating reliable online neuropsychological test results. The Clinical Neuropsychologist, 31(1), 59-84. [doi: 10.1080/13854046.2016.1190405].

Feenstra, H.E., Vermeulen, I.E., Murre, J.M., & Schagen, S.B. (2018). Online self-administered cognitive testing using the Amsterdam Cognition Scan: establishing psychometric properties and normative data. J Medical Internet Res, 20(5), e192 [doi: 10.2196/jmir.9298].

Lee Meeuw Kjoe, P. R., Agelink van Rentergem, J. A., Vermeulen, I. E., & Schagen, S. B. (2020). How to correct for computer experience in online cognitive testing? Assessment, 28(5), 1247-1255. [doi: 10.1177/1073191120911098].

Lee Meeuw Kjoe, P. R., Vermeulen, I. E., Agelink van Rentergem, J. A., van der Wall, E., & Schagen, S. (2022). Standardized item selection for alternate computerized versions of Rey Auditory Verbal Learning Test (-based) word lists. J Clin Exp Neuropsychol, 44(9), 681-701. [doi: 10.1080/13803395.2023.2166904]

Luijendijk, M.J., Feenstra, H.E., Vermeulen, I.E., Murre, J.M., & Schagen, S.B. (2022). Binary classification threatens the validity of cognitive impairment detection. Neuropsychology. Advance online publication. [doi: 10.1037/neu0000831]