Charlotte Wray, Alysse J. Kowalski, Feziwe Mpondo, Laura Ochaeta, Delia Belleza, Ann DiGirolamo, Rachel Waford, Linda Richter, Nanette Lee, Gaia Scerif, Alan Stein, Aryeh D. Stein
Executive functions (EF) can be measured by tests assessing accuracy, reaction times and by computing scores which combine these two components. Interpretation issues can arise from the use of different scoring methods across studies. Given that EF measures and their scoring methods are predominantly developed and validated in high income countries, little is known about the generalisability of such methods cross- culturally. The current paper compares two different established scoring approaches for measures of inhibition and cognitive flexibility: difference scores (which utilise reaction time only) and computed scores (combining accuracy and reaction time). We utilised data collected in adulthood from three low- and middle-income birth cohorts (Guatemala, Philippines, South Africa). Non-normal distributions were observed for both scoring methods in all three samples; however, this was more pronounced for the difference score method. Differing distribution patterns were observed across the three cohorts, which was especially evident in the Guatemala cohort, highlighting potential issues with using these methods across diverse populations. The data suggest that the computed scores may be a reliable measure of EF. However, the different ways of scoring and interpreting EF instruments need to be considered carefully for each population before use. © 2023 Wray et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Department of Psychiatry, the University of Oxford, Oxford, United Kingdom; Nutrition and Health Sciences Program, Laney Graduate School, Emory University, Atlanta, GA, United States; DSINRF Centre of Excellence in Human Development, University of the Witwatersrand, Johannesburg, South Africa; Institute of Nutrition of Central America and Panama, Guatemala City, Guatemala; Department of Psychology, School of Arts and Sciences, University of San Carlos, Cebu, Philippines; Georgia Health Policy Center, Georgia State University, Atlanta, GA, United States; Hubert Department of Global Health, Rollins School of Public Health, Emory University, Atlanta, GA, United States; USC-Office of Population Studies Foundation Inc., University of San Carlos, Cebu, Philippines; Department of Experimental Psychology, the University of Oxford, Oxford, United Kingdom; African Health Research Institute, KwaZulu-Natal, South Africa; MRC/Wits Rural Public Health and Health Transitions Research Unit (Agincourt), School of Public Health, Faculty of Health Sciences, University of the Witwatersrand, Johannesburg, South Africa