Validation and reliability of The Childhood Executive Function Inventory (CHEXI) in Spanish primary school students

  1. Pedro Javier Conesa 1
  2. Iban Onandía-Hinchado 2
  3. Jon Andoni Duñabeitia 3
  1. 1 Universidad de Murcia, Murcia, Spain
  2. 2 Psicologia Amorebieta, Amorebieta, Spain
  3. 3 Universidad Antonio de Nebrija, Madrid, Spain.
Show affiliations +
Journal:
Revista de Psicología Clínica con Niños y Adolescentes

ISSN: 2340-8340

Year of publication: 2023

Issue Title: (Septiembre 2023)

Volume: 10

Issue: 3

Type: Article

DIALNET GOOGLE SCHOLAR lock_openDialnet editor

More publications in: Revista de Psicología Clínica con Niños y Adolescentes

Abstract

Given the enormous influence of executive functions in school and life success, it is necessary to identify EF levels and address them in a reliable way with tools accessible to practitioners. Two studies were conducted. In study 1, the psychometric properties of the Spanish version Children’s Executive Functioning Inventory (CHEXI) in a representative sample of 1230 primary school students from 9 to 12 years old was investigated. According to Barkley’s hybrid model, CHEXI showed good fit indices on the two subscales: working memory and inhibition (Χ² =949.32, p < 0.001, CFI = 0.98, TLI = 0.98, SRMR = 0.06, RMSEA = 0.05), as well as excellent internal consistency (ω ≥ 0.84–0.91; α ≥ 0.84–0.91). In study 2, the efficacy of the CHEXI for the observation of EF deficits related to ADHD symptoms in children was analysed. Significant differences in parent-reported scores were observed between typically developing students and students diagnosed with ADHD (p = < 0.001, η2partial = 0.09 – 0.10). The results showed that the CHEXI is a reliable instrument for measuring EF in Spanish children, and, it could be a useful tool for the identification of ADHD in these ages

Bibliographic References

  • Anwyl-Irvine, A. L., Massonnié, J., Flitton, A., Kirkham, N., & Evershed, J. K. (2020). Gorilla in our midst: An online behavioral experiment builder. Behavior Research Methods, 52(1), 388-407. https://doi.org/10.3758/s13428- 019-01237-x
  • Arnett, A. B., Pennington, B. F., Willcutt, E. G., DeFries, J. C., & Olson, R. K. (2015). Sex differences in ADHD symptom severity. Journal of Child Psychology and Psychiatry, 56(6), 632-639. https://doi.org/10.1111/jcpp.12337
  • Baddeley, A. D., & Hitch, G. J. (1994). Developments in the concept of working memory. Neuropsychology, 8(4), 485-493. https://doi.org/10.1037/0894- 4105.8.4.485
  • Barkley, R. A. (2005). ADHD and the nature of self-control (Paperback ed). Guilford Press.
  • Barkley, R. A. (2012). Barkley deficits in executive functioning scale—Children and adolescents (BDEFS-CA). Guilford Press.
  • Barkley, R. A. (2019). Neuropsychological Testing is Not Useful in the Diagnosis of ADHD: Stop It (or Prove It)! The ADHD Report, 27(2), 1-8. https:// doi.org/10.1521/adhd.2019.27.2.1
  • Barkley, R. A., & Eme, R. (2019). Is Neuropsychological Testing Useful for Any Reason in the Evaluation of ADHD? A Rejoinder to Mapou. The ADHD Report, 27(5), 1-8. https://doi.org/10.1521/adhd.2019.27.5.1
  • Beauducel, A., & Herzberg, P. Y. (2006). On the Performance of Maximum Likelihood Versus Means and Variance Adjusted Weighted Least Squares Estimation in CFA. Structural Equation Modeling: A Multidisciplinary Journal, 13(2), 186-203. https://doi.org/10.1207/s15328007sem1302_2
  • Borella, E., Carretti, B., & Pelegrina, S. (2010). The specific role of inhibition in reading comprehension in good and poor comprehenders. Journal of Learning Disabilities, 43(6), 541-552. https://doi. org/10.1177/0022219410371676
  • Bull, R., Espy, K. A., Wiebe, S. A., Sheffield, T. D., & Nelson, J. M. (2011). Using confirmatory factor analysis to understand executive control in preschool children: Sources of variation in emergent mathematic achievement: Executive control and emergent mathematics. Developmental Science, 14(4), 679-692. https://doi.org/10.1111/j.1467-7687.2010.01012.x
  • Burgess, P. W., Alderman, N., Forbes, C., Costello, A., Coates, L. M.-A., Dawson, D. R., Anderson, N. D., Gilbert, S. J., Dumontheil, I., & Channon, S. (2006). The case for the development and use of «ecologically valid» measures of executive function in experimental and clinical neuropsychology. Journal of the International Neuropsychological Society: JINS, 12(2), 194-209. https://doi.org/10.1017/S1355617706060310
  • Butterfuss, R., & Kendeou, P. (2018). The Role of Executive Functions in Reading Comprehension. Educational Psychology Review, 30(3), 801-826. https://doi.org/10.1007/s10648-017-9422-6
  • Camerota, M., Willoughby, M. T., Kuhn, L. J., & Blair, C. B. (2018). The Childhood Executive Functioning Inventory (CHEXI): Factor structure, measurement invariance, and correlates in US preschoolers. Child Neuropsychology: A Journal on Normal and Abnormal Development in Childhood and Adolescence, 24(3), 322-337. https://doi.org/10.1080/0929 7049.2016.1247795
  • Catale, C., Lejeune, C., Merbah, S., & Meulemans, T. (2013). French Adaptation of the Childhood Executive Functioning Inventory (CHEXI): Confirmatory Factor Analysis in a Sampleof Young French-Speaking Belgian Children. European Journal of Psychological Assessment, 29(2), 149-155. https://doi.org/10.1027/1015-5759/a000141
  • Catale, C., Meulemans, T., & Thorell, L. B. (2015). The childhood executive function inventory: Confirmatory factor analyses and cross-cultural clinical validity in a sample of 8- to 11-year-old children. Journal of Attention Disorders, 19(6), 489-495. https://doi.org/10.1177/1087054712470971
  • Chacko, A., Kofler, M., & Jarrett, M. (2014). Improving outcomes for youth with ADHD: A conceptual framework for combined neurocognitive and skill-based treatment approaches. Clinical Child and Family Psychology Review, 17(4), 368-384. https://doi.org/10.1007/s10567-014-0171-5
  • Chen, F. F. (2007). Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464-504. https://doi.org/10.1080/10705510701301834
  • Cheung, G. W., & Rensvold, R. B. (2002). Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9(2), 233-255. https://doi.org/10.1207/ S15328007SEM0902_5
  • Collins, A., & Koechlin, E. (2012). Reasoning, Learning, and Creativity: Frontal Lobe Function and Human Decision-Making. PLoS Biology, 10(3), e1001293. https://doi.org/10.1371/journal.pbio.1001293
  • Conesa, P. J., & Duñabeitia, J. A. (2021). Effects of computer-based training on children’s executive functions and academic achievement. The Journal of Educational Research, 114(6), 562-571. https://doi.org/10.1080/00220671. 2021.1998881
  • Cortés Pascual, A., Moyano Muñoz, N., & Quílez Robres, A. (2019). The Relationship Between Executive Functions and Academic Performance in Primary Education: Review and Meta-Analysis. Frontiers in Psychology, 10. https://doi.org/10.3389/fpsyg.2019.01582
  • Davidson, M. C., Amso, D., Anderson, L. C., & Diamond, A. (2006). Development of cognitive control and executive functions from 4 to 13 years: Evidence from manipulations of memory, inhibition, and task switching. Neuropsychologia, 44(11), 2037-2078. https://doi.org/10.1016/j.neuropsychologia.2006.02.006
  • D’Esposito, M., & Postle, B. R. (2015). The Cognitive Neuroscience of Working Memory. Annual Review of Psychology, 66(1), 115-142. https://doi. org/10.1146/annurev-psych-010814-015031
  • Diamond, A. (2013). Executive Functions. Annual Review of Psychology, 64(1), 135-168. https://doi.org/10.1146/annurev-psych-113011-143750
  • Diamond, A., & Ling, D. S. (2019). Review of the Evidence on, and Fundamental Questions About, Efforts to Improve Executive Functions, Including Working Memory. En A. Diamond & D. S. Ling, Cognitive and Working Memory Training (pp. 143-431). Oxford University Press. https://doi. org/10.1093/oso/9780199974467.003.0008
  • Duncan, G. J., Dowsett, C. J., Claessens, A., Magnuson, K., Huston, A. C., Klebanov, P., Pagani, L. S., Feinstein, L., Engel, M., Brooks-Gunn, J., Sexton, H., Duckworth, K., & Japel, C. (2007). School readiness and later achievement. Developmental Psychology, 43(6), 1428-1446. https://doi. org/10.1037/0012-1649.43.6.1428
  • Duncan, J., Schramm, M., Thompson, R., & Dumontheil, I. (2012). Task rules, working memory, and fluid intelligence. Psychonomic Bulletin & Review, 19(5), 864-870. https://doi.org/10.3758/s13423-012-0225-y
  • Dunn, T. J., Baguley, T., & Brunsden, V. (2014). From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology (London, England: 1953), 105(3), 399-412. https://doi.org/10.1111/bjop.12046
  • Engle, R. W., & Kane, M. J. (2004). Executive Attention, Working Memory Capacity, and a Two-Factor Theory of Cognitive Control. En The psychology of learning and motivation: Advances in research and theory, Vol. 44 (pp. 145-199). Elsevier Science.
  • Fan, X., & Thompson, B. (2001). Confidence Intervals for Effect Sizes: Confidence Intervals about Score Reliability Coefficients, Please: An EPM Guidelines Editorial. Educational and Psychological Measurement, 61(4), 517-531. https://doi.org/10.1177/0013164401614001
  • Ferguson, H. J., Brunsdon, V. E. A., & Bradford, E. E. F. (2021). The developmental trajectories of executive function from adolescence to old age. Scientific Reports, 11(1), 1382. https://doi.org/10.1038/s41598-020-80866-1
  • Field, A. (2017). Discovering statistics using IBM SPSS statistics (5th edition). SAGE Publications.
  • Follmer, D. J. (2018). Executive Function and Reading Comprehension: A Meta-Analytic Review. Educational Psychologist, 53(1), 42-60. https://doi. org/10.1080/00461520.2017.1309295
  • Forero, C. G., Maydeu-Olivares, A., & Gallardo-Pujol, D. (2009). Factor Analysis with Ordinal Indicators: A Monte Carlo Study Comparing DWLS and ULS Estimation. Structural Equation Modeling: A Multidisciplinary Journal, 16(4), 625-641. https://doi.org/10.1080/10705510903203573
  • Gathercole, S. E., Pickering, S. J., Knight, C., & Stegmann, Z. (2004). Working memory skills and educational attainment: Evidence from national curriculum assessments at 7 and 14 years of age. Applied Cognitive Psychology, 18(1), 1-16. https://doi.org/10.1002/acp.934
  • Giménez de la Peña, A., López-Zamora, M., Vila, O., Sánchez, A., & Thorell, L. B. (2022). Validation of the Spanish version of the Childhood Executive Functioning Inventory (CHEXI) in 4-5 year-old children. Anales de Psicología, 38(1), 101-109. https://doi.org/10.6018/analesps.453171
  • Gioia, G. A., Isquith, P. K., Guy, S. C., & Kenworthy, L. (2000). Behavior Rating Inventory of Executive Function. Child Neuropsychology, 6(3), 235-238. https://doi.org/10.1076/chin.6.3.235.3152
  • Gioia, G. A., Isquith, P. K., Guy, S. C., & Kenworthy, L. (2016). Behavior Rating Inventory of Executive Function®, Second Edition (BRIEF®2). Psychological Assessment Resource.
  • Gioia, G. A., Isquith, P. K., Retzlaff, P. D., & Espy, K. A. (2002). Confirmatory factor analysis of the Behavior Rating Inventory of Executive Function (BRIEF) in a clinical sample. Child Neuropsychology: A Journal on Normal and Abnormal Development in Childhood and Adolescence, 8(4), 249-257. https://doi.org/10.1076/chin.8.4.249.13513
  • Hu, L., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3(4), 424-453. https://doi.org/10.1037/1082-989X.3.4.424
  • Karalunas, S. L., Gustafsson, H. C., Dieckmann, N. F., Tipsord, J., Mitchell, S. H., & Nigg, J. T. (2017). Heterogeneity in development of aspects of working memory predicts longitudinal attention deficit hyperactivity disorder symptom change. Journal of Abnormal Psychology, 126(6), 774-792. https://doi.org/10.1037/abn0000292
  • Kasper, L. J., Alderson, R. M., & Hudec, K. L. (2012). Moderators of working memory deficits in children with attention-deficit/hyperactivity disorder (ADHD): A meta-analytic review. Clinical Psychology Review, 32(7), 605- 617. https://doi.org/10.1016/j.cpr.2012.07.001
  • Kent, P. L. (2016). Working Memory: A Selective Review. Applied Neuropsychology: Child, 5(3), 163-172. https://doi.org/10.1080/21622965.2016.1167491
  • Klenberg, L., Jämsä, S., Häyrinen, T., Lahti-Nuuttila, P., & Korkman, M. (2010). The Attention and Executive Function Rating Inventory (ATTEX): Psychometric properties and clinical utility in diagnosing ADHD subtypes. Scandinavian Journal of Psychology. https://doi.org/10.1111/j.1467- 9450.2010.00812.x
  • Kofler, M. J., Singh, L. J., Soto, E. F., Chan, E. S. M., Miller, C. E., Harmon, S. L., & Spiegel, J. A. (2020). Working memory and short-term memory deficits in ADHD: A bifactor modeling approach. Neuropsychology, 34(6), 686-698. https://doi.org/10.1037/neu0000641
  • Luo, Y., Weibman, D., Halperin, J. M., & Li, X. (2019). A Review of Heterogeneity in Attention Deficit/Hyperactivity Disorder (ADHD). Frontiers in Human Neuroscience, 13, 42. https://doi.org/10.3389/fnhum.2019.00042
  • Milfont, T., & Fischer, R. (2010). Testing measurement invariance across groups: Applications in cross-cultural research. International Journal of Psychological Research, 3(1), 111-130. https://doi.org/10.21500/20112084.857
  • Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000). The Unity and Diversity of Executive Functions and Their Contributions to Complex “Frontal Lobe” Tasks: A Latent Variable Analysis. Cognitive Psychology, 41(1), 49-100. https://doi.org/10.1006/ cogp.1999.0734
  • Moffitt, T. E., Arseneault, L., Belsky, D., Dickson, N., Hancox, R. J., Harrington, H., Houts, R., Poulton, R., Roberts, B. W., Ross, S., Sears, M. R., Thomson, W. M., & Caspi, A. (2011). A gradient of childhood self-control predicts health, wealth, and public safety. Proceedings of the National Academy of Sciences, 108(7), 2693-2698. https://doi.org/10.1073/pnas.1010076108
  • Molina-Torres, J., Orgilés, M., & Servera, M. (2022). El TDAH en la etapa preescolar: Una revisión narrativa. Revista de Psicología Clínica con Niños y Adolescentes, 9(no 3), 1-9. https://doi.org/10.21134/rpcna.2022.09.3.5
  • Nouchi, R., Taki, Y., Takeuchi, H., Hashizume, H., Nozawa, T., Kambara, T., Sekiguchi, A., Miyauchi, C. M., Kotozaki, Y., Nouchi, H., & Kawashima, R. (2013). Brain Training Game Boosts Executive Functions, Working Memory and Processing Speed in the Young Adults: A Randomized Controlled Trial. PLoS ONE, 8(2), e55518. https://doi.org/10.1371/journal. pone.0055518
  • Quinn, P. O., & Madhoo, M. (2014). A Review of Attention-Deficit/Hyperactivity Disorder in Women and Girls: Uncovering This Hidden Diagnosis. The Primary Care Companion for CNS Disorders, 16(3), PCC.13r01596. https://doi.org/10.4088/PCC.13r01596
  • Reynolds, C., & Kamphaus, R. (2015). Behavior Assessment System for Children | Third Edition. https://www.pearsonassessments.com/store/usassessments/ en/Store/Professional-Assessments/Behavior/Comprehensive/BehaviorAssessment-System-for-Children-%7C-Third-Edition-/p/100001402.html
  • Schirmbeck, K., Rao, N., & Maehler, C. (2020). Similarities and differences across countries in the development of executive functions in children: A systematic review. Infant and Child Development, 29(1). https://doi. org/10.1002/icd.2164
  • Schroeders, U., & Gnambs, T. (2020). Degrees of Freedom in Multigroup Confirmatory Factor Analyses: Are Models of Measurement Invariance Testing Correctly Specified? European Journal of Psychological Assessment, 36(1), 105-113. https://doi.org/10.1027/1015-5759/a000500
  • Sjöwall, D., & Thorell, L. B. (2019). A critical appraisal of the role of neuropsychological deficits in preschool ADHD. Child Neuropsychology: A Journal on Normal and Abnormal Development in Childhood and Adolescence, 25(1), 60-80. https://doi.org/10.1080/09297049.2018.1447096
  • Soto, E. F., Kofler, M. J., Singh, L. J., Wells, E. L., Irwin, L. N., Groves, N. B., & Miller, C. E. (2020). Executive functioning rating scales: Ecologically valid or construct invalid? Neuropsychology, 34(6), 605-619. https://doi. org/10.1037/neu0000681
  • St Clair-Thompson, H., & Gathercole, S. (2006). Executive function and achievements in school: Shifting, updating, inhibition, and working memory. Quarterly journal of experimental psychology (2006), 59, 745-759. https://doi.org/10.1080/17470210500162854
  • Thorell, L. B., & Catale, C. (2014). The Assessment of Executive Functioning Using the Childhood Executive Functioning Inventory (CHEXI). En S. Goldstein & J. A. Naglieri (Eds.), Handbook of Executive Functioning (pp. 359-366). Springer New York. https://doi.org/10.1007/978-1-4614-8106-5_20
  • Thorell, L. B., Eninger, L., Brocki, K. C., & Bohlin, G. (2010a). Childhood Executive Function Inventory (CHEXI): A promising measure for identifying young children with ADHD? Journal of Clinical and Experimental Neuropsychology, 32(1), 38-43. https://doi.org/10.1080/13803390902806527
  • Thorell, L. B., Eninger, L., Brocki, K. C., & Bohlin, G. (2010b). Childhood Executive Function Inventory (CHEXI): A promising measure for identifying young children with ADHD? Journal of Clinical and Experimental Neuropsychology, 32(1), 38-43. https://doi.org/10.1080/13803390902806527
  • Thorell, L. B., & Nyberg, L. (2008). The Childhood Executive Functioning Inventory (CHEXI): A New Rating Instrument for Parents and Teachers. Developmental Neuropsychology, 33(4), 536-552. https://doi. org/10.1080/87565640802101516
  • Thorell, L. B., Veleiro, A., Siu, A. F. Y., & Mohammadi, H. (2013). Examining the relation between ratings of executive functioning and academic achievement: Findings from a cross-cultural study. Child Neuropsychology, 19(6), 630-638. https://doi.org/10.1080/09297049.2012.727792
  • Toplak, M. E., Bucciarelli, S. M., Jain, U., & Tannock, R. (2009). Executive functions: Performance-based measures and the behavior rating inventory of executive function (BRIEF) in adolescents with attention deficit/ hyperactivity disorder (ADHD). Child Neuropsychology: A Journal on Normal and Abnormal Development in Childhood and Adolescence, 15(1), 53-72. https://doi.org/10.1080/09297040802070929
  • Toplak, M. E., West, R. F., & Stanovich, K. E. (2013). Practitioner review: Do performance-based measures and ratings of executive function assess the same construct? Journal of Child Psychology and Psychiatry, and Allied Disciplines, 54(2), 131-143. https://doi.org/10.1111/jcpp.12001
  • Usai, M. C., Viterbori, P., & Traverso, L. (2018). Preschool Executive Function Profiles: Implications for Math Achievement in Grades 1 and 3. Journal of Research in Childhood Education, 32(4), 404-418. https://doi.org/10.1080/ 02568543.2018.1496957
  • Wanless, S. B., McClelland, M. M., Lan, X., Son, S.-H., Cameron, C. E., Morrison, F. J., Chen, F.-M., Chen, J.-L., Li, S., Lee, K., & Sung, M. (2013). Gender differences in behavioral regulation in four societies: The United States, Taiwan, South Korea, and China. Early Childhood Research Quarterly, 28(3), 621-633. https://doi.org/10.1016/j.ecresq.2013.04.002
  • Weafer, J., & de Wit, H. (2014). Sex differences in impulsive action and impulsive choice. Addictive Behaviors, 39(11), 1573-1579. https://doi. org/10.1016/j.addbeh.2013.10.033
  • Zelazo, P. D., Blair, C. B., & Willoughby, M. T. (2016). Executive Function: Implications for Education. NCER 2017-2000. En National Center for Education Research. National Center for Education Research. https://eric. ed.gov/?id=ED570880
Data source: Dialnet