Home News SEL Assessment Doesn’t Translate – Language Magazine

SEL Assessment Doesn’t Translate – Language Magazine

by Staff

As well as learning academically, today’s students are learning their place in the world, who they are, and how to make and nurture friendships. They have been impacted by the COVID-19 pandemic, which upended socializing and learning. Now, imagine being a child in the early stages of English language learning.

English language learners (ELLs) account for between 3.8 and 5 million students in our school system (Langdon and Wiig, 2009; Kena et al., 2016; Sanchez, 2017); the overwhelming majority of these ELL students speak Spanish at home as their first language. School districts offer a variety of programs to support these students, but there remain significant issues, particularly in assessment.

Due to the limited development of crucial, validated Spanish-language assessments, the identification of ELL students who would benefit from specialized intervention and educational services suffers from issues of both under- and over-representation (National Academies of Sciences, Engineering, and Medicine, 2017). Many ELL students are inappropriately classified as having academic disabilities, in part related to limitations in assessments (Garcia-Joslin et al., 2016).

In parallel with academic assessment, there is a welcome drive toward the importance of measuring students’ social–emotional competence skills and well-being in schools. Not surprisingly, there is a gaping absence of technically sound tools for measuring social–emotional skills (e.g., Elias, 2019) and well-being among the ELL population (Halle et al., 2014; Rosselli et al., 2010). Apart from third-party rating scales, there exist fewer than a handful of Spanish-language child social–emotional competence assessments (e.g., Social Skills Improvement System (Gresham and Elliott, 2008) and the Bar-On EQI-Youth (Bar-On and Parker, 2000)).

When Spanish-language tools are available, educators and practitioners are at times faced with the challenge of how to approach assessing ELL students who are developing in two languages. Almost ten years ago, Halle and colleagues (2014) made a very explicit plea for the creation of more child-based social–emotional competence assessments for ELL students in home languages, to complement third-party reports. Yet the assessment industry has been slow to adequately meet this need.

Best practice suggests that we not just translate but adapt assessments into other languages, ensuring cultural appropriateness and validity (e.g., Arestad et al., 2017; Barrueco et al., 2012; Cheung et al., 2017; Meera et al., 2015; Peña, 2007; Smith et al., 2017). The transadaptation process should be professionally conducted via research to ensure accurate measurement of targeted skills (Arestad et al., 2017).

Without such tools, educators and practitioners miss opportunities to properly identify students’ strengths and challenges, monitor social–emotional skill development, evaluate the effectiveness of social–emotional learning curriculum for ELL students, and assess progress toward state social–emotional learning standards. As with academic risks, there are risks associated with mischaracterizing a social–emotional learning challenge because of a language barrier.

Our goals are to highlight the challenges facing ELL students, educators, and practitioners; the need for valid and reliable alternate language assessments or adequate language-routing plans for assessment; and how the absence of alternate language assessment further confounds mental health evaluation in ELL students.

Arestad, K. E., MacPhee, D., Lim, C. Y., and Khetani, M. A. (2017). “Cultural Adaptation of a Pediatric Functional Assessment for Rehabilitation Outcomes Research.” BMC Health Services Research, 17(1), 1–13. https://doi.org/10.1186/s12913-017-2592-6

Bar-On, R., and Parker, J. D. A. (2000). The Bar-On Emotional Quotient Inventory: Youth Version (EQ-i:YV) Technical Manual. Multi-Health Systems, Inc.

Barrueco, S., López, M., Ong, C., and Lozano, P. (2012). Assessing Spanish– English Bilingual Preschoolers: A Guide to Best Approaches and Measures. Paul H Brookes Publishing.

Cheung, P. P. P., Siu, A. M. H., and Brown, T. (2017). “Measuring Social Skills of Children and Adolescents in a Chinese Population: Preliminary evidence on the reliability and validity of the translated Chinese version of the Social Skills Improvement System-Rating Scales (SSIS-RS-C).” Research in Developmental Disabilities, 60, 187–197. https://doi.org/10.1016/j.ridd.2016.11.019

Elias, M. J. (2019). “What If the Doors of Every Schoolhouse Opened to Social– Emotional Learning Tomorrow: Reflections on how to feasibly scale up high-quality SEL.” Educational Psychologist, 54(3), 233–245. https://doi.org/10.1080/00461520.2019.1636655

Garcia-Joslin, J., Carrillo, G. L., Guzman, V., Vega, D., Plotts, C. A., and Lasser, J. (2016). “Latino Immigration: Preparing school psychologists to meet students’ needs.” School Psychology Quarterly, 31(2), 256– 269. https://doi.org/10.1037/spq0000136

Gresham, F. M., and Elliott, S. N. (2008). Social Skills Improvement System: Rating Scales Manual. NCS Pearson.

Halle, T. G., Whittaker, J. V., Zepeda, M., Rothenberg, L., Anderson, R., Daneri, P., Wessel, J., and Buysse, V. (2014). “The Social–Emotional Development of Dual Language Learners: Looking back at existing research and moving forward with purpose.” Early Childhood Research Quarterly, 29(4), 734–749. https://doi.org/10.1016/j.ecresq.2013.12.002

Kena, G., Hussar, W., McFarland, J., de Brey, C., Musu-Gillette, L., Wang, X., Zhang, J., Rathburn, A., Wilkinson-Flicker, S., Diliberti, M., Barmer, A., Bullock Mann, F., and Dunlop Velez, E. (2016). The Condition of Education 2016 (NCES 2016-144). US Department of Education, National Center for Education Statistics. https://nces.ed.gov/pubsearch/pubsinfo.asp?pubid=2016144

Langdon, H. W., and Wiig, E. H. (2009). “Multicultural Issues in Test Interpretation.” Seminars in Speech and Language, 30(4), 261–278. https://doi.org/10.1055/s-0029-1241724

Meera, S. S., Girimaji, S. C., Seshadri, S. P., Philip, M., Shivashankar, N., Morgan, P., and Piven, J. (2015). “Translation of the Broad Autism Phenotype Questionnaire to an Indian Language: A description of the process.” Asian Journal of Psychiatry, 15, 62–67. https://doi.org/10.1016/j.ajp.2015.04.013

Peña, E. D. (2007). “Lost in Translation: Methodological considerations in cross cultural research.” Child Development, 78(4), 1255–1264. https://doi.org/10.1111/j.1467-8624.2007.01064.x

National Academies of Sciences, Engineering, and Medicine (2017). Promoting the Educational Success of Children and Youth Learning English: Promising Futures. National Academies Press. https://doi.org/10.17226/24677

Rosselli, M., Ardila, A., Navarrete, M. G., and Matute, E. (2010). “Performance of Spanish/English Bilingual Children on a Spanish-Language Neuropsychological Battery: Preliminary normative data.” Archives of Clinical Neuropsychology, 25(3), 218–235. https://doi.org/10.1093/arclin/acq012

Sanchez, C. (2017). “English Language Learners: How your state is doing.” National Public Radio. www.npr.org/sections/ed/2017/02/23/512451228/5-million-english-language-learners-a-vast-pool-of-talent-at-risk

Smith, L., Malcolm-Smith, S., and de Vries, P. J. (2017). “Translation and Cultural Appropriateness of the Autism Diagnostic Observation Schedule-2 in Afrikaans.” Autism, 21(5), 552–563. https://doi.org/10.1177/1362361316648469

Dr. Nicole Russo-Ponsaran is an associate professor in psychiatry and behavioral sciences at Rush University Medical Center and the research director at Rush NeuroBehavioral Center. Her research spans neuroscience to psychosocial behavioral research, assessment to intervention, and nonclinical to clinical populations. She is nationally recognized for her English and Spanish-language social–emotional assessments.

Dr. Sandra Barrueco is professor of psychology at the Catholic University of America, where she directs the clinical psychology doctoral program as well as the university-wide Latin American and Latino studies interdisciplinary program. Dr. Barrueco’s expertise centers on assessment, methodological, and intervention approaches for young ethnically and linguistically diverse children and families.

Dr. Dominika Winiarski is a licensed clinical psychologist and the director of counseling and psychological services at the College of Lake County, Illinois. Her research and clinical work intersect to address disparities in mental health across various settings including healthcare and education, as well as within the community more generally.

Source link

You may also like