NIH Study Validates New Scale for Measuring Pandemic-Related Traumatic Stress in Children and Adults

FOR IMMEDIATE RELEASE

The Pandemic-related Traumatic Stress Scale (PTSS) can be used to effectively measure stress related to the COVID-19 pandemic and identify children and adults with higher levels of stress who may need additional mental health support, according to a new study funded by the Environmental influences on Child Health Outcomes Program (ECHO) at the National Institutes of Health.

The study included 17,830 children and adults from 47 ECHO Cohort study sites representing all 50 states, Washington, DC, and Puerto Rico. Researchers split the sample into four groups including 1,656 pregnant or postpartum individuals; 11,483 adult caregivers; 1,795 adolescents aged 13 to 21; and 2,896 children aged 3 to 12. Between April 2020 and August 2021, participants or their caregivers completed surveys about their pandemic-related traumatic stress, depressive symptoms, anxiety, general stress, and life satisfaction. On average, caregivers had the highest PTSS scores, followed by adolescents, pregnant or postpartum individuals, and children.

Within these groups, the researchers found additional differences related to age and gender. Adolescents, females, and caregivers of children under 5 had higher PTSS scores on average than younger children, males, and caregivers of children 5 and older, respectively. Higher levels of pandemic-related traumatic stress were associated with greater symptoms of distress and lower life satisfaction.

“The PTSS can be used beyond the immediate COVID-19 pandemic context,” said Courtney Blackwell, PhD, an ECHO Cohort Investigator at Northwestern University. “Unlike previous measures that capture traumatic stress reactions to a single event, the PTSS was developed to evaluate potential traumatic stress reactions to ongoing large-scale threats. In the future, the PTSS could be adapted to evaluate reactions to other acute onset stressors with lengthy durations.”

Dr. Blackwell led this collaborative research published in Psychological Assessment.

Blackwell, C. et al. Development and Psychometric Validation of the Pandemic-related Traumatic Stress Scale for Children and Adults. Psychological Assessment. DOI: 10.1037/pas0001211.

###

About ECHO: Launched in 2016, the Environmental influences on Child Health Outcomes (ECHO) Program is a research program in the Office of the Director at the NIH with the mission to enhance the health of children for generations to come. ECHO investigators study the effects of a broad range of early environmental influences on child health and development. For more information, visit echochildren.org.

About the NIH: NIH, the nation’s medical research agency, includes 27 Institutes and Centers and is a component of the U.S. Department of Health and Human Services. NIH is the primary federal agency conducting and supporting basic, clinical, and translational medical research, and is investigating the causes, treatments, and cures for both common and rare diseases. For more information, visit www.nih.gov.

Media Contacts

For information or to request an interview, contact Rebekah Yeager,  rebekah.yeager@nih.gov.

If you are not a member of the media, but have a general inquiry, please contact  NIHKidsandEnvironment@od.nih.gov.

Connect With Us

echo connectorCheck out the recent issues of our bi-monthly newsletter, the ECHO Connector, for program news and the latest research findings.

To receive the ECHO Connector through email, subscribe here.

Follow @ECHOChildHealth for the latest ECHO Program updates on Twitter.

ECHO Researchers Evaluate New Scale for Measuring Pandemic-related Traumatic Stress in Children and Adults

Courtney K. Blackwell, PhD

Collaborative ECHO research led by Courtney K. Blackwell, PhD of Northwestern University evaluated COVID-19 pandemic-related traumatic stress in a large sample of children and adults. In March 2020, ECHO researchers developed the Pandemic-related Traumatic Stress Scale (PTSS) to measure stress related to the COVID-19 pandemic. The PTSS can be used to identify children and adults with higher levels of traumatic stress and who may need additional mental health support. This research, titled “Development and Psychometric Validation of the Pandemic-related Traumatic Stress Scale for Children and Adults,” is published in Psychological Assessment.

The study included 17,830 children and adults from 47 ECHO Cohort study sites representing all 50 states, Washington, DC, and Puerto Rico. Researchers split the sample into four groups including 1,656 pregnant or postpartum individuals; 11,483 adult caregivers; 1,795 adolescents aged 13 to 21; and 2,896 children aged 3 to 12.

Between April 2020 and August 2021, adolescents and adult caregivers (including pregnant or postpartum individuals) completed surveys about their pandemic-related traumatic stress, depressive symptoms, anxiety, general stress, and life satisfaction. Caregivers of children aged 3-12 reported on the behaviors observed in their child.

On average, caregivers had the highest levels of pandemic-related traumatic stress, followed by adolescents, pregnant or postpartum individuals, and children. Within these groups, the researchers found additional differences. Adolescents, females, and caregivers of children under 5 had higher PTSS scores on average than younger children, males, and caregivers of children 5 and older, respectively. Higher levels of pandemic-related traumatic stress were associated with greater symptoms of distress and lower life satisfaction.

The researchers found that the PTSS is a reliable way to measure pandemic-related traumatic stress in the context of the COVID-19 pandemic. Researchers and doctors can use this scale to distinguish general stress, depression, and anxiety from traumatic stress, helping them to identify people who may need more support to improve their mental health.

“The PTSS can be used beyond the immediate COVID-19 pandemic context,” said Dr. Blackwell. “Unlike previous measures that capture traumatic stress reactions to a single event, the PTSS was developed to evaluate potential traumatic stress reactions to ongoing large-scale threats. In the future, the PTSS could be adapted to evaluate reactions to other acute onset stressors with lengthy durations.”

Read the Research Summary.

New ECHO Research Finds No Link Between “Accelerated” Biological Age and Behavioral and Emotional Health Outcomes in Children

Collaborative ECHO research led by Christine Ladd-Acosta, PhD and Heather Volk, PhD, MPH, of Johns Hopkins Bloomberg School of Public Health, investigates the association between accelerated biological age at birth and children’s health outcomes. This research, titled “Accelerated epigenetic age at birth and child emotional and behavioral development in early childhood: A meta-analysis of four prospective cohort studies in ECHO,” is published in Epigenetics.

Previous studies have shown a potential link between early identification and intervention in the development of emotional and behavioral health challenges in children and better long-term health outcomes. Recently, researchers have begun looking at how epigenetic factors affect children’s biological age and health outcomes.

A molecular process known as DNA methylation, or DNAm, adds a tag to DNA to control gene expression. Researchers measure DNAm to estimate a person’s biological age and compare it with their chronological age to better understand the factors that may influence their long-term health outcomes.  In this study, ECHO researchers looked at the link between biological age at birth, the time between conception and birth (chronological gestational age), and emotional and behavioral health outcomes in children.

The study included 592 children at four ECHO research sites in the United States. Researchers calculated each child’s biological age by analyzing DNA samples collected at birth, and they compared this age to the child’s chronological gestational age. They then tested whether newborns who showed increased biological age relative to their chronological age (“accelerated aging”) were more likely to have emotional and behavioral problems in early childhood.

The study indicates that differences between biological age at birth and chronological gestational age are not linked to emotional and behavioral problems in childhood. This study also did not find any difference between boys and girls in terms of the effect of “accelerated” biological age on behavioral and emotional outcomes.

“This study suggests that biological age has no impact on child emotional and behavioral problems in early childhood,” Dr. Ladd-Acosta said. “These results highlight that future research is needed to look into how other biological factors at birth may influence neurodevelopmental health outcomes in early childhood.”

Future studies may use larger sample sizes to replicate this study and further confirm the findings. The relatively small sample size of this study may have made it difficult to observe differences in behavioral or emotional outcomes based on child sex. Future research with larger samples could help investigate potential differences in the results between boys and girls.

Read the research summary.

New ECHO Cohort Research Finds Some Teens with Disabilities May Have Been More Vulnerable to Social Disruptions During COVID-19 Pandemic

Collaborative ECHO Cohort research led by Phillip Sherlock, PhD; Maxwell Mansolf, PhD; and Courtney Blackwell, PhD of Northwestern University investigates the COVID-19 pandemic’s impacts on adolescents’ mental health. The findings suggest that some teens with a history of depression, anxiety, autism and ADHD experienced more severe impacts than those without. This research, titled “Life Satisfaction for Adolescents with Developmental and Behavioral Disabilities during the COVID-19 Pandemic,” is published in Pediatric Research.

Although researchers have looked at how the COVID-19 pandemic affected the mental health of children of all ages, few studies have examined the pandemic’s impact on children and teens with pre-existing mental, emotional, behavioral, and developmental (MEBD) disabilities such as depression, anxiety, ADHD, and autism spectrum disorder.

Health policies implemented to prevent the spread of COVID-19 disrupted normal activities for children and families. Schools paused in-person learning, extracurricular activities were canceled, and stay-at-home orders meant children spent more time quarantined with family members instead of engaging with friends and peers.

Adolescence is a critical period for social development. Researchers aimed to identify the groups of adolescents most affected by the pandemic to provide mental health practitioners, pediatricians, and family physicians with better information on potential intervention and prevention practices particularly vulnerable adolescents in the future.

This study included data collected from 1,084 adolescents ages 11–21 years old and their caregivers and included individuals with and without disabilities from seven ECHO observational research sites in the U.S. In addition to using existing ECHO Cohort data about adolescents and their families, researchers administered a COVID-19-specific survey to better understand the physical, mental, and social impact of the pandemic on young people and their families.

This study found that when exposed to certain stresses during the COVID-19 pandemic, adolescents with a history of depression, anxiety, autism spectrum disorder, or ADHD had lower life satisfaction compared to their peers. These stressors included social isolation, stress related to medical care access and fears about the pandemic, and living in a single-caregiver household. Additionally, 80% of adolescents, regardless of pre-existing conditions, reported decreases in social connectedness during the COVID-19 pandemic. Although the negative effects of decreased social connectedness were amplified among adolescents with MEBD disabilities, this risk factor was widespread among the majority of adolescents.

“This study allowed us to identify the groups of adolescents with disabilities who are most vulnerable and may need additional support during future emergencies,” Dr. Sherlock said. “This study also highlights the importance of interventions aimed specifically at increasing social connectedness, family engagement, and access to medical support for all adolescents, and especially for those with disabilities.”

This study revealed potential differences between adolescents with disabilities and their peers in terms of life satisfaction. Future research might include studies that focus on the vulnerable subgroups identified in this study. Future studies may also investigate the long-term effects of decreased social connectedness and other risks resulting from the COVID-19 pandemic during developmentally critical time periods.

Read the research summary.

New ECHO Research Suggests Maternal Sleep During Second Trimester of Pregnancy May be Associated with ADHD Symptoms and Sleep Problems in Children

Collaborative ECHO research led by Claudia Lugo-Candelas, PhD, Tse Hwei, MPH, Seonjoo Lee, PhD, and Cristiane Duarte, MPH, PhD of the Columbia University Irving Medical Center and New York State Psychiatric Institutes investigates the effect of prenatal sleep on children’s health outcomes, including neurodevelopment disorders and sleep quality. This research, titled “Prenatal sleep health and risk of offspring ADHD symptomatology and associated phenotypes: A prospective analysis of timing and sex differences in the ECHO Cohort,” is published in The Lancet Regional Health – Americas.

Sleep difficulties are common in pregnancy. Poor prenatal sleep may relate to negative outcomes for both parent and child, including pregnancy complications and certain birth outcomes. The impact of poor prenatal sleep may also extend beyond pregnancy and birth and may increase the risk for neurodevelopment disorders in offspring, particularly attention-deficit/hyperactivity disorder (ADHD).

In this study, ECHO researchers aimed to study potential associations between poor prenatal sleep and an increased risk of ADHD symptoms and sleep problems in offspring. The research team used data from 794 mother-child pairs across five ECHO research sites and all enrolled pairs with available prenatal sleep and offspring ADHD assessments before age 7 were included. The pregnant participants reported on their sleep during pregnancy using self-report questionnaires and reported on children’s symptoms and behaviors when children were between 3 and 5 years old. The study assessed the children’s ADHD symptoms and associated characteristics using the Child Behavior Checklist Preschool Version, a widely used parent report that measures behavior problems in children.

The study found that prenatal sleep quality and duration, particularly in the second trimester, appeared related to children’s risk for ADHD, emotional reactivity, and sleep problems at age 4. Longer sleep duration in the second trimester was associated with fewer ADHD symptoms in children. Poorer sleep quality scores in the second trimester were associated with greater offspring ADHD symptomatology. Shorter duration and poorer quality of sleep during the second trimester were also associated with more sleep difficulties in children.

“This study extends prior work by examining the associations between self-reported prenatal maternal sleep health and offspring ADHD symptoms in early childhood in a large, socio-demographically diverse sample,” Dr. Lugo-Candelas said. “This study was also the first looking to understand if sleep at a particular time in pregnancy is specifically related to offspring outcomes. Our research suggests we need to better study the role of sleep in pregnancy on both the health of the pregnant woman and their offspring to understand these potential associations.”

Future studies are needed to replicate these findings, as well as investigate the possible mechanisms. Poor sleep may impact inflammation in pregnancy and offspring development, but studies have not examined that association.

Read the research summary.

New ECHO Cohort Research Finds Adolescents with Disabilities May Have Been More Vulnerable to Social Disruptions During COVID-19 Pandemic

<< Back to Research Summaries

New ECHO Cohort Research Finds Adolescents with Disabilities May Have Been More Vulnerable to Social Disruptions During COVID-19 Pandemic

Authors: Phillip Sherlock, Maxwell Mansolf, Courtney Blackwell, et al.

 

Who sponsored this study?

The Environmental influences on Child Health Outcomes (ECHO) Program, Office of the Director, National Institutes of Health supported this research.

 

Why was this study needed?

Although researchers have looked at how the COVID-19 pandemic affected the mental health of children of all ages, few studies have examined the pandemic’s impact on children and teens with pre-existing mental, emotional, behavioral, and developmental (MEBD) disabilities like depression, anxiety, attention-deficit hyperactivity disorder (ADHD), and Autism Spectrum Disorder (ASD).

Health policies that were put in place to prevent the spread of COVID-19 caused disruption of normal activities for children and families. Schools paused in-person learning, extracurricular activities were cancelled, and stay-at-home orders meant children spent more time quarantined with family members instead of engaging with friends and peers.

This study was needed to understand how the stresses of the COVID-19 pandemic impacted life satisfaction for adolescents with disabilities, as adolescence is a critical period of social development. Researchers aimed to learn which groups of adolescents were most affected by the pandemic, so that mental health practitioners, pediatricians, and family physicians might be better informed of potential intervention and prevention practices that could be implemented to help particularly vulnerable adolescents through difficult times in the future.

 

What were the study results?

When exposed to certain stresses during the COVID-19 pandemic, adolescents with a history of depression, anxiety, ASD, or ADHD had lower life satisfaction compared to their peers. These stresses included decreased social connectedness, decreased family engagement, stress related to medical care access, pandemic-related traumatic stress, and living in a single-caregiver household.

This study also found that 80% of adolescents, regardless of pre-existing conditions, reported decreases in social connectedness during the COVID-19 pandemic. Although the detrimental effect of decreased social connectedness was amplified among individuals with certain pre-existing MEBD conditions, this risk factor was widespread among the majority of adolescents.

Footnote: Results reported here are for a single study. Other or future studies may provide new information or different results. You should not make changes to your health without first consulting your healthcare professional.

 

What was the study's impact?

This study found that adolescents with decreased social connectedness typically had lower life satisfaction across several groups with different life circumstances. However, decreased social connectedness was more harmful for individuals with disabilities. This study allowed researchers to identify the groups of adolescents with disabilities who are most vulnerable and may need additional support during future emergencies. Findings from this study also highlight the importance of interventions aimed specifically at increasing social connectedness, family engagement, and access to medical support for all adolescents, and especially for those with disabilities.

 

Who was involved?

This study included COVID-19 survey data collected from April 2020 to August 2021 from a sample of 1,084 adolescents ages 11–21 years old, and their caregivers. The sample included individuals with and without disabilities from seven ECHO observational research sites in the U.S.

 

What happened during the study?

In addition to using pre-existing ECHO Cohort data about adolescents and their families, researchers administered a COVID-19-specfic survey to better understand the physical, mental, and social impact of the pandemic on young people and their families. Data were analyzed using a machine-learning process.

 

What happens next?

Findings from this study showed evidence of potential differences between adolescents with disabilities and their peers in terms of life satisfaction. Future research is needed to design studies that focus on the vulnerable subgroups identified in this study. Additionally, future studies may look into the long-term effects of decreased social connections and other risks resulting from the COVID-19 pandemic during developmentally critical time periods.

 

Where can I learn more?

Access the full journal article, titled “Life Satisfaction for Adolescents with Developmental and Behavioral Disabilities during the COVID-19 Pandemic,” in Pediatric Research.

 

The content is the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

Read the associated article.

Published October 24, 2023

ECHO Study Suggests Maternal Sleep During Second Trimester of Pregnancy May be Associated with ADHD Symptoms and Sleep Quality in Early Childhood

<< Back to Research Summaries

ECHO Study Suggests Maternal Sleep During Second Trimester of Pregnancy May be Associated with ADHD Symptoms and Sleep Quality in Early Childhood

Authors: Claudia Lugo-Candelas, Tse Hwei, Seonjoo Lee, Cristiane Duarte, et al.

 

Who sponsored this study?

The Environmental influences on Child Health Outcomes (ECHO) Program, Office of the Director, National Institutes of Health supported this research.

 

Why was this study needed?

Sleep difficulties are common in pregnancy. Poor prenatal sleep may relate to negative outcomes for both parent and child, including pregnancy complications and certain birth outcomes. The impact of poor prenatal sleep may also extend beyond pregnancy and birth and may increase the risk for neurodevelopment disorders in offspring, particularly attention-deficit/hyperactivity disorder (ADHD).

In this study, ECHO researchers aimed to study potential associations between poor prenatal sleep and an increased risk of ADHD symptoms and sleep problems in offspring.

 

What were the study results?

Prenatal sleep quality and duration, particularly in the second trimester, appeared related to children’s risk for ADHD, emotional reactivity, and sleep problems at age 4. Longer sleep duration in the second trimester was associated with fewer ADHD symptoms in children. Poorer sleep quality scores in the second trimester were associated with greater offspring ADHD symptomatology. Shorter duration and poorer quality of sleep during the second trimester were also associated with more sleep difficulties in children.

Footnote: Results reported here are for a single study. Other or future studies may provide new information or different results. You should always consult with a qualified healthcare provider for diagnosis and for answers to your personal questions.

 

What was the study's impact?

This study extends prior work by examining the associations between self-reported prenatal maternal sleep health and offspring ADHD symptoms in early childhood in a large, socio-demographically diverse sample in the U.S., including Puerto Rico.

 

Who was involved?

The research team used data from 794 mother-child pairs across five ECHO research sites. All enrolled pairs with available prenatal sleep and offspring ADHD assessments before age seven were included. The pregnant participants were between 27 and 37 years old.

 

What happened during the study?

Pregnant participants reported on their sleep during pregnancy using self-report questionnaires and reported on children's symptoms and behaviors when children were between 3 and 5 years old. The study assessed the children’s ADHD symptoms and associated characteristics using the Child Behavior Checklist Preschool Version, a widely used parent report that measures behavior problems in children.

What happens next?

Future studies are needed to replicate these findings, as well as investigate the possible mechanisms. Poor sleep may impact inflammation in pregnancy and offspring development, but studies have not examined that association.

 

Where can I learn more?

Access the full journal article, titled “Prenatal sleep health and risk of offspring ADHD symptomatology and associated phenotypes: A prospective analysis of timing and sex differences in the ECHO Cohort,” in The Lancet Regional Health - Americas.

 

The content is the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

Published October 9, 2023

 

Access the associated article.

NIH Study Suggests Measurement Bias in Common Child Behavior Assessment Tool

FOR IMMEDIATE RELEASE

Researchers identify less biased questions that could reliably capture childhood behavior problems

Scores from a commonly used measure of behavior problems in young children may be skewed depending on the primary language, education, and sex of the caregiver who fills out the survey, as well as the child’s age and race, according to new research from the NIH’s Environmental influences on Child Health Outcomes (ECHO) Program.

ECHO Cohort researchers analyzed data from caregivers who filled out the widely used Child Behavior Checklist (CBCL) 1.5–5 on behalf of 9,087 young children ages 18 to 71 months from 26 ECHO research sites across the United States. The caregiver-reported survey evaluates a range of behavior problems in young children.

"Understanding children's behavior can help us identify potential issues in their development and mental health down the road,” said Shuting Zheng, PhD of the University of California, San Francisco. “To do this effectively, we need reliable ways to measure their behavior equivalently for children from diverse backgrounds."

The study found that how caregivers respond to the questions on the measure was biased the most by the language used to complete the survey, followed by factors such as the caregiver's education level and sex and the child's age and race. These biases persisted after accounting for mental health disparities between these groups. Researchers noted that some information could get lost in translation and people from different cultures could understand child behavior problems differently. The gender of the person answering the questions and their level of education also had an impact and researchers pointed to parents’ expectations about how children should develop as possible influences in how they answered the survey questions.

ECHO Cohort researchers were then able to identify some CBCL questions less affected by measurement biases introduced by sociodemographic factors but which still reliably captured childhood behavior problems. The subset of questions that showed little bias across survey-taker demographics still captures a wide range of behaviors across internalizing (e.g., emotionally reactive, withdrawn) and externalizing problems (aggressive behaviors and attention problems).

Going forward, ECHO Cohort researchers plan to apply these questions, evaluating their reliability in identifying children with clinically significant behavior problems.

“Finding questions with less measurement bias across socio-demographic groups helps researchers and clinicians measure behavior problems in different groups of kids of varying ages and family backgrounds more accurately,” Dr. Zheng said.

Dr. Zheng and Somer Bishop, PhD of the University of California, San Francisco, and Maxwell Mansolf, PhD of Northwestern University led this collaborative research that was published in the Journal of Child Psychology & Psychiatry Advances.

Zheng, S. et al. Measurement Bias in Caregiver-Report of Early Childhood Behavior Problems across Demographic Factors in an ECHO-wide Diverse Sample. Journal of Child Psychology & Psychiatry Advances. DOI: 10.1002/jcv2.12198.

###

About ECHO:

Launched in 2016, the Environmental influences on Child Health Outcomes (ECHO) Program is a research program in the Office of the Director at the NIH with the mission to enhance the health of children for generations to come. ECHO investigators study the effects of a broad range of early environmental influences on child health and development. For more information, visit echochildren.org.

About the NIH: NIH, the nation’s medical research agency, includes 27 Institutes and Centers and is a component of the U.S. Department of Health and Human Services. NIH is the primary federal agency conducting and supporting basic, clinical, and translational medical research, and is investigating the causes, treatments, and cures for both common and rare diseases. For more information, visit.

Media Contacts

For information or to request an interview, contact Rebekah Yeager,  rebekah.yeager@nih.gov.

If you are not a member of the media, but have a general inquiry, please contact  NIHKidsandEnvironment@od.nih.gov.

Connect With Us

echo connectorCheck out the recent issues of our bi-monthly newsletter, the ECHO Connector, for program news and the latest research findings.

To receive the ECHO Connector through email, subscribe here.

Follow @ECHOChildHealth for the latest ECHO Program updates on Twitter.

Caregiver-Reported Measures of Childhood Behavior May be Biased by the Demographic Traits of Caregivers and Children

<< Back to Research Summaries

Caregiver-Reported Measures of Childhood Behavior May be Biased by the Demographic Traits of Caregivers and Children

Authors: Shuting Zheng, Maxwell Mansolf, Somer Bishop, et al.

 

Who sponsored this study?

The Environmental influences on Child Health Outcomes (ECHO) Program, Office of the Director, National Institutes of Health supported this research.

 

Why was this study needed?

Behavior problems observed in a young child can provide information on that child’s risk for certain developmental conditions and later mental health issues. A valid and unbiased measure of childhood behavior is critical for helping researchers and clinicians answer questions about the development of behavior problems in children from different backgrounds.

 

What were the study results?

Scores from the Child Behavior Checklist (CBCL) 1.5–5—a commonly used, caregiver-reported measure of internalizing (e.g., anxious) and externalizing (e.g., aggressive) behavior problems in children ages 1.5 to 5 years—may be biased by demographic factors such as the child’s age or the caregiver’s sex, education level, and primary language. Researchers found that caregiver responses for a number of questions on the CBCL were affected by caregiver or child demographic factors. The language (English vs. Spanish) the caregiver used to complete the survey contributed most to measurement bias, followed by their education level and sex. The child’s age and race also influenced CBCL scores.

By determining the factors contributing to measurement bias, ECHO researchers identified a subset of questions on the CBCL that were less impacted by bias but still reliably captured childhood behavior problems.

Footnote: Results reported here are for a single study. Other or future studies may provide new information or different results. You should not make changes to your health without first consulting your healthcare professional.

 

What was the study's impact?

The results of this study highlight the need to carefully consider possible sources of bias when using caregiver-reported measures. This study was the first to use a large, diverse sample of families to examine how demographic factors influence the answers given for individual survey questions in the widely used CBCL. Developing surveys with less bias can help researchers and clinicians better measure and compare behavior problems across groups of children who differ in age and family background.

 

Who was involved?

The study included caregivers of 9,087 young children (ages 18 to 71 months) from 26 ECHO research sites across the United States.

 

What happened during the study?

The researchers used data from 26 ECHO research sites to evaluate how caregiver responses to the CBCL varied based on the characteristics (age, sex, race, bilingual status, and neurodevelopmental disorders) of the child and the characteristics (sex, education level, household income level, and depression diagnosis) of the caregiver. Researchers then selected the CBCL questions that showed the least amount of bias and compared how well this subset of questions worked for evaluating childhood behavior problems when compared to the full CBCL survey. Additionally, the researchers mapped the scores from the less biased question sets to the scores provided by the full item sets, allowing them to derive comparable scores to the original CBCL scale.

What happens next?

ECHO researchers plan to apply the newly identified subset of less biased CBCL survey questions, evaluating its reliability in identifying children with clinically significant behavior problems. The identification of question sets with little bias offers researchers and clinicians better alternatives for measuring and comparing behavior problems across groups of children who differ in age and family background.

 

Where can I learn more?

Access the full journal article, titled “Measurement Bias in Caregiver-Report of Early Childhood Behavior Problems across Demographic Factors in an ECHO-wide Diverse Sample,” in the Journal of Child Psychology & Psychiatry Advances.

 

The content is the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

Published September 29, 2023

 

Access the associated article.

New ECHO Cohort Suggests Bias in Child Behavior Assessment Tool

Collaborative ECHO Cohort research led by Shuting Zheng, PhD, of the University of California, San Francisco, Maxwell Mansolf, PhD, of Northwestern University, and Somer Bishop, PhD, of the University of California, San Francisco suggests that scores from a commonly used measure of behavior problems in young children may be skewed depending on the primary language, education, and sex of the caregiver who fills out the survey.  This research, titled “Measurement Bias in Caregiver-Report of Early Childhood Behavior Problems across Demographic Factors in an ECHO-wide Diverse Sample,” is published in the Journal of Child Psychology & Psychiatry Advances.

Behavior problems observed in a young child can provide information on that child’s risk for certain developmental conditions and later mental health issues. A valid and unbiased measure of childhood behavior can help researchers and clinicians answer questions about the development of behavior problems in children from different backgrounds.

The Child Behavior Checklist 1.5-5 (CBCL) is a commonly used, caregiver-reported measure of internalizing (e.g., anxious) and externalizing (e.g., aggressive) behavior problems in children ages 1.5 to 5 years. Researchers wanted to find out if scores from this test could be affected by demographic factors such as the child’s age or the caregiver’s sex, education level, and primary language, even after accounting for mental health disparities between these groups. The research team’s goal for this study was to identify factors contributing to measurement bias and identify a subset of questions on the CBCL that were less impacted by bias but still reliably captured childhood behavior problems.

The study included caregivers of over 9,000 children between the ages of 18 to 71 months from 26 ECHO study sites across the United States. The data collected was used to evaluate how the characteristics of the child and the caregiver influence the caregiver responses to the CBCL questions. Researchers found that caregiver or child demographic factors affected caregiver responses to many questions on the CBCL. The language (English vs. Spanish) the caregiver used to complete the survey contributed most to measurement bias, followed by their education level and sex. The child’s age and race also influenced caregiver responses to many CBCL questions.

Researchers then selected the CBCL questions that showed the least amount of bias and compared how well they worked to evaluate childhood behavior problems when compared to the full CBCL survey. The researchers also mapped the scores from the less biased question sets to the scores provided by the full item sets, allowing users to derive comparable scores to the original CBCL scale.

Read the research summary.