– How do I do this?
– What Barriers Might I Run Into and What Are Solutions?
– Where do I go for more resources?
Putting a universal screening and assessment process in use can support programs to foster children’s positive social-emotional development in order to prevent suspensions and expulsions. Universal screening is a fast and efficient way to identify children with potential areas of need or concern. Early identification through universal screening also helps programs match at-risk children with the services that benefit children and their families. This practice can result in stronger family partnerships (see Recommendation 1.2). It can also help establish formal collaborations with community partners to support the inclusion of young children with disabilities in your program. Targeted and intensive intervention services can help children who need them to begin and sustain positive relationships with their peers and with adults, possibly preventing and addressing the challenging behaviors that may lead to suspension and expulsion. For instance, many Head Start centers complete a social-emotional screener on all enrolled children within 45 days of the program start date. Screening is also a critical component of a multitiered system of support (to learn more, see Recommendation 1.8). To be most useful and beneficial to you and your program, it is important to use a universal screening and assessment tool that will provide accurate and specific information about what children know and are able to do.
How do I do this?
Step 1. Select a screening tool. When you select a screening tool, consider
- the appropriateness of the screener for your context,
- the technical adequacy of the screener, and
- the usability of the information generated by the screener
Consider the following questions to determine the appropriate screener for your program:
- When is the ideal time to assess children? How often should the tool be used?
- What can we learn about children’s areas of concern and strengths by using this tool?
- Have the format and content of the tool been used in past research and/or evaluation? What did other researchers and professionals learn about children from using the tool?
- Is the assessment contextually, culturally, and developmentally appropriate? Does it make sense to use for the children in our program?
Step 2. Determine the process for implementing the screening tool. This universal screener should be administered at the beginning of the school year to assess the achievement of developmental milestones for all children currently enrolled in the program. You will need to decide
- when that screener will be administered and
- by whom.
In general, administering the assessment with fidelity should be straightforward (e.g., it does not have a complex scoring procedure, or the complex scoring procedure should be streamlined). It would also be helpful to partner with local early intervention or early childhood special education programs to support your screening efforts. They may also offer practical advice, including suggestions for selecting screening tools, items, or tasks.
Step 3. Consider logistics and infrastructure needs. The assessment should not place a large burden on staff time or your program’s financial resources.
- Consider that administering the assessment may require that children and, to a greater extent, providers/teachers will be taken out of instruction and care time.
- Data collection, management, and interpretation require qualified staff, as well as tools that range from analytical software and a quiet testing space to personnel who can accommodate non-English speakers.
- Additional personnel may be required. See section.
- See the resources section for lists and compilations that summarize key characteristics such as the purpose of the instrument, cost of purchase, qualifications/training necessary to administer the tool – and can help in decision-making.
- Staff selection. Select staff to administer the screening tool who have the qualifications and training required (if any) for the tool. If qualifications are not specified, think about who has the skill sets needed to:
- administer the screener items consistently,
- develop a rapport with individual children, and
- carefully pull out and interpret children’s thinking.
- Time to practice and debrief. If training is not required, it may be helpful for staff to practice giving the screener to each other or to a child who does not attend the program.
- Practice allows the administrators to become familiar with the content and directions for each item. Practice also will help staff think through how to respond when children give unexpected responses, do not respond, or say “I don’t know.”
- It may also be helpful to meet with your staff after they administer the screener to a classroom to debrief. A particularly important topic of conversation includes which items seem problematic and how to adjust them or exclude them without compromising the technical adequacy of the overall assessment, using guidance typically offered in the tool’s technical manual.
Step 5. Use the results to inform supports and services. When preparing to use the ratings and results from the screener to identify children in need of additional supports and services, consider:
- Accurately scoring and interpreting scores. Put a process in place to ensure that an accurate score can be assigned to the performance of each child.
- This might mean that the person who scores the screener is different from the person who administers the screener.
- The next step is to interpret the score and figure out what it means. Guidance may be provided by the tool or through discussion with stakeholders. Regardless, providers/teachers, family members, and other stakeholders need to be able to understand what the score means, as well as the consequences associated with various screening outcomes (e.g., Does performance on the screener have the potential to qualify or disqualify a child for certain services? Does the score have any immediate or actionable implications for care and instruction?).
- Timeliness and having a quick turnaround. One of the defining characteristics of universal screening tools is that the data can be put into the hands of the provider/teacher fairly quickly once administration is complete.
- What the data look like and how they can be transformed into something your providers/teachers can use to inform care and instruction must be at the forefront of the decision-making process. Having this conversation with your providers/teachers to get their opinions may be fruitful. It may even be the case that some providers/teachers prefer one format over another, and it may be in your interest to find a way to accommodate such requests.
- For example, children who are identified as having concerns or risk factors should be monitored, referred for additional developmental and diagnostic assessments, or provided targeted instruction or intervention services. Risk or deficits in social-emotional development and/or behavioral adjustment can be targeted for intervention by using a tiered approach (see Recommendation 1.8).
- Another approach is to refer children and their families to local early intervention service (EIS) providers or to the local school district. Your local EIS provider or school district will contact the family to arrange for an evaluation to determine if a child is eligible for infant and early intervention or preschool special education services.
- The Birth to Five website summarizes the general steps that should be followed when a child is being considered for early intervention services.
What Barriers Might I Run Into and What Are Solutions?
Potential Barrier: How do we tell the difference between a rough week and clinically significant problems?
Solution: We recommend that you use a standardized, validated tool that is psychometrically/technically sound. Such instruments provide specific guidance or interpretation of what scores mean, including the threshold for clinical significance. There are multiple benefits to using a standardized instrument, such that
- individual items have been closely studied to determine whether the tool meets the technical standards established through research, and
- scores are computed based on nationally representative samples, allowing good comparisons with other children of the same age.
To make a determination about a child’s risk status, it is useful to compare performance or behavior relative to a similar group of peers (e.g., Does this child perform or behave similarly to other English language learning boys his age?). Local (school-, district-, or state-level) or national norms can also be used. Local norms may be especially useful for identifying the lowest performing children, but national norms tend to be more stable across subgroups over time.
Potential Barrier: My program is worried about misidentifying children.
Solution: When children are misidentified, it can lead to missed opportunities for instruction and intervention services or reduced opportunities for learning and growth. False positives and false negatives can also be prevented through initial and ongoing training for staff on how to implement the tool with fidelity.
- Invest the time to participate in the training recommended by the tool developers.
- Arrange for your staff to have opportunities to practice administering the tool to children before the screener is formally implemented.
- Provide a mechanism for those administering the screening to check in with each other, as well as with an expert in the tool or expert in assessment (e.g., program/school psychologist, psychologist through local university). These meetings help ensure that screening administrators are scoring consistently with each other and their actions and interpretations are in-line with the guidelines provided by the manual or best assessment practices.
- For example, a staff member may have a question about whether or not a child’s behavior should be interpreted as aggressive. This question could be posed to the group, who may also witness such behavior. The group, ideally led by an expert or master teacher/practitioner or coach, should come to a consensus about whether that behavior should be considered aggressive.
Potential Barrier: How can my program make sure the screening results and data are used in a meaningful way?
Solution: It is important that you hear the reactions and requests of providers/teachers and other staff who work with the children on a day-to-day basis on what information and data would be useful to them in their work.
- For example, consider sharing the screening options with your staff and having a conversation about the pros and cons of each tool. Consider structuring the conversation using the following prompts:
- Is this information useful? Why or why not? If not, what would make this information more useful?
- Can you see yourself using such information in your day-to-day work (e.g., planning group work or activities; diagnostic criteria)?
- Can you think of an example of when this information will be used or useful?
- Providers/teachers are more likely to participate in screening when the data
- help to solve a high-priority problem or question,
- do not require excessive effort to administer, and
- are central to the core mission and values of the program/school.
Potential Barrier: My program doesn’t have the resources or funding to conduct universal screening.
Solution: Your local Child Care Resource and Referral agency can help you find local free and low-cost training opportunities. They can also help you find grants for additional funding and resources.
- You can locate Child Care Resource and Referral agencies in your area through Child Care Aware’s search tool. Its State by State Resource Map can point you in the right direction for local resources on child care, health and social services, financial assistance, support for children with special needs, and more.
- Another approach is to refer that child and their families to local early intervention service (EIS) providers or to the local school district. Your local EIS or school district will contact the family to arrange for an evaluation to determine if a child is eligible for infant and early intervention or preschool special education services.
- The Birth to Five website summarizes the general steps that should be followed when a child is being considered for early intervention services.
Potential Barrier: My program doesn’t have the right staff or enough staff to do universal screening.
Solution: Consider building partnerships with your local universities and/or colleges. They may have the human resources necessary to implement screening into your program. Colleges of Education as well as Psychology Departments are filled with undergraduate and graduate students who would benefit from internships that will help them to translate academic knowledge from coursework into relevant professional skills. Having preservice teachers administer the assessment for course credit is cost-effective and provides students with the opportunity to work one-on-one with a child in a program setting. Educational psychologists would also benefit from such experiences, given the centrality of assessment in their training.
Where do I go for more resources?
- Looking for screening and assessment specific to social-emotional development? The Developmental screening and assessment instruments with an emphasis on social-emotional development for young children ages birth through five compiled by the Early Childhood Technical Assistance Center at the University of North Carolina, Frank Porter Graham Child Development Institute. This document contains a helpful list of instruments in a table that is organized by instrument name; provides a brief description, the appropriate age range on which the instrument can be used, the time it takes to administer the tool, how scoring works, and psychometric information (if available); and identifies the most appropriate party to administer the instrument (e.g., parent, practitioner, home visitor).
- The Screening for social-emotional concerns: Considerations in the selection of instruments brief developed by the Technical Assistance Center on Social Emotional Intervention (TACSEI) includes profiles on several validated assessment and screening tools. The profiles include summaries of the properties of each tool:
- Authenticity and equity
- Congruence and sensitivity
- Collaboration and convergence
- Time to administer and score
- Age range
- Data management system
- Looking for a comprehensive list of screening tools for young children? Check out Early childhood developmental screening: A compendium of measures for children ages birth to five, developed by the Office of Planning, Research and Evaluation (OPRE) and Administration for Children and Families (ACF) in the U.S. Department of Health and Human Services. This document also describes the standards that instruments need to meet in order to be considered “technically adequate” (read: reliable and valid). It also contains profiles of 16 individual measures. Information includes:
- Background and purpose of instrument
- Availability and cost
- Training and other requirements for assessors
- Information reporting system
- Approaches to family/parent input
- Options for use with special and diverse populations
- Characteristics of the norming sample
- Reliability and validity information
- Follow-up guidance
- In the process of selecting a developmental and behavioral screening tool to use as part of early childhood mental health consultation? Check out the Early childhood mental health consultation: An evaluation tool kit. The purpose of this tool kit is to increase capacity to evaluate the quality of early childhood mental health programs and services. Appendix C contains a list of outcome measures appropriate for providers/teachers to administer. If you are interested in childhood mental health consultation, please see Recommendation 2.1) of this guide.
- Looking for more resources to promote universal screening? Go to the Birth to 5: Watch Me Thrive! website. Birth to 5: Watch Me Thrive! is a coordinated federal effort to encourage healthy child development, universal developmental and behavioral screening for children, and support for the families and providers who care for them. There are links to resources for families and different kinds of providers serving infants, toddlers, and young children.
- Need training materials for your staff on developmental screening or resources for families? Go to the Centers for Disease Control and Prevention (CDC): Learn the Signs, Act Early website. This CDC site has resources for tracking children’s milestones from birth through age 5, including training modules for staff. If parents have concerns about their children’s development, suggested follow-up steps are provided.
- Want a way to involve families in early identification of concerns? Easter Seals Offers a Free, Confidential Online Screening Tool: Ages and Stages Questionnaire, Third Edition (ASQ-3). This screening tool will help families guide and keep track of their children’s growth and development during the first 5 years. The questionnaire takes 10 to 20 minutes, and families are encouraged to come back and learn about their children’s development over time.
- If you work alongside a school psychologist or partner with an educational psychologist and are interested in issues related to technical adequacy, please see Principle IV-C2 of the National Association of School Psychologists’ Professional Conduct Manual (2000).
- If you are interested in reading more about assessments and screening tools, see the NWEA (Northwest Evaluation Association) blog.
American Education Research Association & American Psychological Association. (1999). NCME: Standards for educational and psychological testing. Washington, DC: American Psychological Association.
Glover, T.A., & Albers, C.A. (2007). Considerations for evaluating universal screening assessments. Journal of School Psychology, 45, 117-135.
Hepburn, K. S., Kaufmann, R. K., Perry, D. F., Allen, M. D., Brennan, E. M., & Green, B. L. (2007). Early childhood mental health consultation: An evaluation tool kit. Washington, DC: Georgetown University, Technical Assistance Center for Children’s Mental Health; Johns Hopkins University, Women’s and Children’s Health Policy Center; and Portland State University, Research and Training Center on Family Support and Children’s Mental Health. Retrieved from http://gucchd.georgetown.edu/products/ECMHCToolkit.pdf
U.S. Department of Education and Health and Human Services (2015). Policy Statement on Inclusion of Children with Disabilities in Early Childhood Programs. Retrieved from http://www2.ed.gov/about/inits/ed/earlylearning/inclusion/index.html
Have questions? Want to provide feedback?