Towards a Better Test: Communicating Assessment Results to Families and Educators Tuesday, April 14 2:00-3:00 p.m. EDT
Agenda
Welcome About Achieve Webinar goals •  Why we developed sample student reports Cory Curl, Achieve, on sample student assessment report findings Resources developed Teresa Ramos, Advance Illinois, on feedback sessions with parents Q&A Webinar evaluation
2
About Achieve
Achieve is an independent, nonpartisan, nonprofit education reform organization committed to ensuring all students graduate from high school “college and career ready� or, in other words, academically prepared for any and all opportunities they choose to pursue. We provide technical assistance to states on the design, development, adoption, implementation, and communications of their college- and career-ready standards, assessments, curriculum and accountability systems. Achieve conducts R&D to help advance the work of states as well as the education reform community. Our research focuses on graduation requirements, standards implementation, state accountability models and international expectations. Our work doesn’t stop with reports; we also develop tools, such as rubrics and audits, to help states change policies and practices. We also have a range of advocacy resources to address common concerns with college and career readiness to help advocates develop, launch and refine their own college- and career-ready communications and outreach.
3
Insights from Sample Student Assessment Reports
Incorporating a learning and continuous improvement mindset
Goal: Advance awareness and capacity across states to report studentlevel assessment results in ways that maximize understanding by families, and use by teachers and school leaders. Strategy: Informed by suggestions from families, teachers and school leaders, develop innovative sample student-level reports and complementary communication materials. Process: – Issued RFI, selecting Tembo, Inc. as partner – Surveyed families and educators regarding current state reports – Applied findings to create draft sample score reports – Engaged parent/family and educator organizations in multiple rounds of feedback and revision
5
Sample reports and communication materials are intended to serve as guides to begin conversations about effective reporting The sample reports are based on a hypothetical “Sample Assessment” – The data elements that can be reported, and how they can be reported, vary across actual assessments Context matters – states will prioritize or communicate information differently based on their context We developed sample reports for 2017, allowing us to explore how to show progress/growth over time
6
Materials on Achieve website
All materials open-source available at: http://www.achieve.org/samplestudentreports Family reports differentiated by grade and subject English language arts: Grades 5, 8 and 11 Mathematics: Grades 5, 8 and Algebra II Educator and school reports Static Web view Communications Letter to families Flyer for families FAQ
7
Priority Areas to Address
Initial feedback on current reports led to three priorities
Prevent information overload Offer more context to student performance, including clear, actionable guidance Explore how to support families and educators in interpreting and acting on information
Overarching focus is on how to communicate about college and career readiness across grades and subjects
9
Across feedback sessions, families consistently prioritized the following:
How is my child performing according to standards/expectations? How well is my child performing relative to school, district, state? What can we do now? How has my child’s performance changed over time? What can we expect for next year’s assessment?
10
Three strategies to prevent information overload
1. Prioritize the information (family report)
11
Three strategies to prevent information overload (cont)
1. Prioritize the information (educator report)
12
Three strategies to prevent information overload (cont)
2. Ensure text is clear and easy to read
13
Three strategies to prevent information overload (cont)
3. Use color in simple graphics
14
Putting results in context is essential for understanding and use, deciding how involves trade-offs 1. Put overall score in context – “How well is my child performing relative to standards/expectations?”
15
Putting results in context is essential for understanding and use, deciding how involves trade-offs (cont) 2. Put overall score in context – “How well is my child performing relative to the school, district, state?”
3. “How has my child’s performance changed over time?”
16
Putting results in context is essential to build understanding and use, deciding how involves trade-offs (cont) 4. “What can we do now?�
17
How to support families and educators in interpreting and using the information
1. Contact information 2. Legends in close proximity
18
How to support families and educators in interpreting and using the information (cont)
3. Wraparound materials
19
Suggestions for language about student college and career readiness
20
Additional Suggestions for States
Language matters to families and educators
Avoid jargon and complex language Use clear, simple language Use positive, action-oriented language Personalize where possible California Assessment of Student Performance and Progress Student Score Report
22
Graphics need to be tested to ensure that families and educators can interpret them
Families like well-organized, simple graphs but will have challenges interpreting graphs with a lot of information Families may have challenges interpreting graphs without enough information Test all graphics well!
23
How families and educators access information also matters
Families want to be able to access the reports in multiple ways – some prefer to access online and others to have hard copies (and archive!) (also supported by May & Robinson 2007) Teachers also need to access the family reports to facilitate strong conversations with families about student results
24
Resources on sample student assessment reports h"p://www.achieve.org/samplestudentreports
25
State Example on Engaging Families and Educators
State leadership to engage families and educators on student assessment reports
Up-front engagement is critical to produce effective reports, as are ongoing strategies for continuous improvement. Partner with schools, districts, or organizations to recruit parents and educators with diverse characteristics and perspectives. – Achieve partnered with a school, two educator leadership organizations and a parent leadership organization. It’s essential to think through how feedback sessions are organized to get actionable information. – Achieve started with an introduction, discussed past experiences, asked questions about sample reports, and discussed ideal reports. Follow up is also important to continue engagement and buy-in. – Achieve followed up with a summary of findings.
27
Teresa Ramos Outreach Director, Advance Illinois
28
Questions & Answers
Mark your calendars!
Upcoming webinars: May 12th from 2-3pm EDT: How We Learn Now: Science Education for the Next Generation June 2nd from 2-3pm EDT: Topic TBD
30
Contact Us!
Anne Bowles Associate Director, Strategic Initiatives abowles@achieve.org or 202-419-1553 Cory Curl Senior Fellow, Assessment and Accountability ccurl@achieve.org or 202-308-6640 Alissa Peltzman Vice President, State Policy and Implementation Support apeltzman@achieve.org or 202-271-8558
31
Thank you!
Slides and resources at www.achieve.org/meetings-webinars We are very interested in receiving your feedback on this webinar: https://www.surveymonkey.com/r/3D2TMBF
32