SBA Scores and Reporting Webinar

SBA Scores and Reporting Webinar

Understanding Smarter Balanced Scores and Reports September 13, 2018 Office of Superintendent of Public Instruction Chris Reykdal, State Superintendent Vision: All students prepared for post-secondary pathways, careers, and civic engagement. Mission: Transform K12 education to a system that is centered on closing opportunity gaps and is characterized by high expectations for all students

and educators. We achieve this by developing equity-based policies and supports that empower educators, families, and communities. Values: Ensuring Equity Collaboration and Service Achieving Excellence through Continuous Improvement Focus on the Whole Child Assessment Development

Our Belief: OSPI provides educators with critical tools, resources, and professional development to determine and communicate where students are in their learning and growth. An end-of-year, summative assessment is one tool for gaining information about student learning achievements during the year. Our Goals: Continue to develop high quality assessments that add value to Phase I of Superintendent Reykdals K 12 Education Vision for 201719. Promote the message that a summative assessment is one tool for gaining information about student learning and growth. Promote and expand relationships with the OSPI Career and Technical Education and Learning and Teaching departments, and establish and promote relationships with the Migrant & Bilingual Education, Educator Growth and Development, and Special Education departments to enhance educators understanding of student learning and assessment. Continue to improve the quality and equitable access of the state assessments and the quality, equitable access, and usability of assessment resources that we make available to educators and

district staff. Introductions Anton Jackson Director of Assessment Development [email protected] Shelley ODell ELA Assessment Specialist [email protected] Kristin Boline Math Assessment Specialist [email protected] 9/13/2018 | 4 Overview

Intended Audience and Purpose Who Teachers, Principals District Administrators, District Test Coordinators Family-School Partnership staff What Answer common questions & share resources for communicating test scores with families 9/13/2018 | 6 Agenda Overview

Categories of common questions Resources for communicating test scores with families This webinar will be recorded and posted (along with this PPT) for future use: In PLCs, department, staff meetings During back-to-school, parent-teacher, family outreach nights To add to presentations (choose, modify slides as needed) 9/13/2018 | 7 Common Questions Several Categories of Questions Reason for testing all students and supports available to students during testing Overall Scale Score and Score Uses, Vertical Scale, and

Standard Error of Measure (+/-) Levels 1, 2, 3, and 4 Claim scores, At/Near, and weighting How results can inform system thinking, instruction, and move student learning forward High School Reports and Higher Education Agreement 9/13/2018 | 9 Reason for Testing and Supports State and Federal accountability State-legislated graduation requirement for high school Supports for students Use best practices - students should use same support during instruction and assessments Know whats available to use during testing Make decisions at individual student level

Use Guidelines on Tool, Supports, & Accommodations (GTSA) Universal Tools Designated Support Accommodations (requires an IEP) For Students with Individualized Education Program (IEP) Provide supports information to parents during IEP conversations Coordinate among district/school staff to use common language 9/13/2018 | 10 Score Uses and Vertical Scale Use summative assessment as one of multiple measures Expected growth from one year to next (vertical scale) Students performing at Level 3 cut score one year and then at

Level 3 cut score next year are making one years worth of growth i.e., student scored 2432 in ELA in grade 3 and 2473 in ELA in grade 4 made one years worth of growth One years worth of growth is less clear at Levels 1 and 4 Anticipate guidance from Smarter Balanced this school year to support growth at ends of performance spectrum 9/13/2018 | 11 Overall Scale Score and Standard Error of Measure (+/-) Scale score alone IS students score Example shows score is 2680

+/- describes theoretical scores for student Example shows +/-10 It is not correct to add +/- to scale score to determine level or highest possible score +/- is included to show all measurement has variability *Source: 9/13/2018 | 12 Performance Levels Student performance at Level 3 and Level 4 is considered on track to College and Career Ready For accountability purposes, Level 3 and Level 4 are considered Proficient under Washington School Improvement Framework

(WSIF) For more information: WISF Framework or Proficiency Infographic Graduation cut scores apply only to high school ELA Graduation cut score is 2548 Math Graduation cut score is 2595 Levels are determined by student performance on all items across both Computer Adaptive Test (CAT) and Performance Task (PT) 9/13/2018 | 13

Claim Scores Claims Broad statements of skills and knowledge Claim scores Includes items from CAT and PT both math and ELA Example from ELA: Writing claim score is from both CAT & PT Full write is only part of writing claim score ( + 9 writing items in CAT) At/Near Claim score means Students are around Level 3 cut score could be just below, just above, or at line For more information see: Understanding Smarter Balanced Assessment Scores module Weighting

Total scale score is not weighted by claim, CAT, or PT All items contribute to total scale score 9/13/2018 | 14 How are scores determined on the SBA? A score is about estimating ability based on evidence Evidence comes from points earned and item difficulty Item difficulty is generated based on student performance in field testing Easy Moderate Difficult

9/13/2018 | 15 Item Difficulty: Difficulty: Each claim has a number of items with a varying range of difficulties intended to assess a range of student performance levels. Difficult Moderate Easy 9/13/2018 | 16 Test Map vs. Difficulty

Blueprints only determine distribution of items. Student performance on those items determines difficulty of future items for the student. Student who answers many difficult items correctly Student who answers easy items correctly but misses difficult items 9/13/2018 | 17 How a student performs across all claims generates their overall score

Overall Scale Score Estimation of Ability Level 4 Claim 1 Claim 2 Level 3 Level 2

Claim 3 Claim 4 Level 1 12/12/2019 | 18 Example: Student A Student A answers ~30 items correctly, most of which are difficult

Overall Scale Score Level 4 Estimation of Ability Level 3 Level 2 Level 1 9/13/2018 | 19

Example: Student B Student B answers ~30 items correctly, most of which are easy Overall Scale Score Level 4 Estimation of Ability Level

3 Level 2 Level 1 9/13/2018 | 20 Comparison of Sample Students Both students answered approximately the same number of items correctly The variance of

scale scores based on difficulty of items answered correctly Level 4 Level 4 Level 3 Level

3 Level 2 Level 2 Level 1 Level 1 Student A

Student B 9/13/2018 | 21 Limitations of a single test results Our belief: An end-of-year, summative assessment is one tool for gaining information about student learning achievements during the year. In order to use results to inform instruction and help student learning moving forward: Use results as one of multiple measures about student learning Use to evaluate instruction systemically at district, building, classroom levels To make district-driven decisions based on data:

Inform system evaluations Use longitudinal data 9/13/2018 | 22 High School Reports and Higher Education Agreement Reports in ORS do not show high school graduation cut scores Math: High School graduation cut is still 2595 ELA: High School graduation cut is still 2548 More information on ESHB 2224 FAQ webpage Washington State Council of Presidents On Issues & Advocacy webpage in COP: Policy Documents section Washington State Board for Community and Technical

Colleges On Preparing High School Students for College webpage in Campus Implementation and Placement Agreement section 9/13/2018 | 23 Next Steps We know we were not able to answer all questions In the chat box: Put the most burning question you still have Put a now that I know more, my question is question We will include these questions in an FAQ document to go along with this PPT and webinar recording

9/13/2018 | 24 Resources to Inform Parents Using ORS Reports Note: Aggregate results/reports only include students who tested Using Online Reporting System (ORS) with parents Timeline for sharing reports in ORS during testing window Usually by June 1 results are accurate enough to share with parents FERPA and student-specific information Parent/guardian only have access to their students information Features

Printing Individual Student Reports in Spanish Under Print, select Language: Spanish Next Steps for claim performance On Individual Student Report in Performance by Claim area 9/13/2018 | 26 Paper Reports and More Information on Sample Student Score Report webpage

12/12/2019 | 27 TestScoreGuide and ReadyWA websites TestScoreGuide Website Understanding Scores Sample Student Score Report Students Progress Resources with Parent Roadmaps

ReadyWA website For Educators For Families For Students 9/13/2018 | 28 Achievement Level Descriptors (ALDs) Audience: content educators Likely need some polishing/selecting if using Smarter Balanced version For ELA, on Smarter Balanced Reporting Scores webpage in Achievement Level Descriptors section

For math, grade-specific ALDs available on Mathematics Assessment webpage in Assessment Resources by Grade section Levels 3 and 4 describe skills on-grade students likely have at end of a year of instruction 9/13/2018 | 29 Thank you! For more information, email [email protected]

Recently Viewed Presentations

  • Analysis KO Analysis Defined Be able to select

    Analysis KO Analysis Defined Be able to select

    Triplets . Repetition . Sibilance . Alliteration . General term to show word or sound patterns in language . Creating a list of ideas . Listing three ideas close together or using three ideas. Saying something more than once across...
  • Module 1: Unit 1: Lesson 1

    Module 1: Unit 1: Lesson 1

    Theme Graphic Organizer (for Body Paragraph 2) Theme Graphic Organizer sample response. Homework—Purpose for reading chapter 16. The Lightning Thief RoutinesSharing Evidence Flags. Refer to your novel to answer the vocabulary questions that follow.
  • Directorate of Emergency Services Law Enforcement Branch Mission

    Directorate of Emergency Services Law Enforcement Branch Mission

    Mission Provide first class law and order through professional enforcement of laws and regulations, protecting property, and reducing/deterring crime to provide a safe and secure environment for ...
  • The OSHA Laboratory Standard - OhioBWC

    The OSHA Laboratory Standard - OhioBWC

    The OSHA Laboratory Standard Tim Govenor, CSP, CIH Institutional Chemical Hygiene Officer The Ohio State University [email protected] The OSHA Laboratory Standard CFR 1910.1450: Occupational Exposure to Hazardous Chemicals in Laboratories Came from the Hazard Communication Standard Established in 1990 State...
  • American Indian Culture Regions

    American Indian Culture Regions

    What is a culture region? Three Characteristics of Culture Regions Physical Terrain Natural Resources Culture everything that makes up the way of life of a people Map of American Indian culture regions 10 Culture Regions Arctic Subarctic Northwest Coast Plateau...
  • ABIOTIC & BIOTIC Key Vocabulary: -Ecosystem -Biotic -Abiotic

    ABIOTIC & BIOTIC Key Vocabulary: -Ecosystem -Biotic -Abiotic

    A HABITAT: is the place where an organism lives out its life Examples include the bottom of a stream, a maple tree, a pond, a park A habitat can change due to natural and human causes
  • Presentation title

    Presentation title

    Developed by Software Engineering Institute (SEI) at Carnegie Mellon University-1990. Is a conceptual framework for process management of software development. Evaluates processes used for executing software projects and improving the processes to positively affect quality in the software produced
  • 6.2 Process of Meiosis KEY CONCEPT Gametes have

    6.2 Process of Meiosis KEY CONCEPT Gametes have

    a. Skin cell b. Sperm cell Somatic cell Liver cell The fusion of gametes is called Fertilization. Reassortment. Meiosis. Gametogenesis. Check for understanding Meiosis makes haploid cells from diploid cells. Meiosis occurs in reproductive germ cells (testes & ovaries) Meiosis...