DTC Face-To-Face March 2016

DTC Face-to-Face
March 16, 2016
Section 1
COLLEGE BOARD
SCORE REPORTS
Educator Reporting
Screen Shot Demo
Educator Reports First Time Login

+
Accessing the K12 Reporting tool, for Reports or ESR Downloads will
require agreement of terms and conditions.
Educator Reports Scores by Institution

View scores by institution for:
+
A State, District or School
Each assessment
administered
Each administration or
cohort
Each grade

+
View mean score

comparisons: School,
District, State, Nation
View scores for

- Districts/schools in a state
- Schools in a District
- Students in a School
View Benchmark
performance and
percentiles
Drill through to reports in

lower levels of hierarchy
Filter by demographics such

as Race/Ethnicity and Sex
NOTE: All data is fictitious.
6

+
Multiple views provided

based on user type and role
Individuals can drill up and

down their hierarchy to
view the same report for a
State, District, and School
Educator Reports Scores by Institution (More Info)

+
Expand More Info views

to view participation,
benchmark, and score
statistics in one place
Educator Reports Scores by Institution (More Info)

+
Expand More Info views

to view participation,
benchmark, and score
statistics in one place
Educator Reports Scores by Institution (Tabular)

+
Most graphical reports can

be viewed in a tabular
format
10
Educator Reports Creating Custom Groups

+
Educators can create

custom lists for analysis
- Create quick lists when
viewing reports
- Create/manage lists via
List Manager
States can create District,

School and Student lists
Districts can create School

and Student lists
Schools can create

Student lists
Lists cannot be imported to

the reporting tool, nor can
they be shared
11
Educator Reports Scores by Demographics

View scores by demographic
groups for:
+
Each assessment administered
Key demographics:
- Sex
- Race/Ethnicity
- Highest Level of Parental
Education
- Core Curriculum
- Student Search Service
Each administration or cohort
Each grade
12

+
View mean scores by

demographics
- Up to two
demographic levels
available
View Benchmark
performance by
demographics
Filter by demographics
such as Race/Ethnicity
and Sex
13

+
View mean scores by

demographics
- Up to two
demographic levels
available
View Benchmark
performance by
demographics
such as Race/Ethnicity
and Sex
14
Educator Reports Score Rosters

View score rosters for:
+
Each assessment
administered for a given
academic year
Roster summaries for a

State, District or School
Roster details for a School
15
Educator Reports Scores Roster

+
View score roster

summaries with high
level details for a State,
District and School
Drill down to a detail

Score Roster report for a
School
16

+
Score Roster
- Easy to export to excel
- Several data points to
hide/show
- Drill to Student Level
Report
17

+
Easily create print-ready

files for selected
students
- Formatted score labels
- Copy of student paper
score report
18
Educator Reports Student Longitudinal Information

View longitudinal information
for students by:
+
Drilling into student records

from reports
Searching for a student
19

+
Students score history

for entire SAT Suite of
Assessments available in
one place
Redesigned assessments
will have detailed score
information, mimicking
students view
10 10th
11th
10 10th
11th
Pre-redesigned
assessments will have
high-level scores only
20

+
Students score history

for entire SAT Suite of
Assessments in one
place
Redesigned assessments
will have detailed score
information, mimicking
students view
Pre-redesigned
assessments will have
high-level scores only
21
Educator Reports Search

+
States can search for

Districts, schools, and
students for a given
school
Districts can search for

schools and students for
a given school
Schools can search for

students
22
Educator Reports Search and Drill-Thru

+
An Educator can drill into a

District or School via
search and will be
navigated to a Summary
Report for that institution
An Educator can drill into a

student via search and will
be navigated to that
students score report
(summary and detail)
Bread crumb trail provided

to allow an educator to
drill up and down a
hierarchy
23
Educator Reports Benchmarks by Institution

View Benchmark performance
for:
+
Each assessment
administered
cohort
Each grade
24

+
View Benchmark
performance comparisons:
School, District, State, Nation
View aggregate and student

performance on Benchmarks:
- Need to strengthen skills (red)
- Approaching benchmark
(yellow)
- Meet or exceed benchmark
(green)
View percent of students

meeting both or no
benchmarks
Apply demographic filters
Drill-thru to lower levels in

the hierarchy
25

+

comparisons: School, District,
State, Nation
View aggregate and student

performance on Benchmarks:
(yellow)
(green)

meeting both or no
benchmarks
Drill-thru to lower levels in the

hierarchy
26
Educator Reports Benchmarks by Demographics

for:
+
Each assessment
administered
cohort
Each grade
27

+

for: School, District, State,
Nation
View aggregate performance

by demographic groups on
Benchmarks:
(yellow)
(green)

meeting both or no
benchmarks
28

+

for: School, District, State,
Nation
View aggregate performance

by demographic groups on
Benchmarks:
(yellow)
(green)

meeting both or no
benchmarks
29
Educator Reports Instructional Planning

View score performance for:
+
State, District or School
Each assessment
administered
Each administration
Each grade
30

+
Provides breakout of student

performance, in each Section,
Test and Subscores:
(yellow)
(green)
At school-level, ability to see

student in each performance
group
See state standards for

subscores
Drill-thru to Question Analysis

report
31

+
Provides breakout of student

performance, in each Section,
Test, and Subscores:
(yellow)
(green)
At school-level, ability to see

student in each performance
group
See state standards for

subscores
Drill-thru to Question Analysis

report
32
Educator Reports Question Analysis

View question performance
for:
+
Each assessment
administered
Each administration and

Form completed
Each grade
33

+
See performance, by question
For disclosed forms

- Individual answer choice
performance
- Link to actual question content
(including answer
explanations)
Available only for disclosed forms. PSAT 8/9 is a nondisclosed form in 2015-2016. PSAT 10 and April SAT
School Day are disclosed forms.
34

+
View student produced

responses
For non-disclosed
- % Correct / Incorrect
- No question content provided
Unscorable questions
also displayed
35
Educator Reports Question Analysis State Standards

+
See your state standards

for Subscores
Note: Links to State

Standards will eventually
be provided anywhere a
Subscore is reported;
currently only available in
the Question Analysis
Report
36

+
Link to individual student

performance
37
Educator Reports Score Trends by Institution

View score trends for:
+
A State, District or
School
Each assessment
administered
2-5 administrations or
cohorts
Each grade
38
Educator Reports Score Trends by Institution

+
View mean score trend

comparisons: School,
District, State, Nation
View score trends for

- Districts/schools in a state
- Schools in a District
- A School
Drill-thru to lower levels in

the reporting hierarchy
Filter by demographics such

as Race/Ethnicity and Sex
Screenshot
coming soon!
39
Educator Reports Score Trends by Demographics

View score trends for:
+
A State, District or
School
Each assessment
administered
2-5 administrations or
cohorts
Each grade
40
Educator Reports Score Trends by Demographics

+
View mean score trends

by demographics
- Up to two demographic
levels available
such as Race/Ethnicity and
Sex
Screenshot
coming soon!
41
Section 2
SAT SCHOOL DAY MONITORING
42
SAT School Day

Monitoring-School Visits
Identified High Schools/Test Centers will be visited on April 12
First year for state accountability
DOE monitors will be announced prior to visit
College Board staff will also be part of the school visits
Protocol for observations

Monitors will receive training prior to visiting
Security, administration, and testing environment protocol
will be observed
Monitoring Summary for DOE and College Board

Survey will inform potential improvements for future administrations
Feedback process
43
SMARTER MONITORING
44
Smarter Tests Monitoring School Visits

Elementary & middle schools will be visited during testing
DOE monitor(s) will be announced prior to visit
Annual process with rotation of districts
Protocol for observations

Monitors will receive training prior to visiting
Security, administration, and testing environment protocol will be
observed
Possible interviews of teachers, students, & administrators
Monitoring Summary for DOE and Districts

Monitors will complete a follow-up survey to help inform possible
improvements for future administrations
Feedback will be given to schools
45
Section 3
SAT ACCESSIBILITY
College Reportable Scores
Deadline for initial request: Feb. 24

Must be approved by College Board (CB)
Additional documentation sometimes required
CB will send scores to a college if the student has
requested they be sent
Scores will be used for accountability this year
If not approved, school should call the CB hotline
and submit appeal (844) 255-7728
School should do everything possible to avoid
using State Allowed Accommodation for a college
reportable accommodation
SAA is not college reportable
47
Delaware State Allowed Accommodations

College Non-Reportable Scores
College non-reportable score due to:
Accommodation determined to change construct (meaning) of SAT
Accommodation used by a student who did not have sufficient
supporting documentation to receive an approval
Accommodation used on Delaware Specific Non-College
Reportable list
Deadline: March 28
CB must be informed (automatically approved)
Documentation is not required
Scores will be used for accountability but will not be reported to
college
Parent Score Report and School Score Report will indicate the
score is not reportable to a college
If student wants College Reportable scores, he/she may re-take
the SAT using College Reportable accommodations in future
If student requests to send to a college, CB will not send the
scores
48
SAT Accommodations Request Process
DTC Monthly Meeting March 16, 2016
49
Contact College Board

Coordinator Hotline
(help with submitting approvals or checking approval status)
FAX:
(866) 360-0114
By Phone:
(212) 713-8333 or (844) 255-7728 (Coordinator Hotline)
By Email:
ssd@info.collegeboard.org
Students and Parents

(registration, online account questions)
By Phone: 212-713-8333
Delaware Department of Education Website

(Accommodations)
http://www.doe.k12.de.us/Page/2718
50
Section 4
SMARTER SCORING WINDOWS
Smarter Assessment Preliminary Scores
Score reports for parents and schools will arrive by mail in July
Preliminary online scores will be available earlier according to the following
scoring windows:
The score will be available in the

If Computerized Adaptive Test
(CAT) and Performance Task (PT) Online Reporting System (DeSSA
Portal) by this date:
for a content area are completed
by this date:
52
Online Reporting System (ORS)
Section 5
TECHNICAL ASSISTANCE
REMINDERS
Connecting Interim Results with

Digital Library Resources
Smarter received requests from teachers to connect
student results on interim assessment blocks to
resources in the Digital Library
Smarter staff developed the first iteration of these
resources. Feedback was requested before continuing
development on a more robust set of resources for the
interim assessment blocks
Based on survey feedback, SBAC will compile the
survey data and develop additional resources
55
Sample Interim Assessment Block Resources
56
Sample Interim Assessment Block Resources
57
Access to Smarter Resources

AVA Access
DeSSA Entry Training is a prerequisite (PDMS #24246)
Smarter Interim Training is also required (PDMS # 24288)
Digital Library Access

Different account than IMS
When locked out of existing account, contact
DeSSA Help Desk
If you need a new account, contact your ISO at the
school or district
58
Section 6
TRAINING UPDATES
New Training Available

SysAid Online Training
PDMS # TBD
Not required
Audience: DTCs and anyone else with administrative license for SysAid
Purpose: How to submit and monitor SysAid tickets
Accessibility Coordinator Training

PDMS #24483
Not required
Audience:
IEP, 504, ELL, Gen Ed/Supports Coordinators
Others who need/want the information
Purpose: Selection and use of accommodations
School Day SAT Attendance Tool Training
PDMS #24741
Not required
Audience: SAT test coordinators, school pupil accounting coordinators
Purpose: How to use the SAT Attendance tool in eSchoolPLUS
60
DeSSA Entry Training

Reminder about DeSSA Entry Training
Course #24246
Completion required to gain access to the TA
Interface
TAs must take it in addition to test to be
administered
Smarter Summative TA training
DCAS EOC TA Training
Smarter Interim TA Training
Wait 24-48 hours before logging in to launch

TA Interface
AVA
Proctored Practice Tests
61
How to Access Training

Make sure users know how and where to
register for and take DeSSA training
Register in PDMS
Follow the link in PDMS course record to
Schoology
62
Section 7
SYSAID TRAINING
What is SysAid?
Web-based application
Originally designed as a system to manage
Information Technology requests for assistance
Similar software packages are used by call
centers to document customer service calls
SysAid adapted for use by Office of Assessment to
manage requests for assistance regarding
statewide assessment
Administrative need to track
Timeliness of responses to districts
Number of requests from districts
Types of requests from districts
Who Uses SysAid?

DOE Office of Assessment
Statewide Assessment tickets are routed to Office of
Assessment
District Test Coordinators

Have full administrative licenses
https://SysAid.doe.k12.de.us/EndUserPortal.jsp OR
https://SysAid.doe.k12.de.us/Login.jsp
All IMS users

All users of IMS can log in at the End User Portal
and submit tickets, receive updates
https://SysAid.doe.k12.de.us/EndUserPortal.jsp
They do not have the full functionality that DTCs have
Log in to SysAid
District Test Coordinator logs in:
https://SysAid.doe.k12.de.us/EndUserPortal.jsp
OR https://SysAid.doe.k12.de.us/Login.jsp
Use IMS username/password
Submit a SysAid Ticket

District Test Coordinator clicks submit an
incident:

District Test Coordinator enters information
into a ticket somewhat like an email:
MUST choose statewide assessment
Describe ticket briefly (like email

subject)
Describe ticket in more detail
Select a security level
Select an assessment (if applicable)
Attach related documents

Submit
Email Updates From SysAid

Received by Submit
user, Request user, and
Assigned to user
When:
ticket is initiated
ticket status changes
notes are added
ticket is assigned to
another user
DOE wants to send you
information, On the
Record
How is the Ticket Handled?

DOE/Assessment SysAid Administrator (Helen)
receives the ticket
Administrator receives an email notifying that the
ticket is in queue
Administrator logs in and views the queue
Administrator opens ticket
The ticket is like a file folder a repository of all
information about the issue
Submit user and Request user
usually the same person
receives email updates on the progress of the ticket
Advantages:
No need to track multiple emails about the ticket - all
information is entered
Tickets are monitored/tracked to ensure timely response
View Your Service History

Check on your tickets, edit tickets

Review tickets
DTC checks status of tickets, modifies
tickets, selects, prints & exports tickets
Click on a ticket

Review tickets
DTC checks status of tickets, modifies
tickets, selects, prints & exports tickets
Click on a ticket
75
View or Edit a Ticket AFTER Submission
DOE notes and your notes

appear here
What Do I Submit in SysAid?

Exemption requests illness, etc.
Recently arrived ELL exemptions for SAT
Data Issues
Student/staff not in TIDE
Student/staff cant access test administration interface
Problem with training
Functionality problem with test or associated applications
Security reports
Cheating
Unauthorized sharing of test content
Changes to accommodations after test item 5
Reset, reopen requests
Other
Reporting Accommodations Changes

(After Item 5)
Security
Accoms Change:
More than 5 Items
Accommodations Change at item 7

Busytown
Student alerted the TA at item 7 that he did not have TTS Items. Student: Bob Jones ID 999999, sch
555 dist 66.
Irregularity
Math CAT
Knowledge Base
Knowledge Base
Knowledge Base
Knowledge Base
82
If you have any questions . . .

If you find that there is functionality
described in this presentation that you
think you do not have or you have
questions contact Helen Dennis
Helen.dennis@doe.k12.de.us
302-857-3316
83
Section 8
TEST RESET AND REOPEN POLICY
Test Reset and Reopen Policy

Smarter introduced new, stricter policy in
2015
Now applies to DCAS and EOC also
The following slides provide detail

This information is posted in the
Accessibility Coordinator training due to its
impact on accommodated test
administrations
District must submit requests via SysAid
85
Reset and Reopen Definitions

Reset
Erases a students test attempt and allows
student to begin a new attempt
If test is requested to be reset by mistake, AIR
can un-reset, but it takes some time
Reopen
Allows student to continue working on a test
despite its having been expired or even
reported
86
Test Reset Requests 1

If this . . . .
Reset Requests:
DO this . . . .
Security Level
If any of the following settings

need to be changed because
they were incorrectly set on a
CAT or PT:
American Sign Language
Braille
Closed captioning
Translation-stacked
(Spanish) Permissive Mode
Translations (Glossaries)
Request a reset in SysAid and

choose irregularity from the
security level drop-down.
Irregularity
Change to accommodations/
supports on a CAT when
student has been presented
with five items or fewer.
These settings cannot be changed

while a students test is paused. A
reset is necessary to change these
settings after a test is launched.
Pause student test. Change

accoms/supports. Re-launch
student test. Do not request a
reset.
No need to submit.
Security level: None.
87
Test Reset Requests 2

If this . . . .
Reset Requests:
DO this . . . .
District makes a change to

accommodations/supports
on a CAT while student test
is paused, when student
has been presented with
more than five items.
Submit an incident report in

SysAid. Do not request a reset.
Irregularity
Choose irregularity from
security drop-down in SysAid.
District makes a change to

accommodations/supports
on a PT while student test
is paused, when student
has been presented any
number of items in a
performance task.
Security Level

Irregularity
SysAid. Do not request a reset.
security drop-down in SysAid.
88
Test Reopen Requests 1

If this . . . .
DO this . . . .
Reopen Requests
A student is unable to complete a CAT or PT
test due to a technological difficulty that
results in the expiration of the test.
Security
Level

SysAid to request a reopen.
security drop-down.
Irregularity

security drop-down.
Irregularity

If a student is unable to complete a PT test
SysAid to request reopen.
before it expires (10 calendar days) due to an
unanticipated excused absence or
security drop-down.
unanticipated school closure.
Irregularity
A student is unable to complete a CAT test

before it expires (45 days) due to an
unanticipated excused absence (e.g. illness
documented by a medical professional) or
unanticipated school closure.
89
Test Reopen Requests 2

If this . . . .
Reopen Requests
DO this . . . .
Security Level
If a student starts a PT
unintentionallyfor example,
selects a PT instead of a CAT or
selects a mathematics PT instead
of an ELA PTand the student is
unable to complete the test
before it expires (10 calendar
days).

security drop-down.
Irregularity
A student unintentionally submits

a PT test before he or she has
completed itfor example, a
student submits the ELA PT
before completing part 2.
Submit an incident report to Irregularity

request a reopen, but choose
none from security dropdown.
90
Other Types of Requests

Grace Period Extension
Removes the effect of the 20-minute pause
rule
Allows students to access items previously
entered despite a pause of 20 minutes or
more since those items were answered
Segment Permeability
Removes the rule preventing the student from
returning to previous sections of the test
91
Section 9
SCHOOL DAY SAT ATTENDANCE

TOOL
Objectives
Learn to use the School Day SAT
Attendance Tool in eSchoolPLUS and
Cognos
Intended Audience
Test Center Coordinators
District/School Test Coordinators
eSchoolPLUS/Pupil Accounting
Coordinators
94
SAT Attendance Tool

Optional tool to
track attendance
eSchoolPLUS
Accountability
Screen Flags
School Year School
Day SAT
Pre-registered for
School Day SAT
Y/N
Attended School
Day SAT Y/N
95
Overview
1. The day before initial administration:
Download a School Day SAT roster from

eSchoolPLUS/Cognos in Excel format
2. After test administration:
Update the Attended field for each student in the

roster in Excel and use Y for Yes for each student
that attended
3. Upload the Attended field flags to eSchoolPLUS

4. Download a new roster the day before make-up
test to reflect enrollment changes
5. Take attendance on make-up day
6. Upload the Attended field flags to eSchoolPLUS
96
Before Test: Download Roster of

Students Who are Required to Test
To generate the roster:
1. Login to IMS
2. Select eSchoolPLUS
3. Click on Cognos Reporting
4. Select Standard DOE Public Folders
Shortcut
5. Select Standard DOE Public Reports
6. Select DeSSA Reports
7. Select SAT School Day Attendance
97
After Test: Update the Attended Fields

in Roster
98
Upload the Roster to eSchool

1. Save the roster file as a text file called SATAT.txt.
Delete all columns except student ID and Y indicator
and re-save
2. Login into eSchoolPLUS and select Upload File
from left menu. Upload your file called SATAT.txt.
You will see the file on your home screen under
Reports
3. Go to Utilities, Upload/Download, Run Upload
4. Select the upload called SATAT
5. Set Run Mode to Run upload, updating the
database
6. Check both Insert New Records and Update
Existing Records
99
Upload the Roster to eSchoolPLUS

(continued)
6.
Continued: Your screen should look like this:
7.
Select Run. The upload will show up on your home screen

under Tasks: Schedule. In a minute or two, it will move to
Tasks: Current. When it is complete, you will see a new
Interface Upload Log under Reports
100
Make Up Day Upload
101
Documents For Download in This

Course
The Upload/Download instructions are
posted inside this Schoology course for
your convenience
102
Contact the Office of

Assessment
(302) 857-3391
assessment@doe.k12.de.us
Please e-mail any additional questions or comments
103
Section 10
PLANNING
THE 2016-2017 ASSESSMENT CALENDAR
Current Testing Calendar 2015-2016
105
Input Needed for Developing DRAFT

2016-2017 Testing Calendar
This is a draft based on this years windows.
Please discuss and bring feedback to the March DTC meeting.
106
Section 11
DESSA SCORE REPORTS

PROVIDING ADDITIONAL INFORMATION
Updated Mock-Ups
108
DTC Questions
109

DTC Face-To-Face March 2016

Enviado por

Dados do documento

Direitos autorais

Formatos disponíveis

Compartilhar este documento

Compartilhar ou incorporar documento

Opções de compartilhamento

Você considera este documento útil?

Este conteúdo é inapropriado?

Direitos autorais:

Formatos disponíveis

DTC Face-To-Face March 2016

Enviado por

Direitos autorais:

Formatos disponíveis

DTC Face-to-Face

March 16, 2016

Educator Reports First Time Login

Educator Reports Scores by Institution

A State, District or School

Educator Reports Scores by Institution

View mean score

View scores for

Drill through to reports in

Filter by demographics such

Educator Reports Scores by Institution

Multiple views provided

Individuals can drill up and

NOTE: All data is fictitious.

Educator Reports Scores by Institution (More Info)

Expand More Info views

NOTE: All data is fictitious.

Educator Reports Scores by Institution (More Info)

Expand More Info views

NOTE: All data is fictitious.

Educator Reports Scores by Institution (Tabular)

Most graphical reports can

NOTE: All data is fictitious.

Educator Reports Creating Custom Groups

Educators can create

States can create District,

Districts can create School

Schools can create

Lists cannot be imported to

NOTE: All data is fictitious.

Educator Reports Scores by Demographics

A State, District or School

Each assessment administered

Each administration or cohort

Educator Reports Scores by Demographics

View mean scores by

NOTE: All data is fictitious.

Educator Reports Scores by Demographics

View mean scores by

NOTE: All data is fictitious.

Educator Reports Score Rosters

Roster summaries for a

Roster details for a School

Educator Reports Scores Roster

View score roster

Drill down to a detail

NOTE: All data is fictitious.

Educator Reports Scores Roster

NOTE: All data is fictitious.

Educator Reports Scores Roster

Easily create print-ready

NOTE: All data is fictitious.

Educator Reports Student Longitudinal Information

Drilling into student records

Searching for a student

NOTE: All data is fictitious.

Educator Reports Student Longitudinal Information

Students score history

NOTE: All data is fictitious.

Educator Reports Student Longitudinal Information

Students score history

NOTE: All data is fictitious.

Educator Reports Search

States can search for