Special Education

Attachment 2

New York State (NYS) Sampling Methodology for Some Federal Indicators in the 2005-10 SPP, Revised February 2008

NYS will collect data from a statewide representative sample of school districts on six federal indicators. No district will report on all indicators every year except New York City (NYC). All school districts will provide data on all six indicators distributed over a six-year period beginning with the initial year in which data are collected for each indicator. The six indicators are as follows:

  • Indicator 7: Percent of preschool children aged 3 through 5 with individualized education programs (IEPs) who demonstrate improved: A. Positive social-emotional skills (including social relationships); B. Acquisition and use of knowledge and skills (including early language/communication and early literacy); and C. Use of appropriate behaviors to meet their needs.
  • Indicator 8: Percent of parents with a child receiving special education services who report that schools facilitated parent involvement as a means of improving services and results for children with disabilities.
  • Indicator 11: Percent of children who were evaluated within 60 days of receiving parental consent for initial evaluation or, if the State establishes a timeframe within which the evaluation must be conducted, within that timeframe. NYS will use the data from 1/6 of the State’s school districts annually to monitor the requirements of this indicator. All school districts will be monitored on this indicator within the six-year period. The State will require documentation that all self-reported noncompliance is corrected within one year of notification of noncompliance. 
  • Indicator 12: Percent of children referred by Part C prior to age 3, who are found eligible for Part B, and who have an IEP developed and implemented by their third birthdays. NYS will use the data from 1/6 of the State’s school districts annually to monitor the requirements of this indicator. All school districts will be monitored on this indicator within the six-year period. NYS will require documentation that all self-reported noncompliance is corrected within one year of notification of noncompliance.
  • Indicator 13: Percent of youth with IEPs aged 15 and above with an IEP that includes appropriate measurable post-secondary goals that are annually updated and based upon an age-appropriate transition assessment, transition services, including courses of study, that will reasonably enable the student to meet those postsecondary goals, and annual IEP goals related to the student’s transition services needs, with evidence that the student was invited to the IEP Team meeting where transition services are to be discussed and evidence that, if appropriate, a representative of any participating agency was invited to the IEP Team meeting with the prior consent of the parent or student who has reached the age of majority. NYS will use the data from 1/6 of the State’s school districts annually to monitor the requirements of this indicator. All school districts will be monitored on this indicator within the six-year period. NYS will require documentation that all self-reported noncompliance is corrected within one year of notification of noncompliance.
  • Indicator 14: Percent of youth who are no longer in secondary school, had IEPs in effect at the time they left school, and were:
    1. Enrolled in higher education within one year of leaving high school.
    2. Enrolled in higher education or competitively employed within one year of leaving high school.
    3. Enrolled in higher education or in some other postsecondary education or training program; or competitively employed or in some other employment within one year of leaving high school.

NYS has distributed all school districts among six statewide representative samples. These six groups of school districts were tested with ANOVA and there was no statistical difference among the six groups of school districts on the population variables listed in the table below. These population variables were from the 2000 decennial census.

Census 2000 Population Variables Used to Ensure Each Sample of School Districts is Similar
population female poverty head of household n households in POV
n children in families n unempl over 16 n house classif in POV
n children w/single parent n in workforce n households w/ no plumbing
n children 5~17 in poverty n unempl 1999 n total Households
n 5~17 persons not in POV n one room Households
n 5~17 relevant for school n classif in POV n occupied Households
n less than 5 n children in 1 parent family n over 25 not graduate of HS
female head of household n children in families n total over 25

NYC is the only local educational agency (LEA) in the State with a total enrollment of 50,000 or more students, so it will be represented in each of the six samples.

For Indicators 8 and 13, all school districts will have a choice of reporting data on all eligible students or submitting data on a randomly selected sample of students. For Indicators 7, 11, 12 and 14 no districts except for NYC will be permitted to sample students who meet the criteria for the indicator. When permitted to sample, the minimum number of students required for the indicators can be obtained by using the sampling calculator provided by the State and the guidelines provided below. The vast majority of school districts will need to submit data on all eligible students on most indicators. For some large school districts if it will be less burdensome to report on a sample of students, the methodology described below (totally random sampling) is likely to produce a sample that is representative of the school district in terms of all variables, since every eligible student has the same chance as another student to be selected for the sample.

The State Education Department (SED) will require that LEAs maintain documentation as described below if they choose to report data on a sample of students. The totally random sampling methodology and required documentation should eliminate selection bias.  School districts will be required to over-sample as described below for indicator 8 where poor response rate is a known issue. Also, school districts will be encouraged to provide surveys for indicator 8 in a variety of ways to improve the response rate. 

SED will attempt to prevent missing data by first describing precisely what the State needs to collect, providing technical assistance and then following up with school districts to request missing data. The completeness of data collection will improve after the first year and will continue to improve as long as requirements remain unchanged.

All issues of confidentiality will be handled in accordance with the rules and procedures in FERPA. SED will also guard against divulging personally identifiable information by not reporting results when there are less than five students for whom data are available or when those results can be easily calculated based on other data provided.

Federal Indicator Number Eligible Population of Students From Which a Random Sample1 Must be Selected Minimum Number of Students in the Sample Method for Selecting Students Required Documentation
7 Entry - all children who are referred for preschool special education programs and/or services.
Exit  - all children who received preschool special education programs/or services for at least six months and are declassified or are within their last six months of eligibility for preschool special education services and the annual review meeting for whom  entry evaluation data are available.
Beginning in 2007-08, only NYC will sample students for this indicator. All other districts assigned to report data will be required to provide data on all exiting preschool children who meet the criteria and no sampling will be permitted.
To sample, NYC will use a sampling calculator. Require 95% confidence interval and plus or minus 5% margin of error.
Random selection using a random number table. Documentation period is seven years.
Maintain list of all eligible students, copy of Random Number Table used, beginning random number for selecting students and list of all students who were selected and their number.
8 Every preschool and school-age student with a disability who is provided special education program and/or services in a district-operated program or under contract with other service providers. Use a sampling calculator. Require 95% confidence interval and plus or minus 10% margin of error.
Expect 10% response rate, so require over-sampling by multiplying the minimum number identified by the calculator by 10.
Same as above. Same as above.
11 For preschool and school-age students: All preschool and school-age students for whom parental consent for an
initial evaluation was received during the school year (July 1-June 30).
Beginning in 2007-08, only NYC will sample students for this indicator. All other districts assigned to report data will be required to provide data on all children who meet the criteria and no sampling will be permitted.
To sample, NYC will use a sampling calculator. Require 95% confidence interval and plus
or minus 2% margin of error.
Same as above Same as above
12 All children who are referred for special education programs and/or services from Part C to Part B prior age 3 during the school year (July 1-June 30). Beginning in 2007-08, only NYC will sample students for this indicator. All other districts assigned to report data will be required to provide data on all preschool children who meet the criteria and no sampling will be permitted.
To sample, NYC will use a sampling calculator. Require 95% confidence interval and plus or minus 2% margin of error.
Same as above Same as above
13 All students with disabilities ages 15-21 who are provided special education services in district-operated programs or under contract with other service providers. All students up to 30.
NYC sample 100 students.
Same as above Same as above
14 All students with disabilities who are no longer in secondary school but received some special education program and/or service during the school year (July 1-June 30) in district-operated programs or under contract with another service provider.
(Include all students who left with a credential, reached maximum age for educational services or dropped out.)
Through 2007-08, school districts with less than 100 students with disabilities exiting, survey all students.
Through 2007-08, School districts with 100 or more students use the sampling calculator. Require 95% confidence interval and plus or minus 5% margin of error.
Beginning in 2008-09, only NYC will sample students for this indicator. All other districts assigned to report data will be required to provide data on all children who meet the criteria and no sampling will be permitted.
Same as above Same as above

The table below demonstrates a schedule for data collection from the six sample groups of school districts on the six federal indicators listed above.  Please note:

  • For Indicator 7, entry assessment data must be collected on all preschool children who are evaluated for preschool special education programs/or services annually by all school districts. Sample group 6 reports only entry data in 2005-06 but will not report exit data (i.e., entry to exit progress) until 2010-11. Exit evaluation data must be collected and reported to the State by the sample of school districts as described below.
  • For Indicator 14 (related to post school outcomes), requires school districts to collect contact information on students who will be leaving high school in “Year 1” and collect data on their post-school outcomes in “Year 2”. In order for all school districts to have post-school outcomes data by the 2010-11 school year, all sample groups will need to provide data on two indicators in one of the six years. All school districts will need to do Indicators 7-exit and 14 (Year 2) in the same year.

 

School Year Schedule for Reporting Data on Some Federal Indicators 2
Sample 1* Sample 2* Sample 3* Sample 4* Sample 5* Sample 6*
2005-06 8 11 12 13 14 (Year 1) 7 - entry
2006-07 11 12 13 14 (Year 1) 7-exit
14 (Year 2)
8
2007-08 12 13 14 (Year 1) 7-exit
14 (Year 2)
8 11
2008-09 13 14 (Year 1) 7-exit
14 (Year 2)
8 11 12
2009-10 14 (Year 1) 7-exit
14 (Year 2)
8 11 12 13
14 (Year 1)
2010-11 7-exit
14 (Year 2)
8 11 12 13 7-exit
14 (Year 2)

* NYC is in all sample groups.


1 The Sampling Plan is being revised as of February 2008.  For Indicators 7, 11, 12 and 14, random sampling will only be permitted for NYC. For these indicators, all other districts will report on all students meeting the criteria. For Indicators 8 and 13, the sampling plan remains unchanged.

2 Schedule for district cycles of reporting was revised in June 2007 to allow for all data to be collected and reported by 2010-2011, the life of the current State Performance Plan.

Last Updated: February 28, 2011ate -->