Appendix B

Miscellaneous Revisions/Edits to
State Performance Plan or Annual Performance Report

State Performance Plan - Attachment 2 - Sampling Plan - Revised February 2008 to improve reliability and validity of data collection for certain indicators.

State Performance Plan Indicator 10 - Revised February 2008 to align wording of the indicator and measurement to the federal language for this Indicator.

State Performance Plan Indicator 12 - Revised February 2008 to clarify the language describing the NYS measure being used.

Annual Performance Report Indicator 12 - Revised February 2008 to clarify the language describing the NYS measure being used.


Attachment 2

New York State (NYS) Sampling Methodology for Some Federal Indicators
in the 2005-10 SPP , Revised February 2008
 

NYS will collect data from a statewide representative sample of school districts on six federal indicators. No district will report on all indicators every year except New York City (NYC). All school districts will provide data on all six indicators distributed over a six-year period beginning with the initial year in which data are collected for each indicator. The six indicators are as follows:

NYS has distributed all school districts among six statewide representative samples. These six groups of school districts were tested with ANOVA and there was no statistical difference among the six groups of school districts on the population variables listed in the table below. These population variables were from the 2000 decennial census.

Census 2000 Population Variables Used to Ensure Each Sample of School Districts is Similar

population

female poverty head of household

n households in POV

n children in families

n unempl over 16

n house classif in POV

n children w/single parent

n in workforce

n households w/ no plumbing

n children 5~17 in poverty

n unempl 1999

n total Households

n 5~17

persons not in POV

n one room Households

n 5~17 relevant for school

n classif in POV

n occupied Households

n less than 5

n children in 1 parent family

n over 25 not graduate of HS

female head of household

n children in families

n total over 25

NYC is the only local educational agency (LEA) in the State with a total enrollment of 50,000 or more students, so it will be represented in each of the six samples.

For Indicators 8 and 13, all school districts will have a choice of reporting data on all eligible students or submitting data on a randomly selected sample of students. For Indicators 7, 11, 12 and 14 no districts except for NYC will be permitted to sample students who meet the criteria for the indicator. When permitted to sample, the minimum number of students required for the indicators can be obtained by using the sampling calculator provided by the State and the guidelines provided below. The vast majority of school districts will need to submit data on all eligible students on most indicators. For some large school districts if it will be less burdensome to report on a sample of students, the methodology described below (totally random sampling) is likely to produce a sample that is representative of the school district in terms of all variables, since every eligible student has the same chance as another student to be selected for the sample.

NYSED will require that LEAs maintain documentation as described below if they choose to report data on a sample of students. The totally random sampling methodology and required documentation should eliminate selection bias.  School districts will be required to over-sample as described below for indicator 8 where poor response rate is a known issue. Also, school districts will be encouraged to provide surveys for indicator 8 in a variety of ways to improve the response rate.  NYSED will attempt to prevent missing data by first describing precisely what the State needs to collect, providing technical assistance and then following up with school districts to request missing data. The completeness of data collection will improve after the first year and will continue to improve as long as requirements remain unchanged. All issues of confidentiality will be handled in accordance with the rules and procedures in FERPA. NYSED will also guard against divulging personally identifiable information by not reporting results when there are less than five students for whom data are available or when those results can be easily calculated based on other data provided.
 

Federal Indicator Number

Eligible Population of Students From Which a Random Sample[5] Must be Selected

Minimum Number of Students in the Sample

Method for Selecting Students

Required Documentation

7

Entry - all children who are referred for preschool special education programs and/or services.

Exit  - all children who received preschool special education programs/or services for at least six months and are declassified or are within their last six months of eligibility for preschool special education services and the annual review meeting for whom  entry evaluation data are available.

Beginning in 2007-08, only NYC will sample students for this indicator. All other districts assigned to report data will be required to provide data on all exiting preschool children who meet the criteria and no sampling will be permitted.

To sample, NYC will use a sampling calculator. Require 95% confidence interval and plus or minus 5% margin of error.

Random selection using a random number table.

Documentation period is seven years.

Maintain list of all eligible students, copy of Random Number Table used, beginning random number for selecting students and list of all students who were selected and their number.

8

Every preschool and school-age student with a disability who is provided special education program and/or services in a district-operated program or under contract with other service providers.

Use a sampling calculator. Require 95% confidence interval and plus or minus 10% margin of error.

Expect 10% response rate, so require over-sampling by multiplying the  minimum number identified by the calculator by 10.

Same as above.

Same as above.

11

For preschool and school-age students: All preschool and school-age students for whom parental consent for an initial evaluation was received during the school year (July 1-June 30).

Beginning in 2007-08, only NYC will sample students for this indicator. All other districts assigned to report data will be required to provide data on all children who meet the criteria and no sampling will be permitted.

To sample, NYC will use a sampling calculator. Require 95% confidence interval and plus or minus 2% margin of error.

Same as above

Same as above

12

All children who are referred for special education programs and/or services from Part C to Part B prior age 3 during the school year (July 1-June 30).

Beginning in 2007-08, only NYC will sample students for this indicator. All other districts assigned to report data will be required to provide data on all preschool children who meet the criteria and no sampling will be permitted.

To sample, NYC will use a sampling calculator. Require 95% confidence interval and plus or minus 2% margin of error.

Same as above

Same as above

13

All students with disabilities ages 15-21 who are provided special education services in district-operated programs or under contract with other service providers.

All students up to 30.

NYC sample 100 students.

Same as above

Same as above

14

All students with disabilities who are no longer in secondary school but received some special education program and/or service during the school year (July 1-June 30) in district-operated programs or under contract with another service provider.

(Include all students who left with a credential, reached maximum age for educational services or dropped out.)

Through 2007-08, school districts with less than 100 students with disabilities exiting, survey all students.

Through 2007-08, School districts with 100 or more students use the sampling calculator. Require 95% confidence interval and plus or minus 5% margin of error.

Beginning in 2008-09, only NYC will sample students for this indicator. All other districts assigned to report data will be required to provide data on all children who meet the criteria and no sampling will be permitted. 

Same as above

Same as above

The table below demonstrates a schedule for data collection from the six sample groups of school districts on the six federal indicators listed above.  Please note:

School Year

Schedule for Reporting Data on Some Federal Indicators[6]

Sample 1*

Sample 2*

Sample 3*

Sample 4*

Sample 5*

Sample 6*

2005-06

8

11

12

13

14 (Year 1)

7 - entry

2006-07

11

12

13

14 (Year 1)

7-exit
14 (Year 2)

8

2007-08

12

13

14 (Year 1)

7-exit
14 (Year 2)

8

11

2008-09

13

14 (Year 1)

7-exit
14 (Year 2)

8

11

12

2009-10

14 (Year 1)

7-exit
14 (Year 2)

8

11

12

13
14 (Year 1)

2010-11

7-exit
14 (Year 2)

8

11

12

13

7-exit
14 (Year 2)

* NYC is in all sample groups.

 
[5] The Sampling Plan is being revised as of February 2008.  For Indicators 7, 11, 12 and 14, random sampling will only be permitted for NYC. For these indicators, all other districts will report on all students meeting the criteria. For Indicators 8 and 13, the sampling plan remains unchanged.

[6] Schedule for district cycles of reporting was revised in June 2007 to allow for all data to be collected and reported by 2010-2011, the life of the current State Performance Plan.


Overview of the State Performance Plan Development

See Overview of the State Performance Plan Development preceding Indicator #1.

Monitoring Priority:  Disproportionality

Indicator 10: Percent of districts with disproportionate representation of racial and ethnic groups in specific disability categories that is the result of inappropriate identification.

 (20 U.S.C. 1416(a)(3)(C))

Measurement:

Percent = [(# of districts with disproportionate representation of racial and ethnic groups in specific disability categories that is the result of inappropriate identification) divided by the (# of districts in the State)] times 100.

Include State’s definition of “disproportionate representation.”

Describe how the State determined that disproportionate representation of racial and ethnic groups in specific disability categories was the result of inappropriate identification, e.g., monitoring data, review of policies, practices and procedures under 618(d), etc.

NYS Measurement:

NYS will compare the percent of total enrollment of each race/ethnic group that is identified by particular disabilities compared to other race/ethnic groups combined. For notifications of school districts during the 2005-06 school year based on 2004-05 school year data, the State will use the following definition of “disproportionate representation” and in subsequent years may revise the definition by lowering the relative risk ratio, weighted relative risk ratio as well as the minimum numbers of students. (The State’s definition of significant disproportion is the same as the definition of disproportion):

For Over-Identification of race/ethnic groups in specific disabilities:

·      At least 75 students with disabilities enrolled on 12/1/04;

·      A minimum of 30 students (disabled and nondisabled) of particular race/ethnicity enrolled on first Wednesday in October 2004;

·      At least 75 students (disabled and nondisabled) of all other race/ethnicities enrolled on first Wednesday in October 2004;

·      At least 10 students with disabilities of particular race/ethnicity and disability   enrolled in district on 12/1/04; and

·     Either:

o     Both the relative risk ratio and weighted relative risk ratio for any minority group  is 4.0 or higher; or

o     All students with disabilities in a specific disability category are of only one minority group regardless of the size of the relative risk ratio and weighted relative risk ratio.

For Under-identification of race/ethnic groups in specific disabilities:

NYSED has begun data analysis, however, will seek technical assistance from the National Center for Culturally Responsive Educational Systems (NCCRESt) to assist us with meaningful data analysis and reporting for under-representation in special education by race/ethnicity.

NYS will evaluate disproportionality in the identification of students by the following particular disabilities: learning disability; emotional disturbance; mental retardation, speech and language impairment; autism; and other health impairment.

Explanation of Revisions:

1.       Beginning with 2006-07 school year data, NYS will eliminate Indicator 10B from its SPP since this indicator is not required by USED. This change results in dropping SPP language related to 10B in the Indicator and in the NYS measure. However, NYS will still implement its responsibilities described in IDEA related to disproportionate placement, based on race/ethnicity, of students with disabilities, in particular Least Restrictive Environment (LRE) settings. NYS will also continue to require school districts to reserve up to 15 percent of IDEA funds for early intervening services when data indicate significant disproportionality in placement of students in particular settings.

2.       Language was added to the NYS measure to clarify that “significant disproportion” is defined the same as “disproportion.”

3.       Language was added to the NYS measure regarding under representation.
 



Part B State Performance Plan (SPP) for 2005-2010

Overview of the State Performance Plan Development

See Overview of the State Performance Plan Development preceding Indicator #1.  In addition, NYS consulted with the NYCDOE to identify NYC specific issues and needed improvement activities.

Monitoring Priority:  Effective General Supervision Part B / Effective Transition

Indicator 12:  Percent of children referred by Part C prior to age 3, who are found eligible for Part B, and who have an IEP developed and implemented by their third birthday.

(20 U.S.C. 1416(a)(3)(B))

Measurement:

a.      # of children who have been served in Part C and referred to Part B for eligibility determination.

b.      # of those referred determined to be NOT eligible and whose eligibilities were determined prior to their third birthday.

c.      # of those found eligible who have an IEP developed and implemented by their third birthday.

d.      # of children for whom parent refusal to provide consent caused delays in evaluation or initial services.

Account for children included in a but not included in b, c or d.  Indicate the range of days beyond the third birthday when eligibility was determined and the IEP developed and the reasons for the delays.

Percent = [(c) divided by (a – b – d)] times 100.

Explanation of Revision:

Minor wording changes were made to clarify the language for describing the NYS measure that is being used.



Overview of the Annual Performance Report Development:

See Overview of the Development of the Annual Performance Report on page 1.

Monitoring Priority: Effective General Supervision Part B / Effective Transition

Indicator 12:  Percent of children referred by Part C prior to age 3, who are found eligible for Part B, and who have an IEP developed and implemented by their third birthdays.

(20 U.S.C. 1416(a)(3)(B))

Measurement:

a.      # of children who have been served in Part C and referred to Part B for eligibility determination.

b.      # of those referred determined to be NOT eligible and whose eligibilities were determined prior to their third birthdays.

c.      # of those found eligible who have an IEP developed and implemented by their third birthdays.

d.      # of children for whom parent refusal to provide consent caused delays in evaluation or initial services.

Account for children included in a but not included in b, c or d.  Indicate the range of days beyond the third birthday when eligibility was determined and the IEP developed and the reasons for the delays.

Percent = [(c) divided by (a – b – d)] times 100.

NYS will use the above formula except it will add “e” to the equation as follows:

e.     # of children whose IEPs were not implemented by their third birthdays but for reasons that are “in compliance” with State regulations.

 NYS Baseline Data = [(c ) divided by (a-b-d-e)] times 100.

Explanation of Revision:

Minor wording changes were made to clarify the language for describing the NYS measure that is being used.