This report presents the outcome analyses of the third and final year of the Jefferson County School Board Arts in Education Project (AEP). The AEP is an innovative program designed to administer arts instruction to youth in the public schools. It was hypothesized that students receiving the enhanced language-arts curriculum would significantly improve their academic grades and performance. Youth at the Howard Middle School in Jefferson County, Florida (treatment group) received the curriculum, while a matched set of youth attending Central Middle School in Madison County, Florida, were selected to serve as a comparison group. Various measures of academic progress were collected for the students in the treatment cohort and compared to those in the comparison cohort. Data were collected for the 5th, 6th, 7th and 8th grade years for both cohorts to assess outcome results. The results of this study indicate that both the treatment and comparison cohorts had decreases in mean subject grades over the study period. However, the treatment group exhibited significant increases in the National Norm Reference Test for reading and math scores, as well as increases in the annual Florida Comprehensive Assessment Test (FCAT) reading and math scores. Introduction The Justice Research Center, Inc. (JRC) was hired as a subcontractor to perform evaluation analyses for the Florida State University and Jefferson County School Board, Arts in Education Project. This report presents the final year analyses from the project. The Arts in Education Project (AEP) is an innovative program designed to administer arts instruction to youth at the Jefferson County Howard Middle School (treatment group). Youth attending Central Middle School in Madison County (comparison group) were likewise being tracked for comparison. The project was commenced during the 2003-04 school year when the youth in both cohorts were in sixth grade. At that time, retrospective data were collected on the youths’ 5th grade progress and outcomes. Data for the 6th grade year were collected and reported on in the Year One Arts in Education Project Report. At the request of the federal funding agency, the sixth grade year was used as the baseline year for outcome evaluation, with the fifth grade year reported for comparative purposes. Seventh grade data were collected and reported on in the Mid-Project Outcome Evaluation Report completed in 2006. The following report presents an overview of the academic semester changes from the 5th grade year to the final semester of the
8th grade year for the treatment and comparison groups. In examining significant outcome differences between the two groups, the 6th grade year was used as the baseline and each subsequent year-end semester through the 8th grade as outcome data. This quasi-experimental design was used (as random assignment was not permitted) to assess outcome differences in school performance between the treatment and comparison group. Significant differences should be interpreted with caution, as they may in part be due to internal or external factors impacting outcomes. Both descriptive statistics and analysis of variance models are presented in examining differences between the treatment and comparison groups on school performance measures. Study Hypotheses and Baseline Data In the original grant application, the Florida State University researchers hypothesized that students receiving the enhanced language-arts curriculum in Jefferson County’s Howard Middle School would significantly improve their reading and language arts skills as measured by three indicators: 1) student grades, 2) National Norm Referenced Test scores and 3) Florida Comprehensive Assessment Test (FCAT) scores in reading and math. It was also hypothesized that youth completing the intervention in the treatment group would exhibit improvements in other subjects such as reading, science, and social studies grades. Because past research has found a link between arts education and social skills, the Florida State University researchers also hypothesized that the language-arts intervention would enhance students’ empathy and prosocial skills. Improvement in these areas was to be measured by examining changes in school disciplinary referrals, attendance, suspensions and scores on two instruments: the Interpersonal Reactivity Index (IRI) to measure empathy, and the Social Skills Rating System (SSRS) to measure pro-social skills. While data on disciplinary referrals, attendance and suspensions were forwarded to the JRC, scores on the IRI and SSRS were not provided to the subcontractor and,
2
therefore, only changes on subject grades, national standardized tests, FCAT scores, school attendance, suspensions and disciplinary referrals are presented here. Findings The focus of the current analysis was to examine descriptive statistics and outcomes for the treatment (Jefferson) and comparison (Madison) cohorts of youth across the period from the students’ sixth grade year through the eighth grade. Within- and between-group comparisons of outcomes are presented for youths’ academic performance in the subject areas of language arts, reading, math, social studies and science; the extent of absences, suspensions and disciplinary actions; and performance on state and national standardized educational testing scores. Treatment and Comparison Group Descriptions
The 5th grade school year was originally intended to serve as the baseline measurement for the Arts in Education project. However, at the request of the federal funding agency seeking to have uniformity across funding sites, 6th grade was set as the baseline year against which subsequent years’ grades and scores would be compared for both the treatment and comparison cohorts. It should be noted, that for the final 8th grade year, data were not uniformly available for all Jefferson and Madison county study youth for science and social studies. As such, these two subjects were omitted from outcome evaluation comparisons. Table 1 presents the descriptive statistics for the treatment and comparison groups by academic grade/year. There were a total of 91 students in the 6th grade treatment cohort in Jefferson County. This compares to a class size of 236 in the comparison group, Madison County. While Florida State University project staff attempted to track each of these youths
3
through the 8th grade, there was attrition in data provided by the schools and as such, the sample sizes for both schools reduced by approximately 44% for Jefferson and 15% for Madison. The treatment group and comparison group had roughly equal proportions of male students (53% and 51%, respectively), however the treatment group had a slightly greater proportion of minority students than the comparison group (74% non-white and 61% non-white, respectively). The average academic year ages for both groups were similar for all years. Large differences, however, were seen in both the percentage of youth determined as ESE and the percentage of youth that had a disciplinary action during a given year. In 5th grade, only four percentage points separated Jefferson and Madison relative to the proportion of youth classified as ESE (13%, Jefferson; 17%, Madison). The ESE rate remained relatively stable in Madison County until the 8th grade, when more than one-third of the youths (37%) in the comparison group were designated as ESE. This was in contrast to roughly half of the Jefferson cohort being classified as ESE in the 7th and 8th grades. The percentage of youth with a disciplinary action fluctuated in both schools, with Jefferson increasing from 25% in 5th grade to nearly one-half of the study cohort youth receiving at least one disciplinary referral during the 8th grade year. The comparison group youth started with approximately one-third receiving a disciplinary action in 5th grade and increasing slightly to 38% by 8th grade. Table 1. Jefferson County (Treatment) and Madison County (Comparison) Descriptive Statistics: 5th through 8th Grade
School Jefferson
Madison
N 91
236
Percent Male 53%
51%
Percent White 26%
39%
Percent Non-White 74%
61%
Grade
Percent With ESE Classification
Percent With Disciplinary Action
Average Age
5th Grade
13%
25%
11.6
6th Grade
23%
33%
12.6
7th Grade
46%
20%
13.6
8th Grade
48%
46%
14.6
5th Grade
17%
34%
11.5
6th Grade
19%
56%
12.5
7th Grade
17%
51%
13.5
8th Grade
37%
38%
14.5
4
Change in Academic Achievement Within Schools
The following tables and narrative present the within- and between-school differences in academic performance and achievement. One-way, analysis of variance models (ANOVA) were used to test significant academic grade changes within the treatment school and comparison school separately. In addition, in some instances, post-hoc Bonferroni tests were utilized to examine specific year-to-year comparisons within subject-matter average grades. Independent samples t-tests were used to examine differences between the comparison and treatment groups on all applicable measures. Within-School Change in Academic Subject Grades
Tables 2 and 3, present end-of-year average grades by school subject for the Jefferson and Madison county cohorts, respectively. In general, grades did not change appreciably for either school during the study period. Comparing the baseline 6th grade year to the final 8th grade Table 2. Jefferson County Grades by Subject and Year (Descriptive Statistics)
Subject
Language Arts
Reading
Math
Science
Social Studies
Grade
N
Mean
Std. Deviation
Std. Error
Minimum
Maximum
5th Grade
80
79.3
10.6
1.2
52.3
96.8
6th Grade
91
76.6
11.0
1.1
50.0
95.7
7th Grade
79
68.0
8.0
0.9
50.0
89.5
8th Grade
51
72.0
8.5
1.2
51.7
91.8
5th Grade
80
75.9
8.9
1.0
53.3
95.7
6th Grade
91
75.4
10.5
1.1
53.0
95.8
7th Grade
78
68.7
7.6
0.9
54.3
88.8
8th Grade
33
76.9
8.9
1.6
55.7
89.8
5th Grade
80
76.7
9.5
1.1
50.0
91.8
6th Grade
91
71.6
11.2
1.2
50.7
93.5
7th Grade
79
70.7
9.5
1.1
51.7
91.5
8th Grade
51
76.1
8.9
1.2
53.2
91.7
5th Grade
80
79.1
9.7
1.1
58.3
98.7
6th Grade
91
71.5
11.9
1.2
49.7
94.3
7th Grade
78
75.7
10.8
1.2
50.0
92.0
8th Grade
17
77.0
7.8
1.9
60.0
90.8
5th Grade
80
78.9
10.0
1.1
54.5
98.5
6th Grade
91
71.8
12.1
1.3
50.0
94.5
7th Grade
79
70.1
9.0
1.0
51.0
88.5
8th Grade
51
79.0
8.9
1.2
57.5
92.8
5
Table 3. Madison County Grades by Subject and Year (Descriptive Statistics)
Subject
Language Arts
Reading
Math
Science
Social Studies
Grade
N
Mean
Std. Deviation
5th Grade
183
83.1
7.7
6th Grade
201
79.9
7th Grade
166
81.0
8th Grade
129
83.4
7.1
Std. Error
Minimum
Maximum
0.6
55.6
97.3
9.8
0.7
39.0
100.0
11.7
0.9
0.0
98.8
0.6
55.0
96.5
5th Grade
183
81.5
8.4
0.6
60.0
98.7
6th Grade
115
84.9
11.0
1.0
36.0
100.0
7th Grade
163
79.4
11.0
0.9
0.0
99.0
8th Grade
139
82.8
8.3
0.7
61.5
98.0
5th Grade
182
80.8
8.2
0.6
48.0
98.2
6th Grade
204
77.3
8.7
0.6
32.0
97.3
7th Grade
164
78.2
12.2
1.0
0.0
98.5
8th Grade
116
81.3
7.4
0.7
55.0
96.5
5th Grade
183
82.9
7.9
0.6
34.0
97.7
6th Grade
210
78.4
10.9
0.8
23.5
99.8
7th Grade
174
84.6
8.0
0.6
50.0
96.3
8th Grade
26
85.1
9.7
1.9
67.3
96.5
5th Grade
183
83.3
7.8
0.6
45.3
100.0
6th Grade
211
76.6
9.0
0.6
47.5
98.0
7th Grade
172
82.1
11.2
0.9
0.0
99.8
8th Grade
14
75.5
11.3
3.0
64.8
98.0
year, average grades increased slightly for Jefferson youth in reading, math, science and social studies, while decreasing slightly in language arts. Madison youth, on the other hand, exhibited slight increases in language arts, math and science, with decreases in reading and social studies. One-way, Analysis of Variance (ANOVA) models examining between and within group differences in language arts, reading, and math are presented in Tables 4 and 5. The results of these ANOVA analyses reveal that differences rose to the level of statistical significance for both the Jefferson and Madison youth cohorts.
6
Table 4. Jefferson County Between and Within Group Score Comparisons for School Subjects* (ANOVAs) Sum of Squares
Mean Square
F
5,886.1
3
1,962.03
20.64
0.00
Within Groups
28,233.5
297
95.06
Total
34,119.6
300 11.90
0.00
7.19
0.00
F
Sig.**
Between Groups Language Arts
Between Groups Reading
2,965.5
3
988.50
Within Groups
23,095.3
278
83.08
Total
26,060.8
281
2,126.6
3
708.86
Within Groups
29,291.4
297
98.62
Total
31,418.0
300
Between Groups Math
df
Sig.**
* Science and Social Studies are omitted as sample sizes were too small in 8th. ** The difference is significant at the .05 level. Values determined as insignificant are stricken.
Table 5. Madison County Between and Within Group Score Comparisons for School Subjects* (ANOVAs) Sum of Squares Between Groups Language Arts
1,452.0
3
484.00
58,990.4
675
87.39
Total
60,442.4
678
2,170.7
3
723.57
Within Groups
55,385.2
596
92.93
Total
57,555.9
599
Between Groups Math
Mean Square
Within Groups
Between Groups Reading
df
1,831.5
3
610.51
Within Groups
58,198.4
662
87.91
Total
60,030.0
665
5.54
0.00
7.79
0.00
6.94
0.00
* Science and Social Studies are omitted as sample sizes were too small in 8th. ** The difference is significant at the .05 level. Values determined as insignificant are stricken.
7
Post-hoc Bonferroni tests were utilized to examine specific year-to-year comparisons within subject-matter average grades. The critical year comparisons are 6th to 8th grade mean differences and corresponding significance levels (i.e., baseline year to final year). As can be seen in Table 6, the decreases in language arts grades were significant between 5th and 8th, and the 6th and 8th grade years for Jefferson County. While there was a 3.96 average percentage point increase between 7th and 8th grade in language arts, this change was not statistically significant at the 0.05 level. Conversely, Table 7 depicts the same test statistics for Madison County where the average language arts grade for students increased approximately 3.51 percentage points between 6th and 8th grade, a finding statistically significant at the 0.05 level. While average language arts grades did not increase for Jefferson students, their average grades for reading and math did increase significantly between the 7th and 8th grade years of the Arts in Education Project. Madison County reading grades while up over this same one-year period, actually declined overall between the 6th and 8th grade years.
8
Table 6. Jefferson County Between Grade Comparisons for School Subjects by Year** (Bonferroni Statistic) 95% Confidence Interval Dependent Variable
(I) Category
5th Grade
6th Grade
Language Arts 7th Grade
8th Grade
5th Grade
6th Grade
Reading 7th Grade
8th Grade
5th Grade
6th Grade
Math 7th Grade
8th Grade
(J) Category
Mean Difference (I-J)
Std. Error 1.49
Sig.* 0.42
Lower Bound
Upper Bound
-1.25
6.68
6th Grade
2.71
7th Grade
11.30
1.55
0.00
7.19
15.40
8th Grade
7.34
1.75
0.00
2.70
11.98
5th Grade
-2.71
1.49
0.42
-6.68
1.25
7th Grade
8.58
1.50
0.00
4.60
12.56
8th Grade
4.63
1.71
0.04
0.10
9.16
5th Grade
-11.30
1.55
0.00
-15.40
-7.19
6th Grade
-8.58
1.50
0.00
-12.56
-4.60
8th Grade
-3.96
1.75
0.15
-8.61
0.70
5th Grade
-7.34
1.75
0.00
-11.98
-2.70
6th Grade
-4.63
1.71
0.04
-9.16
-0.10
7th Grade
3.96
1.75
0.15
-0.70
8.61
6th Grade
0.46
1.40
1.00
-3.25
4.17
7th Grade
7.21
1.45
0.00
3.36
11.06
8th Grade
-1.07
1.89
1.00
-6.08
3.94
5th Grade
-0.46
1.40
1.00
-4.17
3.25
7th Grade
6.75
1.41
0.00
3.01
10.49
8th Grade
-1.53
1.85
1.00
-6.45
3.39
5th Grade
-7.21
1.45
0.00
-11.06
-3.36
6th Grade
-6.75
1.41
0.00
-10.49
-3.01
8th Grade
-8.28
1.89
0.00
-13.31
-3.25
5th Grade
1.07
1.89
1.00
-3.94
6.08
6th Grade
1.53
1.85
1.00
-3.39
6.45
7th Grade
8.28
1.89
0.00
3.25
13.31
6th Grade
5.08
1.52
0.01
1.04
9.12
7th Grade
6.01
1.58
0.00
1.83
10.20
8th Grade
0.55
1.78
1.00
-4.18
5.27
5th Grade
-5.08
1.52
0.01
-9.12
-1.04
7th Grade
0.93
1.53
1.00
-3.12
4.99
8th Grade
-4.54
1.74
0.06
-9.15
0.08
5th Grade
-6.01
1.58
0.00
-10.20
-1.83
6th Grade
-0.93
1.53
1.00
-4.99
3.12
8th Grade
-5.47
1.78
0.01
-10.21
-0.73
5th Grade
-0.55
1.78
1.00
-5.27
4.18
6th Grade
4.54
1.74
0.06
-0.08
9.15
7th Grade
5.47
1.78
0.01
0.73
10.21
* The difference is significant at the .05 level. Values determined as insignificant are stricken. ** Science and Social Studies are omitted as sample sizes were too small in 8th.
9
Table 7. Madison County Between Grade Comparisons for School Subjects by Year** (Bonferroni Statistic) 95% Confidence
Dependent Variable
(I) Category
(J) Category 6th Grade
5th Grade
6th Grade
Language Arts 7th Grade
8th Grade
5th Grade
6th Grade
Reading 7th Grade
8th Grade
5th Grade
6th Grade
Math 7th Grade
8th Grade
Mean Difference (I-J) 3.16
Std. Error 0.96
Sig.*
Interval Lower Upper Bound Bound
0.01
0.64
5.69 4.72
7th Grade
2.07
1.00
0.24
-0.58
8th Grade
-0.35
1.07
1.00
-3.19
2.49
5th Grade
-3.16
0.96
0.01
-5.69
-0.64
7th Grade
-1.10
0.98
1.00
-3.69
1.50
8th Grade
-3.51
1.05
0.01
-6.30
-0.72
5th Grade
-2.07
1.00
0.24
-4.72
0.58
6th Grade
1.10
0.98
1.00
-1.50
3.69
8th Grade
-2.42
1.10
0.17
-5.32
0.49
5th Grade
0.35
1.07
1.00
-2.49
3.19
6th Grade
3.51
1.05
0.01
0.72
6.30
7th Grade
2.42
1.10
0.17
-0.49
5.32
6th Grade
-3.43
1.15
0.02
-6.46
-0.39
7th Grade
2.02
1.04
0.31
-0.73
4.77
8th Grade
-1.38
1.08
1.00
-4.25
1.49
5th Grade
3.43
1.15
0.02
0.39
6.46
7th Grade
5.45
1.17
0.00
2.34
8.56
8th Grade
2.05
1.22
0.55
-1.17
5.26
5th Grade
-2.02
1.04
0.31
-4.77
0.73
6th Grade
-5.45
1.17
0.00
-8.56
-2.34
8th Grade
-3.40
1.11
0.01
-6.35
-0.45
5th Grade
1.38
1.08
1.00
-1.49
4.25
6th Grade
-2.05
1.22
0.55
-5.26
1.17
7th Grade
3.40
1.11
0.01
0.45
6.35
6th Grade
3.47
0.96
0.00
0.94
6.00
7th Grade
2.57
1.01
0.07
-0.11
5.24
8th Grade
-0.47
1.11
1.00
-3.42
2.48
5th Grade
-3.47
0.96
0.00
-6.00
-0.94
7th Grade
-0.91
0.98
1.00
-3.51
1.69
8th Grade
-3.94
1.09
0.00
-6.83
-1.06
5th Grade
-2.57
1.01
0.07
-5.24
0.11
6th Grade
0.91
0.98
1.00
-1.69
3.51
8th Grade
-3.03
1.14
0.05
-6.04
-0.02
5th Grade
0.47
1.11
1.00
-2.48
3.42
6th Grade
3.94
1.09
0.00
1.06
6.83
7th Grade
3.03
1.14
0.05
0.02
6.04
* The difference is significant at the .05 level. Values determined as insignificant are stricken. ** Science and Social Studies are omitted as sample sizes were too small in 8th.
10
Within-School Change in Absences, Suspensions and Disciplinary Actions
Shifting to absences, suspensions and disciplinary actions, Tables 8 and 9 present descriptive statistics for these measures for Jefferson and Madison county schools, respectively. Excused and unexcused absences decreased between 6th and 8th grades for youth in both the treatment and comparison group schools. The average number of excused absences decreased by 1.8 absences over this period for Jefferson and declined by 2.2 absences for Madison. Unexcused absences decreased by nearly 3 absences for Jefferson between the 6th and 8th grade years, while Madison exhibited a decline of 1.0 absences over this period.
Table 8. Jefferson County Absences, Suspensions and Disciplinary Actions by Year (Descriptive Statistics)
School Variables
Excused Absences
Unexcused Absences
Out of School Suspensions
Disciplinary Actions
Grade
N
Mean
Std. Deviation
Std. Error
Minimum
Maximum
5th Grade
91
3.2
5.1
0.5
0.0
25.0
6th Grade
91
3.1
3.4
0.4
0.0
17.0
7th Grade
91
2.2
3.6
0.4
0.0
18.0
8th Grade
50
1.3
2.1
0.3
0.0
12.0
5th Grade
91
6.4
6.2
0.6
0.0
28.0
6th Grade
91
9.3
8.7
0.9
0.0
38.0
7th Grade
91
8.8
10.2
1.1
0.0
53.0
8th Grade
50
6.5
5.7
0.8
0.0
23.0
5th Grade
91
0.8
2.2
0.2
0.0
14.0
6th Grade
91
1.5
2.8
0.3
0.0
12.0
7th Grade
91
1.6
3.2
0.3
0.0
19.0
8th Grade
50
1.7
3.3
0.5
0.0
17.5
5th Grade
91
0.3
0.4
0.0
0.0
1.0
6th Grade
91
0.3
0.5
0.0
0.0
1.0
7th Grade
91
0.2
0.4
0.0
0.0
1.0
8th Grade
50
0.5
0.5
0.1
0.0
1.0
11
Table 9. Madison County Absences, Suspensions and Disciplinary Actions by Year (Descriptive Statistics)
School Variable
Excused Absences
Unexcused Absences
Out of School Suspension
Disciplinary Actions
Grade
N
Mean
Std. Deviation
Std. Error
Minimum
Maximum
5th Grade
201
3.2
5.1
0.4
0.0
47.0
6th Grade
209
3.7
8.4
0.6
0.0
104.0
7th Grade
236
2.4
4.0
0.3
0.0
26.0
8th Grade
141
1.5
2.4
0.2
0.0
14.0
5th Grade
201
4.7
5.1
0.4
0.0
29.0
6th Grade
209
5.6
6.0
0.4
0.0
36.0
7th Grade
236
6.9
12.7
0.8
0.0
162.0
8th Grade
141
4.6
5.0
0.4
0.0
29.0
5th Grade
201
0.5
1.6
0.1
0.0
12.0
6th Grade
209
1.4
2.9
0.2
0.0
16.0
7th Grade
236
0.9
2.4
0.2
0.0
18.0
8th Grade
141
0.5
1.1
0.1
0.0
6.0
5th Grade
236
0.3
0.5
0.0
0.0
1.0
6th Grade
236
0.6
0.5
0.0
0.0
1.0
7th Grade
236
0.5
0.5
0.0
0.0
1.0
8th Grade
141
0.4
0.5
0.0
0.0
1.0
Review of ANOVAs and corresponding Bonferroni statistic of within-school differences over the study period reveals that these changes in excused and unexcused absences were not statistically significant at the 0.05 level for Jefferson County (treatment group).
Only the
decrease in excused absences was significant for Madison County (comparison group) (see Tables 10-13). The average number of out-of-school suspensions did not change appreciably between 6th and 8th grade for either the treatment or the comparison groups. The Bonferroni statistic of the mean difference in suspensions did not reach the level of statistical significance for the Jefferson County or Madison County cohorts.
12
Table 10. Jefferson County Between and Within Group Comparisons for Absences, Suspensions and Disciplinary Actions (ANOVAs) Sum of Squares Between Groups Excused Absences
153.6
3
51.19
4,827.8
319
15.13
Total
4,981.4
322
559.1
3
186.36
Within Groups
21,214.4
319
66.50
Total
21,773.5
322
42.7
3
14.22
Within Groups
2,600.0
319
8.15
Total
2,642.7
322
Between Groups Out of School Suspension
Between Groups Disciplinary Actions
Mean Square
Within Groups
Between Groups Unexcused Absences
df
2.6
3
0.86
Within Groups
64.7
321
0.20
Total
67.2
324
F
Sig.*
3.38
0.02
2.80
0.04
1.74
0.16
4.26
0.01
* The difference is significant at the .05 level. Values determined as insignificant are stricken.
Table 11. Madison County Between and Within Group Comparisons for Absences, Suspensions and Disciplinary Actions by Year (5th-8th) (ANOVAs) Sum of Squares Between Groups Excused Absences
3
159.44
Within Groups
24,605.0
783
31.42
Total
25,083.3
786
662.7
3
220.89
Within Groups
54,236.2
783
69.27
Total
54,898.9
786
Between Groups Out of School Suspension
107.2
3
35.72
Within Groups
3,767.5
783
4.81
Total
3,874.7
786
Between Groups Disciplinary Actions
Mean Square
478.3
Between Groups Unexcused Absences
df
6.9
3
2.29
Within Groups
203.5
845
0.24
Total
210.4
848
F
Sig.*
5.07
0.00
3.19
0.02
7.42
0.00
9.50
0.00
* The difference is significant at the .05 level. Values determined as insignificant are stricken.
13
Table 12. Jefferson County Between Grade Comparisons for Absences, Suspensions and Disciplinary Actions by Year (Bonferroni Statistic) 95% Confidence
Dependent Variable
(I) Category
5th Grade
6th Grade
Excused Absences 7th Grade
8th Grade
5th Grade
6th Grade
Unexcused Absences 7th Grade
8th Grade
5th Grade
6th Grade
Out-of-School Suspensions 7th Grade
8th Grade
5th Grade
6th Grade
Disciplinary Actions 7th Grade
8th Grade
(J) Category
Mean Difference (I-J)
Std. Error
Sig.*
Interval Lower Upper Bound Bound
6th Grade
0.12
0.58
1.00
-1.41
7th Grade
1.00
0.58
0.50
-0.53
2.53
8th Grade
1.91
0.68
0.03
0.09
3.72
5th Grade
-0.12
0.58
1.00
-1.65
1.41
7th Grade
0.88
0.58
0.77
-0.65
2.41
8th Grade
1.79
0.68
0.06
-0.03
3.60
5th Grade
-1.00
0.58
0.50
-2.53
0.53
6th Grade
-0.88
0.58
0.77
-2.41
0.65
8th Grade
0.91
0.68
1.00
-0.91
2.72
5th Grade
-1.91
0.68
0.03
-3.72
-0.09
6th Grade
-1.79
0.68
0.06
-3.60
0.03
7th Grade
-0.91
0.68
1.00
-2.72
0.91
6th Grade
-2.92
1.21
0.10
-6.13
0.29
7th Grade
-2.40
1.21
0.29
-5.61
0.81
8th Grade
-0.11
1.44
1.00
-3.92
3.70
5th Grade
2.92
1.21
0.10
-0.29
6.13
7th Grade
0.53
1.21
1.00
-2.68
3.74
8th Grade
2.82
1.44
0.30
-0.99
6.63
5th Grade
2.40
1.21
0.29
-0.81
5.61
6th Grade
-0.53
1.21
1.00
-3.74
2.68
8th Grade
2.29
1.44
0.67
-1.52
6.10
5th Grade
0.11
1.44
1.00
-3.70
3.92
6th Grade
-2.82
1.44
0.30
-6.63
0.99
7th Grade
-2.29
1.44
0.67
-6.10
1.52
6th Grade
-0.69
0.42
0.62
-1.82
0.43
7th Grade
-0.80
0.42
0.35
-1.93
0.32
8th Grade
-0.94
0.50
0.37
-2.27
0.39
5th Grade
0.69
0.42
0.62
-0.43
1.82
7th Grade
-0.11
0.42
1.00
-1.23
1.01
8th Grade
-0.25
0.50
1.00
-1.58
1.09
5th Grade
0.80
0.42
0.35
-0.32
1.93
6th Grade
0.11
0.42
1.00
-1.01
1.23
8th Grade
-0.14
0.50
1.00
-1.47
1.20
5th Grade
0.94
0.50
0.37
-0.39
2.27
6th Grade
0.25
0.50
1.00
-1.09
1.58
7th Grade
0.14
0.50
1.00
-1.20
1.47
6th Grade
-0.08
0.07
1.00
-0.25
0.10
7th Grade
0.05
0.07
1.00
-0.12
0.23
8th Grade
-0.21
0.08
0.05
-0.42
0.00
1.65
5th Grade
0.08
0.07
1.00
-0.10
0.25
7th Grade
0.13
0.07
0.29
-0.04
0.31
8th Grade
-0.13
0.08
0.55
-0.34
0.08
5th Grade
-0.05
0.07
1.00
-0.23
0.12
6th Grade
-0.13
0.07
0.29
-0.31
0.04
8th Grade
-0.26
0.08
0.00
-0.47
-0.06 0.42
5th Grade
0.21
0.08
0.05
0.00
6th Grade
0.13
0.08
0.55
-0.08
0.34
7th Grade
0.26
0.08
0.00
0.06
0.47
* The difference is significant at the .05 level. Values determined as insignificant are stricken.
14
Table 13. Madison County Between Grade Comparisons for Absences, Suspensions and Disciplinary Actions by Year (Bonferroni Statistic) 95% Confidence
Dependent Variable
(I) Category
5th Grade
6th Grade
Excused Absences 7th Grade
8th Grade
5th Grade
6th Grade
Unexcused Absences 7th Grade
8th Grade
5th Grade
6th Grade
Out-of-School Suspensions 7th Grade
8th Grade
5th Grade
6th Grade
Disciplinary Actions 7th Grade
8th Grade
(J) Category
Mean Difference (I-J)
Std. Error
Sig.*
Interval Lower Upper Bound Bound
6th Grade
-0.57
0.55
1.00
-2.03
0.90
7th Grade
0.79
0.54
0.84
-0.63
2.22
8th Grade
1.63
0.62
0.05
0.00
3.26
5th Grade
0.57
0.55
1.00
-0.90
2.03
7th Grade
1.36
0.53
0.06
-0.05
2.77
8th Grade
2.20
0.61
0.00
0.58
3.82
5th Grade
-0.79
0.54
0.84
-2.22
0.63
6th Grade
-1.36
0.53
0.06
-2.77
0.05
8th Grade
0.84
0.60
0.96
-0.74
2.42
5th Grade
-1.63
0.62
0.05
-3.26
0.00
6th Grade
-2.20
0.61
0.00
-3.82
-0.58
7th Grade
-0.84
0.60
0.96
-2.42
0.74
6th Grade
-0.75
0.82
1.00
-2.92
1.43
7th Grade
-2.14
0.80
0.05
-4.25
-0.03
8th Grade
0.09
0.91
1.00
-2.33
2.50
5th Grade
0.75
0.82
1.00
-1.43
2.92
7th Grade
-1.39
0.79
0.47
-3.48
0.70
8th Grade
0.83
0.91
1.00
-1.57
3.23
5th Grade
2.14
0.80
0.05
0.03
4.25
6th Grade
1.39
0.79
0.47
-0.70
3.48
8th Grade
2.22
0.89
0.07
-0.12
4.57
5th Grade
-0.09
0.91
1.00
-2.50
2.33
6th Grade
-0.83
0.91
1.00
-3.23
1.57
7th Grade
-2.22
0.89
0.07
-4.57
0.12
6th Grade
-0.93
0.22
0.00
-1.50
-0.35
7th Grade
-0.40
0.21
0.35
-0.96
0.16
8th Grade
-0.04
0.24
1.00
-0.68
0.59
5th Grade
0.93
0.22
0.00
0.35
1.50
7th Grade
0.53
0.21
0.07
-0.02
1.08
8th Grade
0.88
0.24
0.00
0.25
1.51
5th Grade
0.40
0.21
0.35
-0.16
0.96
6th Grade
-0.53
0.21
0.07
-1.08
0.02
8th Grade
0.36
0.23
0.77
-0.26
0.97
5th Grade
0.04
0.24
1.00
-0.59
0.68
6th Grade
-0.88
0.24
0.00
-1.51
-0.25
7th Grade
-0.36
0.23
0.77
-0.97
0.26
6th Grade
-0.21
0.05
0.00
-0.33
-0.09
7th Grade
-0.17
0.05
0.00
-0.28
-0.05
8th Grade
-0.03
0.05
1.00
-0.17
0.11
5th Grade
0.21
0.05
0.00
0.09
0.33
7th Grade
0.05
0.05
1.00
-0.07
0.17
8th Grade
0.18
0.05
0.00
0.04
0.32
5th Grade
0.17
0.05
0.00
0.05
0.28
6th Grade
-0.05
0.05
1.00
-0.17
0.07
8th Grade
0.13
0.05
0.07
-0.01
0.27
5th Grade
0.03
0.05
1.00
-0.11
0.17
6th Grade
-0.18
0.05
0.00
-0.32
-0.04
7th Grade
-0.13
0.05
0.07
-0.27
0.01
* The difference is significant at the .05 level. Values determined as insignificant are stricken.
15
Within-School Change in State and National Test Scores
Table 14 presents the descriptive statistics for Jefferson county youth relative to their state and national standardized test scores. Jefferson went from an average FCAT Reading Score of 264 in the 6th grade to an average score of 259 by the 8th grade and increased in the National Percentile Ranking from 42 to 47. Moreover, Jefferson youth demonstrated significant increases in math comprehension with an increase from an average FCAT Math Score of 251 in the 6th grade to an average of 281 by 8th grade, and from an average National Math Percentile Ranking of 45 to an average of 54 by the 8th grade.
Table 14. Jefferson County State and National Test Scores by Grade (Descriptive Statistics)
Academic Variable
FCAT Scale Reading Score (Test 10)
FCAT Scale Math Score (Test 20)
National Percentile Ranks for Reading Score
National Percentile Ranks for Math Score
Grade
N
Mean
Std. Deviation
Std. Error
Minimum
Maximum
5th Grade
79
243.2
63.2
7.1
100.0
376.0
6th Grade
87
264.1
53.9
5.8
100.0
356.0
7th Grade
71
269.1
63.3
7.5
100.0
392.0
8th Grade
52
259.2
64.7
9.0
100.0
368.0
5th Grade
79
245.5
76.7
8.6
100.0
392.0
6th Grade
87
251.7
59.8
6.4
100.0
354.0
7th Grade
72
275.0
56.5
6.7
100.0
378.0
8th Grade
52
280.9
65.4
9.1
100.0
372.0
5th Grade
80
34.5
24.4
2.7
1.0
87.0
6th Grade
87
42.3
25.6
2.7
1.0
96.0
7th Grade
73
43.8
25.0
2.9
2.0
97.0
8th Grade
44
47.2
26.8
4.0
2.0
92.0
5th Grade
80
36.4
24.9
2.8
1.0
98.0
6th Grade
87
44.5
25.0
2.7
2.0
96.0
7th Grade
73
46.4
24.1
2.8
5.0
93.0
8th Grade
44
54.2
25.3
3.8
4.0
97.0
Madison County youth overall had higher mean FCAT Reading and Math scores, as well as higher average percentile reading and math rankings than Jefferson County youth (see Table 15). The comparison group youth went from an average FCAT Reading Score of 276 in 6th
16
grade to 289 in 8th grade, while their average national percentile rankings were 43 on reading in 6th grade and 58 by the 8th grade. Greater means were also exhibited among Madison youth for their 8th grade FCAT Math Scores and National Math Percentile Rankings, in comparison to their 6th grade year.
Table 15. Madison County State and National Test Scores by Grade (Descriptive Statistics)
Academic Variable FCAT Scale Reading Score (Test 10)
FCAT Scale Math Score (Test 20)
National Percentile Ranks for Reading Score
National Percentile Ranks for Math Score
Grade
N
Mean
Std. Deviation
Std. Error
Minimum
Maximum
5th Grade
191
266.5
60.9
4.4
100.0
395.0
6th Grade
225
275.7
64.6
4.3
100.0
500.0
7th Grade
156
283.7
55.9
4.5
100.0
445.0
8th Grade
131
289.0
56.6
4.9
100.0
441.0
5th Grade
191
280.1
71.5
5.2
100.0
467.0
6th Grade
222
264.9
70.9
4.8
100.0
406.0
7th Grade
157
277.6
53.6
4.3
100.0
402.0
8th Grade
131
295.3
61.2
5.4
100.0
386.0
5th Grade
183
44.6
26.7
2.0
2.0
98.0
6th Grade
201
43.4
26.7
1.9
1.0
99.0
7th Grade
152
44.4
25.6
2.1
3.0
99.0
8th Grade
130
58.0
24.3
2.1
2.0
98.0
5th Grade
182
50.2
27.4
2.0
1.0
99.0
6th Grade
201
53.0
26.4
1.9
1.0
99.0
7th Grade
152
49.0
23.7
1.9
5.0
99.0
8th Grade
130
62.1
24.7
2.2
3.0
99.0
Within-group comparisons for the state and national test scores by year reveals statistically significant differences for both the Jefferson and Madison county youth (see Tables 16 and 17). The post-hoc Bonferroni tests of the mean difference between the 6th and 8th grade on the state and national test scores were not statistically significant for Jefferson County (see Table 18). Mean difference comparisons of 6th to 8th grade were significant for Madison County youth on the FCAT Scale Math Score, National Percentile Reading Ranking, and the National Percentile Math Ranking (see Table 19). While these differences are notable, it is important to note that these tests merely examine overall average math and reading scores per school in one
17
year compared to the overall scores for per school in the final year of the project. These numbers do not however examine the one-to-one individual change in academic performance on the state and national tests. Between-school comparisons therefore are needed to examine the individual change over time.
Table 16. Jefferson County Between and Within Group Comparisons for State and National Test Scores by Year (ANOVAs)
Sum of Squares FCAT Scale Reading Score (Test 10) FCAT Scale Math Score (Test 20) National Percentile Ranks for Reading Score National Percentile Ranks for Math Score
Between Groups
Norm Referenced Test Math Score
Mean Square 3
9,721.33
Within Groups
1056091
285
3,705.58
Total
1085255
288
Between Groups
60903
3
20,301.12
Within Groups
1211837
286
4,237.19
Total
1272741
289
Between Groups
5808
3
1,936.04
Within Groups
179163
280
639.87
Total
184971
283
Between Groups Within Groups Total
Norm Referenced Test Reading Score
df
29164
9586
3
3,195.38
172023
280
614.37
181610
283
Between Groups
4163479
3
1,387,826.20
Within Groups
5267432
280
18,812.26
Total
9430911
283
Between Groups
3766339
3
1,255,446.21
Within Groups
5064305
280
18,086.80
Total
8830643
283
F
Sig.*
2.62
0.05
4.79
0.00
3.03
0.03
5.20
0.00
73.77
0.00
69.41
0.00
F
Sig.*
* The difference is significant at the .05 level. Values determined as insignificant are stricken.
Table 17. Madison County Between and Within Group Comparisons for State and National Test Scores by Year (ANOVAs)
Sum of Squares FCAT Scale Reading Score (Test 10) FCAT Scale Math Score (Test 20) National Percentile Ranks for Reading Score National Percentile Ranks for Math Score
Between Groups
Norm Referenced Test Math Score
Mean Square 3
15,732.59
Within Groups
2539175
699
3,632.58
Total
2586373
702
Between Groups
78070
3
26,023.46
Within Groups
3015860
697
4,326.91
Total
3093930
700
Between Groups
20394
3
6,797.90
Within Groups
447144
662
675.44
Total
467538
665
Between Groups Within Groups Total
Norm Referenced Test Reading Score
df
47198
Between Groups
14647
3
4,882.45
438436
661
663.29
453084
664
6750526
3
2,250,175.30
Within Groups
13023853
662
19,673.49
Total
19774379
665
Between Groups
4618223
3
1,539,407.72
Within Groups
14028436
661
21,223.05
Total
18646659
664
4.33
0.00
6.01
0.00
10.06
0.00
7.36
0.00
114.38
0.00
72.53
0.00
* The difference is significant at the .05 level. Values determined as insignificant are stricken.
18
Table 18. Jefferson County Between Grade Comparisons for State and National Test Scores by Year (Bonferroni Statistic)
Dependent Variable
(I) Category 5th Grade
6th Grade FCAT Scale Reading Score (Test10) 7th Grade
8th Grade
5th Grade
6th Grade FCAT Scale Math Score (Test20) 7th Grade
8th Grade
5th Grade
6th Grade National Percentile Ranks for Reading Score 7th Grade
8th Grade
5th Grade
6th Grade National Percentile Ranks for Math Score 7th Grade
8th Grade
(J) Category
Mean Difference (IJ) Std. Error
Sig.*
95% Confidence Interval Lower Upper Bound Bound
6th Grade
-20.90
9.46
0.17
-46.03
7th Grade
-25.87
9.95
0.06
-52.32
4.24 0.58
8th Grade
-15.97
10.87
0.86
-44.85
12.91
5th Grade
20.90
9.46
0.17
-4.24
46.03
7th Grade
-4.97
9.74
1.00
-30.84
20.89
8th Grade
4.93
10.67
1.00
-23.42
33.28
5th Grade
25.87
9.95
0.06
-0.58
52.32
6th Grade
4.97
9.74
1.00
-20.89
30.84
8th Grade
9.90
11.11
1.00
-19.62
39.42
5th Grade
15.97
10.87
0.86
-12.91
44.85
6th Grade
-4.93
10.67
1.00
-33.28
23.42
7th Grade
-9.90
11.11
1.00
-39.42
19.62
6th Grade
-6.16
10.12
1.00
-33.03
20.72
7th Grade
-29.41
10.61
0.04
-57.59
-1.24
8th Grade
-35.30
11.62
0.02
-66.18
-4.42
5th Grade
6.16
10.12
1.00
-20.72
33.03
7th Grade
-23.26
10.37
0.15
-50.81
4.30
8th Grade
-29.15
11.41
0.07
-59.46
1.17
5th Grade
29.41
10.61
0.04
1.24
57.59
6th Grade
23.26
10.37
0.15
-4.30
50.81
8th Grade
-5.89
11.85
1.00
-37.36
25.58
5th Grade
35.30
11.62
0.02
4.42
66.18
6th Grade
29.15
11.41
0.07
-1.17
59.46
7th Grade
5.89
11.85
1.00
-25.58
37.36
6th Grade
-7.86
3.92
0.28
-18.27
2.55
7th Grade
-9.30
4.09
0.14
-20.18
1.57
8th Grade
-12.74
4.75
0.05
-25.36
-0.13
5th Grade
7.86
3.92
0.28
-2.55
18.27
7th Grade
-1.45
4.01
1.00
-12.11
9.22
8th Grade
-4.88
4.68
1.00
-17.32
7.55
5th Grade
9.30
4.09
0.14
-1.57
20.18
6th Grade
1.45
4.01
1.00
-9.22
12.11
8th Grade
-3.44
4.83
1.00
-16.27
9.39
5th Grade
12.74
4.75
0.05
0.13
25.36
6th Grade
4.88
4.68
1.00
-7.55
17.32
7th Grade
3.44
4.83
1.00
-9.39
16.27
6th Grade
-8.10
3.84
0.21
-18.31
2.10
7th Grade
-9.99
4.01
0.08
-20.65
0.67
8th Grade
-17.76
4.65
0.00
-30.12
-5.40
5th Grade
8.10
3.84
0.21
-2.10
18.31
7th Grade
-1.88
3.93
1.00
-12.34
8.57
8th Grade
-9.65
4.59
0.22
-21.84
2.53
5th Grade
9.99
4.01
0.08
-0.67
20.65
6th Grade
1.88
3.93
1.00
-8.57
12.34
8th Grade
-7.77
4.73
0.61
-20.34
4.80
5th Grade
17.76
4.65
0.00
5.40
30.12
6th Grade
9.65
4.59
0.22
-2.53
21.84
7th Grade
7.77
4.73
0.61
-4.80
20.34
* The difference is significant at the .05 level. Values determined as insignificant are stricken.
19
Table 19. Madison County Between Grade Comparisons for State and National Test Scores by Year (Bonferroni Statistic)
Dependent Variable
(I) Category 5th Grade
6th Grade FCAT Scale Reading Score (Test10) 7th Grade
8th Grade
5th Grade
6th Grade FCAT Scale Math Score (Test20) 7th Grade
8th Grade
5th Grade
6th Grade National Percentile Ranks for Reading Score 7th Grade
8th Grade
5th Grade
6th Grade National Percentile Ranks for Math Score 7th Grade
8th Grade
(J) Category
Mean Difference (IJ) Std. Error
Sig.*
95% Confidence Interval Lower Upper Bound Bound
6th Grade
-9.24
5.93
0.72
-24.93
6.44
7th Grade
-17.23
6.50
0.05
-34.44
-0.02
8th Grade
-22.50
6.84
0.01
-40.59
-4.41
5th Grade
9.24
5.93
0.72
-6.44
24.93 8.63
7th Grade
-7.99
6.28
1.00
-24.60
8th Grade
-13.26
6.62
0.27
-30.78
4.27
5th Grade
17.23
6.50
0.05
0.02
34.44
6th Grade
7.99
6.28
1.00
-8.63
24.60
8th Grade
-5.27
7.14
1.00
-24.17
13.63
5th Grade
22.50
6.84
0.01
4.41
40.59
6th Grade
13.26
6.62
0.27
-4.27
30.78
7th Grade
5.27
7.14
1.00
-13.63
24.17
6th Grade
15.18
6.49
0.12
-1.99
32.36
7th Grade
2.43
7.09
1.00
-16.32
21.18
8th Grade
-15.23
7.46
0.25
-34.97
4.52
5th Grade
-15.18
6.49
0.12
-32.36
1.99
7th Grade
-12.75
6.86
0.38
-30.90
5.40
8th Grade
-30.41
7.25
0.00
-49.58
-11.24
5th Grade
-2.43
7.09
1.00
-21.18
16.32
6th Grade
12.75
6.86
0.38
-5.40
30.90
8th Grade
-17.66
7.78
0.14
-38.25
2.94
5th Grade
15.23
7.46
0.25
-4.52
34.97
6th Grade
30.41
7.25
0.00
11.24
49.58
7th Grade
17.66
7.78
0.14
-2.94
38.25
6th Grade
1.20
2.66
1.00
-5.83
8.22
7th Grade
0.24
2.85
1.00
-7.31
7.79
8th Grade
-13.39
2.98
0.00
-21.28
-5.50
5th Grade
-1.20
2.66
1.00
-8.22
5.83
7th Grade
-0.95
2.79
1.00
-8.35
6.44
8th Grade
-14.59
2.93
0.00
-22.33
-6.85
5th Grade
-0.24
2.85
1.00
-7.79
7.31
6th Grade
0.95
2.79
1.00
-6.44
8.35
8th Grade
-13.63
3.10
0.00
-21.85
-5.42
5th Grade
13.39
2.98
0.00
5.50
21.28
6th Grade
14.59
2.93
0.00
6.85
22.33
7th Grade
13.63
3.10
0.00
5.42
21.85
6th Grade
-2.81
2.64
1.00
-9.78
4.16
7th Grade
1.15
2.83
1.00
-6.34
8.64
8th Grade
-11.94
2.96
0.00
-19.77
-4.11
5th Grade
2.81
2.64
1.00
-4.16
9.78
7th Grade
3.96
2.77
0.92
-3.37
11.28
8th Grade
-9.13
2.90
0.01
-16.80
-1.46
5th Grade
-1.15
2.83
1.00
-8.64
6.34
6th Grade
-3.96
2.77
0.92
-11.28
3.37
8th Grade
-13.09
3.08
0.00
-21.23
-4.95
5th Grade
11.94
2.96
0.00
4.11
19.77
6th Grade
9.13
2.90
0.01
1.46
16.80
7th Grade
13.09
3.08
0.00
4.95
21.23
* The difference is significant at the .05 level. Values determined as insignificant are stricken.
20
Change in Academic Achievement Between Schools
Comparisons in academic achievement between Jefferson and Madison over the period from 6th to 8th grade exhibit that Jefferson outperformed Madison youth relative to reading and math grade changes, as well as individual change in FCAT Reading scores, FCAT Math scores, Norm Reference Reading Test scores, and Norm Reference Math Test scores (see Table 20 below).
Table 20. Jefferson and Madison County Group Statistics for the Average Individual Change in Scores from 6th Grade to 8th Grade
School Sample Language Arts
Reading
Math
FCAT Scale Reading Score
FCAT Scale Math Score
Norm Reference Test Reading Score
Norm Reference Test Math Score
Excused Absences
Unexcused Absences
Out of School Suspensions
Disciplinary Actions
N
Mean
Std. Deviation
Std. Error Mean
Jefferson
51
-5.7
9.9
1.4
Madison
107
1.3
8.4
0.8
Jefferson
33
3.8
8.8
1.5
Madison
79
-2.5
8.8
1.0
Jefferson
51
3.5
9.8
1.4
Madison
96
3.3
6.9
0.7
Jefferson
50
4.8
39.1
5.5
Madison
131
-2.1
39.7
3.5
Jefferson
50
36.2
33.8
4.8
Madison
131
15.6
33.6
2.9
Jefferson
42
224.3
149.9
23.1
Madison
129
192.9
163.3
14.4
Jefferson
42
242.5
146.9
22.7
Madison
129
142.8
162.5
14.3
Jefferson
50
-1.7
3.2
0.5
Madison
140
-1.9
4.5
0.4
Jefferson
50
-3.0
6.4
0.9
Madison
140
-0.4
5.9
0.5
Jefferson
50
0.2
3.2
0.5
Madison
140
-0.3
2.4
0.2
Jefferson
52
0.1
0.5
0.1
Madison
141
-0.1
0.6
0.0
21
Madison youth outperformed Jefferson youth in mean change in language arts grade between the 6th and 8th grades. It is important to note, that sample sizes for both the treatment and comparison groups decreased appreciably between the descriptive statistics presented in Tables 14 and 15, and the between-group comparisons reported here. In Tables 14 and 15, overall average scores are presented for all youth in a school by year, regardless of whether they had both a 6th grade score (baseline) and an 8th grade score (outcome). The analyses presented in Tables 20 and 21 however, require that a youth have both a baseline and outcome score in order to calculate overall change over the study period. Table 21 depicts tests of statistical significance between the mean change in academic performance measures between the treatment and control group.
Not only did Jefferson
demonstrate greater strides in performance reading grades, Norm Math Test scores, and FCAT Math scores, but these differences were statistically significant at the 0.05 level. Jefferson County students also had greater average declines in unexcused absences than Madison youth,
Table 21. Independent-Samples T-Test for Mean Differences in Scores from 6th to 8th Grade Between Jefferson and Madison Counties
95% Confidence Interval
School Variables Language Arts
t -4.59
df 156.0
Sig. (2-tailed)*
Mean Difference
Std. Error Difference
0.00
-6.93
1.51
of the Difference Lower
Upper
-9.92
-3.95 9.88
Reading
3.44
110.0
0.00
6.27
1.82
2.66
Math
0.17
145.0
0.87
0.24
1.39
-2.51
2.98
Norm Reading Test
1.10
169.0
0.27
31.42
28.44
-24.74
87.58
Norm Math Test
3.53
169.0
0.00
99.62
28.22
43.91
155.33
FCAT Reading Scores
1.05
179.0
0.29
6.19
6.57
-6.05
19.88
FCAT Math Scores
3.67
179.0
0.00
20.54
5.60
9.49
31.58
0.19
188.0
0.85
0.13
0.69
-1.24
1.50
-2.63
188.0
0.01
-2.62
1.00
-4.58
-0.66
Out of School Suspensions
1.04
188.0
0.30
0.45
0.43
-0.41
1.31
Disciplinary Actions
2.94
191.0
0.00
0.26
0.09
0.09
0.44
Excused Absences Unexcused Absences
* The difference is significant at the .05 level. Values determined as insignificant are stricken.
22
which likewise was statistically significant.
Madison students significantly outperformed
Jefferson youth only in terms of language arts grades and disciplinary actions. Conclusion The current report provides final overall baseline data and outcome measurement of the Arts in Education treatment introduced at the Howard Middle School in Jefferson County over the period from the 6th to 8th grade school years. The results presented here should be interpreted with caution given missing school performance data for youth in the 8th grade in both the treatment and comparison cohorts. In addition, given the correspondingly reduced sample sizes, sophisticated multivariate analyses were not possible. Despite these qualifiers, the treatment group did exhibit improvements in reading grades, National Percentile Ranks for Math and improvements in FCAT Reading scores between the students' 6th grade and 8th grade years. Furthermore, students attending the treatment school outperformed the comparison group students on average change for unexcused absences. The data are inconsistent in demonstrating support for the hypothesis that the Arts in Education curriculum would improve language arts, math, reading and writing skills. The data examined provide some support for the impact of the Arts in Education on math skills as measured by national standardized tests and the state FCAT assessments. Only academic grades in reading, however, support the study hypotheses. Whether this is indicative of a lack of support or instead reflects subjective problems in assessments of academic grade allocation is debatable. The overall relatively large and significant differences between the treatment and comparison groups on state and national math test scores, does suggest that perhaps the treatment had an impact on academic performance at the Jefferson County Howard Middle School.
23