Visible Learning: A Synthesis of over 800 Meta-Analyses Relating to Achievement By John Hattie Meta-analyses by rank order (as identified by the author)
Rank
Domain
purple = high green = medium yellow = low red = negative
1
Effect size 1.44
student
Self-report grades
2
1.28
student
Piagetian programs
3
.90
teaching Providing formative approaches evaluation of programs
4
.88
teacher
Micro teaching
5
.88
school
Acceleration for gifted students
6
.80
school
Classroom behavioral
7
.77
teaching Comprehensive approaches intervention for LD students
d = â&#x2030;Ľ Â .6 d = .4 d = .2 d = < .2
Influence
Additional information Students have reasonably accurate understandings of their levels of achievement, typically formed from past experiences in learning. High school students had very accurate understandings of their achievement levels across all subjects, and are very knowledgeable about their chance of success. These expectations of success may become a barrier for some students as they may only perform to whatever expectations they already have of their ability. The relationship between Piagetian stage and achievement is very high. Knowing the ways in which students think and how this thinking may be constrained by their stages of development may be most important to how teachers choose materials and tasks, how the concept of difficulty and challenge can be realized in different tasks, and the importance of developing successive and simultaneous thinking. Feedback that provides teachers with formative information on attention to the purposes of innovations, the willingness to seek evidence on where students are not doing well, the keenness to see the effects on all students, and openness to new experiences make a difference. The major issue is for teachers to pay attention to the formative effects of their teaching. Microteaching typically involves student-teachers conducting mini-lessons to a small group of students, often in a laboratory setting, and then engaging in post-discussions about the lesson. Acceleration involves progress through an educational program at rates faster or ages younger than is conventional, and may include curriculum compacting, telescoping, and advanced placement. Acceleration is successful, but one of the least used methods for gifted students. There may be a negative social impact on gifted students if they are not accelerated. See classroom management, climate, decreasing disruptive behavior, and peer influences on behavior for specifics. A combined direct instruction and strategy instruction model was an effective procedure for remediating learning disabilities. These two approaches are somewhat
Compiled by Instructional Consultants/Brenda Hatfield Sorensen
Page 1
8
.75
teacher
Teacher clarity
9
.74
teaching Reciprocal teaching approaches
10
.73
teaching Feedback approaches
11
.72
teaching Teacher-student approaches relationships
independent, so it’s important to use both to maximize the effect on achievement. Important instructional components included attention to sequencing, drill-repetition-practice, segmenting information into parts or units for later synthesis, controlling task difficulty through prompts and cues, use of technology, systematically modeling problem solving steps, and making use of small interactive groups. Teacher clarity is defined as organization, explanation, examples and guided practice, and assessment of student learning. The emphasis of reciprocal teaching is on enabling students to learn and use cognitive strategies such as summarizing, questioning, clarifying, and predicting when supported through teacher-student dialogue. The effect size is very high, and this high effect was evident regardless of who delivered the intervention. Effects were highest when there was explicit teaching of cognitive strategies before beginning reciprocal teaching dialogue, showing the importance of modeling and practice as well as giving instruction in use of the strategies close to the time students used them. Feedback is most powerful when it is from the student to the teacher. When teachers seek feedback from students as to what students know, what they understand, where they make errors, when they have misconceptions, when they are not engaged- then teaching and learning can be synchronized and powerful. The most effective feedback forms provide cues or reinforcement to the learner, are in the form of video, audio, or computer-assisted instruction feedback, or relate feedback to learning goals. The key is feedback that is received and acted upon by students. At best, each student receives moments of feedback in a single day. Programmed instruction, praise, punishment, and extrinsic awards were the least effective forms of feedback for enhancing achievement. Providing feedback is not about giving rewards, but rather providing information about the task. Feedback is more effective when it provides information on correct rather than incorrect responses. Impact is highest when goals are specific and challenging but when task complexity is low. The art is to provide the right form of feedback at, or just above, the level where the student is learning. Feedback at the self or personal level, such as praise, is rarely effective. When feedback is combined with effective instruction in classrooms, it can be very powerful in enhancing learning. In classes with more person-centered teachers, there is more engagement, more respect of self and others, fewer resistant behaviors, greater non-directivity (student initiated and student regulated activities), and higher achievement outcomes. From high to low in effect size, 9 teacher-student relationship variables are non-directivity, empathy, warmth, encouragement of higher order thinking, encouraging
Compiled by Instructional Consultants/Brenda Hatfield Sorensen
Page 2
12
.71
teaching Spaced vs. mass approaches practice
13
.69
teaching Meta-cognitive approaches strategies
14 15
.67 .67
student curricula
Prior achievement Vocabulary programs
16
.67
curricula
Repeated reading programs
17
.65
curricula
Creativity programs
18
.64
teaching Self-verbalization/ approaches Self-questioning
learning, adapting to differences, genuineness, and learnercentered beliefs. It is the frequency of different opportunities, rather than merely spending more time on task that makes the difference in learning. This is not drill and practice, but rather deliberative practice involving specific skills, complex performance, and attainment of success criteria. Students often need 3-4 exposures to the learning- usually over several days- before there is reasonable probability they will learn. Students in spaced practice perform higher than in mass practice. The effectiveness of the length of pacing is related to the challenge/complexity of the task: stronger effects were found for simple tasks with brief rest periods, and longer rest periods (at least 24 hours) for more complex tasks. Meta-cognitive activities can include planning how to approach a given learning task, evaluating progress, and monitoring comprehension. Programs are effective when implemented using small group instruction, with students in higher grades, with remedial students, and in less intensive programs. The most effective meta-cognitive strategies were awareness of text inconsistency and use of self-questioning. Students who experienced vocabulary instruction had major improvements in reading comprehension of passages containing taught words. The most effective teaching methods include providing definitional and contextual information, involving students in deeper processing, and giving students more than one or two exposures to the words. Repeated reading consists of re-reading a short and meaningful passage until a satisfactory level of fluency is reached. The skills of automaticity in word recognition and decoding generally develop in grades 2 and 3. These skills need to be specifically assessed and taught, especially to learning disabled students. Repeated reading has marked positive effects on reading comprehension as well as fluency. An emphasis on instructional strategies and direct instruction makes a major difference in the effectiveness of creativity programs. Creativity programs with a high level of structuring, questioning, and responding to student questioning had high constant effects across all subject areas. Creativity programs that include explicit instruction were most successful, as were those based on developing thinking strategies. Of the cognitive mediation strategies taught to students, selfverbalization was among the most effective and worked better for task oriented skills such as writing or mathematics. The effects of student self-questioning are higher with low ability students, because high-ability students are generally
Compiled by Instructional Consultants/Brenda Hatfield Sorensen
Page 3
19
.62
teacher
Professional development
20
.61
teaching Problem-solving approaches teaching
21
.61
teacher
Not labeling students
22
.60
curricula
Phonics instruction
23
.60
teaching Teaching strategies approaches
24
.59
teaching strategies
Cooperative vs. individualistic learning
25
.59
teaching strategies
Study skills
using a variety of self-regulation strategies already. The effects are higher for pre- and post-lesson questioning, compared to questioning interspersed during the lesson; when questionings were delayed rather than immediate; and where there was teacher modeling compared to none. Four types of instruction found to be most effective on teacher knowledge and behavior are: observation of actual classroom methods, microteaching, video/audio feedback, and practice. Lowest effects are from discussion, lectures, games/simulations, and guided field trips, as were coaching, modeling, and production of printed or instructional materials. Significant direct links were found between problem solving and various measures of basic performance, in particular basic skills in mathematics. For surface knowledge, problembased learning can have limited and even negative effects. For deeper learning, when students already have the surface level knowledge, problem-based learning can have positive effects. Application of knowledge, not development of knowledge, is the heart of the success of problem-based learning. Labels often help “classify” students and can lead to extra funding, but rarely does it make a difference as to what works best. Though the findings of the NRP on phonemic awareness have been hotly contested, other studies have confirmed their conclusions. Phonological awareness training should be seen as a causal factor in learning to read. Also, phonological training in groups is more effective, and training that combines phonological and letter training combined is more effective. Phonics with additional language and literacy activities were the most effective. For students with learning disabilities, there are higher effect sizes for models of instruction that include direct and strategy instruction, with the most successful being sequencing, drill repetition, and strategy cues. Marzano found that when the instructional technique was designed for the student, the effect was higher than when the technique was designed for the teacher. Both cooperative and competitive learning are more effective than individualistic methods- pointing to the power of peers in the learning equation. Under cooperative conditions interpersonal relations have the strongest effect on achievement, clearly pointing to the value of friendship in the achievement equation. Courses in study skills alone can have an effect on surface level information, but it is necessary to combine study skills with the content to have an effect on the deeper levels of understanding. The highest ranked study skill is organizing and transforming (rearranging of instructional materials to
Compiled by Instructional Consultants/Brenda Hatfield Sorensen
Page 4
26
.59
teaching strategies
Direct instruction
27
.58
curricula
Tactile stimulation programs
28
.58
curricula
Comprehension programs
29
.58
teaching strategies
Mastery learning
30
.57
teaching strategies
Worked examples
31 32 33
.57 .57 .57
home home teaching strategies
Home environment Socioeconomic status Concept mapping
improve learning, such as making an outline). Teaching note taking has higher effects when students are given instructor’s notes to work from, as the reviewing of notes is more effective than the taking of notes. In a nutshell, the teacher decides the learning intentions and success criteria, demonstrates them by modeling, evaluates if students understood what they have been told by checking for understanding, and re-telling them what they have told by tying it all together with closure. The effects of direct instruction are similar for regular and special ed/lower ability students, higher for reading than mathematics, similar for low level word attack and also for high level comprehension, and similar for elementary and high school students. The messages of the meta-analyses underline the power of stating the learning intentions and success criteria, then engaging students in moving toward these. The evidence of the effectiveness of tactile stimulation used with infants and young children as a form of early intervention to stimulate the senses points to its effectiveness. Reading comprehension programs have a greater effect on vocabulary than on reading comprehension outcomes. A higher effect results from programs that focus on processing strategies such as inferential reasoning, rules for summarizing, and chunking texts. Guthrie’s concept-oriented reading program intervention has had positive effects on multiple text comprehension, fluency, story comprehension, and motivation. Features of mastery learning include providing students with a clear explanation of what is to be mastered, high levels of cooperation among classmates, high levels of frequent and specific teacher feedback, use of diagnostic formative tests, and regular corrections of mistakes. The notion is that learning should be held constant and time should be allowed to vary. It is the most successful of several innovative systems, with highest effects at the elementary level, followed by high school and college. Worked examples typically consist of a problem statement and the appropriate steps to the solution. Instruction using worked examples generally helps to reduce cognitive load.
Concept mapping involves developing graphical representations of the conceptual structure of content to be learned. The importance of it relates to its emphasis on summarizing the main ideas in what is to be learned. It can assist in synthesizing and identifying major ideas, themes, and interrelationships- particularly for learners who do not have organizing and synthesizing skills. Effects were greater when done after initial exposure to the material to be mapped, and
Compiled by Instructional Consultants/Brenda Hatfield Sorensen
Page 5
34
.56
teaching strategies
Goals
35
.55
curricula
Visual-perception programs
36
.55
teaching strategies
Peer tutoring
37
.54
teaching strategies
Cooperative vs. competitive learning
38
.54
student
Pre-term birth weight
39
.53
school
Climate of the classroom: Classroom cohesion
40
.53
teaching strategies
Keller’s Personalized System of Instruction
when the emphasis was on understanding central rather than detailed ideas of the topic to be mapped. Goals are critical for enhancing performance. Achievement is enhanced to the effect that students and teachers set challenging, rather than “do your best” goals. More difficult goals are more effective in that they lead to a clearer notion of success and direct students’ attention to relevant behaviors or outcomes. Any school with a “do your best” goal should change it to “face your challenges” or “strive to the highest.” Effective teachers set appropriately challenging goals and then structure situations so students can reach them. Encouraging students to share commitment to the goals and providing feedback on how successful learning has been increases the likelihood of attainment. Challenging goals are also effective with special ed students. Visual perception refers to the process of organizing and interpreting letters on the page. Both auditory and visual perception were important predictors of reading for both average students and students with disabilities. The overall effect of the use of peers as co-teachers is quite powerful. It is an excellent method to teach students to become their own teachers. Peer tutoring has many academic and social benefits for both those tutoring and those being tutored. If the peer intervention is more student controlled, such as peers being involved in setting goals, monitoring performance, evaluating performance, and selecting rewards, the effects are greater than when the teacher controls the situation. When students become teachers of others, they learn as much as those they are teaching. Both cooperative and competitive learning are more effective than individualistic. For rote decoding and correcting tasks, cooperation does not seem to be superior. Cooperative learning is more effective in reading than in mathematics. The positive effects of cooperative learning increased as students moved through elementary to junior high and high school, particularly when there was individual accountability and group rewards. A key factor in positive classroom climate is classroom cohesion- the sense that all are working towards positive learning gains. Common attributes that optimize student learning include goal directedness, positive interpersonal relations, and social support. In situations with greater cohesiveness, it is more likely there are co-peer learning, tolerance and welcoming of error, increased feedback, and more discussions of goals, success criteria, and positive relationships. Students using PSI had higher grades and higher satisfaction rates than students in conventional classes. Key features of
Compiled by Instructional Consultants/Brenda Hatfield Sorensen
Page 6
41
.53
school
Peer influences
42
.52
school
Classroom management
43
.52
curricula
Outdoor/adventure programs
44
.52
teaching strategies
Interactive video methods
45 46
.51 .50
home curricula
Parental involvement Play programs
47
.50
curricula
Second/third chance programs
48
.49
school
Small group learning
the program include students proceed through the course at their own pace, students demonstrate mastery of each component before proceeding to the next, materials and communication are largely text based, and teachers primarily provide tutorial support and student motivation. Low classroom peer acceptance can be consistently linked with student disengagement. Friendships can play an important part in the classroom environment, as they often involve higher levels of caring, support, and help, can ease conflict resolution, and thus lead to more learning opportunities and enhanced academic achievement, particularly from early adolescence on. The attributes of teachers that had the greatest influence on ensuring well-managed classrooms and reducing disruption came from having an appropriate mental set or “with-it-ness” by the teacher; the teacher had the ability to identify and quickly act on potential behavioral problems and retain emotional objectivity. The most successful programs were Outward Bound or Adventure programs. Those run by teachers were least successful, and those that were more cognitively based than emotionally or affective based were more successful. Major reason for a program’s success include the way activities are structured to emphasize very challenging learning intentions, clear success criteria, optimized peer support, and feedback that is actively sought by participants. Cognitive achievement from interactive video instruction is influenced by a wide range of variables such as the nature of instructional content, environmental factors, instructional methods, and the learning materials. Hypermedia (multiple representations of information and interactivities between users and this information) has positive effects over traditional instruction, with effects greater in regular classrooms, in elementary school, and when used to supplement rather than substitute regular instruction. For younger children, play makes a difference. It promotes improved performance outcomes in cognitive-linguistic and affective-social domains. Socio-dramatic play had the most striking effect and the smallest effect was with imaginative play. Well-designed, reliably implemented, one-to-one interventions (e.g., Reading Recovery) can make a significant contribution to improved reading outcomes for many students whose poor reading skills place them at risk of academic failure. Small group learning typically involves assigning a task to a small group and then expecting them to complete the task. Small group learning has significantly more positive effects than individual learning with computer technology on student
Compiled by Instructional Consultants/Brenda Hatfield Sorensen
Page 7
achievement, group task performance, and several process and affective outcomes. The effects of small group learning were significantly enhanced when students had group work experience or instruction, where specific learning strategies were employed, and when group size was small. Simply placing students in small or more homogeneous groups is not enough. For grouping to be maximally effective, materials and teaching must be varied and maximally effective materials and teaching must be varied and made appropriately challenging to accommodate student needs. 49
.48
student
Concentration/ Persistence/ Engagement School effects
50
.48
school
51 52 53
.48 .47 .46
student student teaching practices
Motivation Early intervention Questioning
54
.45
curricula
Mathematics
55 56
.45 .44
student teacher
Preschool programs Quality of teaching
Classrooms are far more important than schools in determining how children perform at school. Effective schools are only as effective to the extent they have effective teachers. Many of the influences that really make a difference to student learning in developed nations are within schools, from the influence of specific teachers, specific curriculum, and strategies teachers use to teach.
The overall effects of questioning vary, depending on the type of question. Higher cognitive questioning strategies have a small positive effect on learning measures. Factual prequestions can facilitate learning if they are directly related to the materials to be learned. Teacher training in questioning matters, especially when attention is paid to teachers monitoring their own actions. Of more importance than teacher questioning is analyzing the questions students ask. Highest effects accrued when teachers provided feedback data or recommendations to students, peer-assisted learning, explicit teacher-led instruction, direct instruction, and concrete feedback to parents. Providing teachers and students with specific information on how each student was performing seemed to consistently enhance mathematics achievement. Overall, the use of manipulative materials does not detract from, but does little to support the learning of mathematics. The highest correlations involved items relating to: 1. Teachers challenging students, encouraging them to think through and solve problems, either by themselves or together as a group. 2. High expectations. 3. Monitoring and evaluation, getting students to think about the nature and quality of their work; encouraging them to test mathematical ideas and discover mathematical principals. 4. Teaching the language, love, and details of mathematics. Having poor teachers can be devastating. The residual effects of relatively ineffectual teachers from prior years can be
Compiled by Instructional Consultants/Brenda Hatfield Sorensen
Page 8
57
.44
curricula
Writing programs
58
.43
teacher
Expectations
59
.43
school
School size
60 61
.43 .41
student teaching practices
Self-concept Behavioral objectives/ advance organizers
62
.41
teaching practices
Matching style of learning
63
.41
teaching practices
Cooperative learning
64
.40
curricula
Science
measured in subsequent student achievement scores. The effect of poor teaching quality tends to persist for years after a student has had such a teacher. It is powerful to teach strategies for planning, revising, and editing compositions, particularly with struggling writers. There is power in teaching students the processes and strategies involved in writing, structuring teaching of writing by having students work together in an organized fashion, and setting of clear and specific goals as to the purpose of each piece of writing. Workshop instructional treatments have a greater effect size than computer support or teaching of inquiry skills. Teachers must stop overemphasizing ability, and start emphasizing progress, seek evidence to surprise themselves regarding student performance, find ways to raise the achievement of all, and be evidence informed about the talents and growth of all students, by welcoming diversity and being accountable for all. Some research indicates optimal size of a high school to be about 800. The curriculum advantages of larger schools start to reduce in their effectiveness as they grow much beyond 800. Achievement gains in mathematics and reading over the course of high school were largest in middle-sized high schools (600-800). Teachers and students at smaller schools are more likely to have positive perceptions of their school environment. Using advance organizers to introduce new materials, by providing a bridge from previous knowledge, did facilitate long-term learning, but effects were lower for written advance organizers compared to non-written ones, and had no effect with low-ability or low-knowledge learners. Authors noted it was hard to discern the meaning of some of the meta-analyses related to this topic. One conclusion was that learning style is somewhat important. One possible explanation is that when students enjoy learning, then achievement is higher. Cooperative learning is effective, especially when contrasted with competitive and individualistic learning. Cooperation was superior to competition in promoting achievement across all subjects, for all age groups, and for tasks involving concept attainment, verbal problem solving, categorizing, spatial problem solving, retention, memory, motor performance, and guessing-judging-predicting. It is more effective in reading than in math. The effects increased as students moved through elementary through high school. Under cooperative conditions, interpersonal relations have the strongest influence on achievement, and this clearly points to the value of friendship in the achievement equation. Meta-analyses in science investigated skills based programs
Compiled by Instructional Consultants/Brenda Hatfield Sorensen
Page 9
65
.40
curricula
Social skills programs
66 67
.40 .39
student curricula
Reducing anxiety Integrated curriculum programs
68
.39
school
Enrichment for gifted students
69
.38
curricula
Career education interventions
70
.38
teaching practices
Time on task
71
.37
teaching practices
Computer assisted instruction
72
.37
teaching practices
Adjunct aids
73
.37
curricula
Bilingual programs
vs. traditional programs. Skills based programs emphasize analytic and process skills, integrated lab activities, higher cognitive skills, and science appreciation. Traditional curricula emphasize knowledge of facts, laws, theories, and applications. Students in skills based programs generally outperformed those in traditional ones on attitudes, process skills, analytic skills, and achievement. The effects of social skills programs are stronger on enhancing peer relations and social outcomes; lower when students are initially identified as social problems; and lowest when academic achievement is the outcome. The most important elements in integrated programs were thematic instruction and an emphasis on process skills. They were more successful in elementary and middle school than in secondary; for lower achieving and ethnically diverse students; and when more experienced teachers implemented the program. Enrichment has less effect than acceleration. Programs in which students mastered more mature ideas had higher effects than those with a broader investigation of the regular curriculum. Career counseling has generally positive effects, with class interventions the most effective, but also requiring the most hours. Time on learning can involve longer school days or years, procedural time, time off or on task, and so on. At best, half of student time in class involves engagement in the class activity, largely because so much time is spent listening to teachers talking. Engagement is highest when students are working in groups or laboratories. Also, time spent on practice needs to be deliberate, with a focus on effort to improve performance, requiring students to stretch themselves to higher levels of performance, and requiring concentration and effort over extended periods. Computers are used effectively when there is a diversity of teaching strategies; when there is pre-training in the use of computers as a teaching/learning tool; when there are multiple opportunities for learning; when the student is in control of learning, when peer learning is optimized; and when feedback is optimized. Adjunct aids such as animation and illustrations can assist learning when they function to attract and direct attention, when they highlight main ideas and comprehension, and when the text assists readers to see details in the pictures. Bilingual programs are programs where two languages are used as a medium for instruction. A meta-analysis of a Santa Fe Bilingual Education program found the initial impact was greater in the early grades, and had a significant effect on mathematics achievement, while reading gains were small.
Compiled by Instructional Consultants/Brenda Hatfield Sorensen
Page 10
74
.36
school
Principals/school leaders
75
.36
student
76
.36
curricula
Attitude to mathematics/science Exposure to reading
77
.35
curricula
Drama/arts programs
78 79
.35 .34
student teaching practices
Creativity Frequent testing/ effects of testing
80
.34
school
Decreasing disruptive behavior
81 82
.33 .33
student teaching practices
Drugs Simulations
83
.33
teaching practices
Inductive teaching
Two major forms of leadership include instructional and transformational leadership. Evidence supports the power of the former over the latter in terms of student outcomes. School leaders who promote challenging goals, and then establish safe environments for teachers to critique, question, and support other teachers to reach these goals together that have most effect on student outcomes. Leaders who focus on student achievement and instructional strategies are the most effective. Leaders who place more attention on teaching and focused achievement domains have higher effects.
Parent-preschooler joint book reading experiences were shown to be related to positive outcomes in language growth, emergent literacy, and reading achievement. Reading to children, however, is not sufficient to lead to competent readers- instruction is also needed. Creative drama activities have positive effects on children’s achievement at elementary grade levels in oral language skills, self-esteem, moral reasoning, role-taking abilities, and drama skills. Repeated testing is only effective if there is feedback from the tests to teachers such that they modify their instruction to attend to the strengths and gaps of student performance. Although performance is increased with more frequent testing, the amount of improvement in achievement diminishes as the number of tests increase. Teachers need skills to ensure no student unnecessarily disrupts their own or the learning of any other students in class. Targeting classroom disruptions via a behavioral approach is the most efficacious. The most successful programs included social or token reinforcement, cooperation, behavioral consultation, and cognitive behavior modification; the least successful involved social skills training. Simulations and gaming had a small positive effect over alternative instructional techniques, although somewhat larger effects when compared with lecture only. Simulations are more effective with lower rather than high ability students. Simulation and gaming had higher effect sizes in achievement when used with students in higher grade levels. Induction is usually described as moving from the specific to the general. In science teaching, results indicated it makes no difference if educational experiences are provided to students prior to formalizing generalizations, or if generalizations are formulated prior to any illustrative examples.
Compiled by Instructional Consultants/Brenda Hatfield Sorensen
Page 11
84
.32
student
Positive view of own ethnicity Teacher effects Inquiry based teaching
85 86
.32 .31
teacher teaching practices
87
.30
school
Ability grouping for gifted students
88
.29
teaching practices
Homework
89 90 91
.29 .28 .28
home student school
Home visits Exercise/relaxation Desegregation
92
.28
school
Mainstreaming
93
.27
curricula
Use of calculators
94
.24
curricula
Values/moral education programs
See individual teacher items for more description. Effect sizes of inquiry teaching are greater on process than on content, and higher for biology and physics than for chemistry. Effects were greatest at elementary level and decreased as students progressed through their school years. Results indicate inquiry based instruction can foster critical thinking which was transferable, improved achievement, and improved attitude towards the subject. Gifted students, when placed in special, homogeneous classes with challenging curricula, achieved more than gifted counterparts in regular classes. The positive effects of homework are higher in secondary than junior high and higher in junior high than in elementary. The positive effects of homework were negatively related to the duration of the homework. Shorter is better, but for elementary students, the correlation is near zero between time spent on homework and achievement. Effects were higher when the material was not complex or if it was novel. Homework involving higher level conceptual thinking and project based was the least effective. Effects are greater for higher than for lower ability students and for older rather than younger students.
Some studies found students in desegregated schools performed at higher achievement levels than students in control groups. Others found virtually no effect from desegregation on the achievement of African American students in reading and mathematics. Mainstreaming is the concept that students with disabilities should be integrated with their non-disabled peers to the maximum extent possible, and certainly placed in the least restrictive environment. It is often argued more on equity and social justice reasons than in terms of optimal effects on learning. There are small but positive advantages for mainstream over special classes, for achievement, and for social/personality outcomes. The calculator is neither a help nor a hindrance to students’ overall mathematics achievement, and at minimum their use helps reduce cognitive load and enhance students’ attitudes towards the study of mathematics. Across all grades and ability levels, students using calculators led to greater effects in students’ basic skills in operations and particularly in problem solving. The effects of social skills programs are stronger on enhancing peer relations and social outcomes; lower when students are identified as social problems; and lowest when academic achievement is the outcome of the social skills
Compiled by Instructional Consultants/Brenda Hatfield Sorensen
Page 12
95
.24
teaching practices
Programmed instruction
96
.24
teaching practices
Special college programs
97
.24
teaching practices
Competitive vs. individualistic learning
98
.23
school
Summer school
99
.23
school
Finances
100
.23
teaching practices
Individualized instruction
101
.23
school
Religious schools
102 103
.23 .22
student teaching practices
Lack of illness Teaching test taking
104
.22
teaching practices
Visual/audio-visual methods
105
.22
teaching practices
Comprehensive teaching reforms
programs. Most programs resulted in short term gains, indicating a need to provide social skills training on a regular and sustained basis. There are very low effects from programmed instruction. When compared to other teaching methods, programmed instruction often comes near the bottom. Remediation programs for college students had higher effects for new programs and weaker effects in institutionalized programs. Thus, colleges seem more proficient at setting up programs for high-risk students than they were at keeping these programs going. Competitiveness can be toward beating a standard- either a personal best standard or a standard of the curriculum. Cooperative learning has higher effects than competitive, and both are superior to individualistic learning. Going to summer school does not make much of a difference, but it is difficult to ignore the small gains if they are critical to students who may be already marginal. In studies, higher achievers gained more than lower achievers, and middle and higher SES students gained more than lower SES students. One claim is that there is no consistent statistical relation between educational expenditure and measures of student performance. The emphasis of research may need to be not on the notion of “Does money make a difference?” but on “How does money make a difference, particularly beyond the fixed costs of running a school?” An individualized teaching system had only a small effect on student achievement in high school courses. There was limited contribution to student self-esteem, critical thinking ability, or attitude toward subject matter taught when using individualized programs. The dividend of attending religious schools is supposedly greater for those from lower socioeconomic background, and effects are slightly stronger for high schools and middle schools. Coaching is instruction given or practice undertaken in preparation for taking a test. While coaching did raise SAT scores, the length of the training seems important. Programs continuing for 5 weeks or more produced better effects than shorter ones, the effects were higher with students in upper rather than lower grades, and higher for students from lower socioeconomic backgrounds. Very small effects resulted from use of television, film, slides, and tapes. Providing audio tapes of lessons had a small overall effect on student achievement in college courses. Comprehensive teaching reform programs, such as Success for All, Core Knowledge, and Accelerated Schools, are often “imposed” on schools in an effort to reduce the achievement gap. Their low effects provide little confidence these
Compiled by Instructional Consultants/Brenda Hatfield Sorensen
Page 13
106
.21
school
Class size
107
.20
school
Charter schools
108
.19
teaching practices
Aptitude/treatment interactions
109 110
.19 .19
student teaching practices
Personality Learning hierarchies
111
.19
teaching
112
.18
teaching practices
Co-teaching/ team teaching Web-based learning
113 114
.17 .17
home curricula
Family structure Extra-curricular programs
115
.16
teaching practices
Teacher immediacy
116
.16
school
Within class grouping
117
.16
teaching practices
Home-school programs
programs alone will reduce the achievement gap between atrisk students and their more advantaged peers. It appears the effects of reducing class size may be higher on teacher and student work-related conditions, which then may or may not translate into effects on student learning. Merely reducing the number of students in front of teachers appears to change little- in teaching and in outcomes. It is striking how little we currently know about the effect of charter schools on student achievement. There is close to zero effect when comparing achievement in charter and regular schools. This refers to instruction being altered for different types of students. Researchers noted existing studies cannot be used with any confidence to construct general principles of instructional design. A different form of learning intention is to structure learning in some form of hierarchy, such that it is more effective to acquire first a set of skills that will support later learning. Overall effects are very low, but it is more effective in promoting learning at the elementary level than at high school. Little research is available on the effects of team teaching. Use of the world wide web is a fairly recent phenomenon in our classrooms, so little research is available to analyze its merits at this time. If we wish students to enhance achievement, extra-curricular activities relating to academic types of skills is optimal, and sport has the least effect on most outcomes. The greatest effects on achievement came from participation in schoolbased extracurricular activities, then pro-social activities such as scouting, with performing arts having the least effect on all outcomes. The immediacy and closeness of responses to students shows them that teachers are listening and responding. The effects of teacher immediacy were much stronger on affective learning such as attitudes toward the teacher or course, or engaging in the learning experience, than on achievement. There are two major forms of in class grouping: ability/achievement grouping and small group learning which is more spontaneous and usually for specific tasks over a shorter time period. The mean effects size of within class grouping is low overall, but slightly more advantageous for high ability students and less for low ability students. In classes with over 35 students, the mean effect of grouping is .35. Use of technology to develop home-school connections in student learning has limited effects on reading, slightly higher
Compiled by Instructional Consultants/Brenda Hatfield Sorensen
Page 14
118
.15
teaching practices
Problem-based learning
119
.15
curricula
Sentence combining programs
120
.15
teaching practices
Mentoring
121
.12
school
Ability grouping
122 123 124
.12 .12 .11
student student teacher
Gender Diet Teacher training
125
.09
teacher
Teacher subject matter knowledge
126
.09
Distance education
127
.09
teaching practices school
128
.08
curricula
Perceptual-motor programs
129
.06
curricula
Whole language
130
.05
school
College halls of residence
131
.04
school
Multi-grade classes
Out of school curriculum experiences
for mathematics, and is highest for writing. With this topic, it is important to separate the effects on surface and deep knowledge and understanding. For surface knowledge, problem-based learning can have limited and even negative effects; for deeper learning, when students have the surface level knowledge, it can have positive effects. Sentence combining is an instructional activity that requires students to combine sentences to create compound, complex, or compound-complex sentence. The effects are small, but more effective at the elementary than high school levels. Mentoring usually involves older persons providing academic or social assistance to younger people. It has close to zero effect on performance outcomes, but does have higher effects on attitudes, motivation, and involvement. Results show that tracking had minimal effects on learning outcomes and profound negative equity effects. Many low track classes are deadening, non-educational environments. Low track classes are more fragmented, less engaging, and taught by fewer well-trained teachers.
The effect size of teacher education on subsequent student outcomes is negligible, although the effect on specific skills is quite high. There is not a large corpus of evidence to defend the thought that teaching begins with a teacher’s understanding of what is to be learned and how it is to be taught. Results indicate similar effects between distance programs and traditional face-to-face classroom programs. The more successful out of school programs were shorter rather than longer, involved one-on-one tutoring, and were for students from lower elementary and high school. The overall effects are negligible compared to what effective teachers can attain in regular classrooms using many other methods of instruction. Perceptual motor training is an intervention more often used with learning-difficulty students. Overall, they are not effective in improving academic or cognitive learning and there were no major improvements associated with perceptual/sensory outcomes. Whole language programs have negligible effects on learning to read. Low socioeconomic status children receiving basal readers did consistently better than their counterparts receiving whole language instruction. It did not matter whether a student lived in a college, at home, in a fraternity or sorority house, or in off-campus housing. Overall, the effects from multi-grade classes compared to single-age classes are not compelling enough to argue for the
Compiled by Instructional Consultants/Brenda Hatfield Sorensen
Page 15
132
.04
teaching practices
Student control over learning
133
.01
school
Open vs. traditional
134
-.09
School
Summer vacation
135 136
-.12 -.16
home school
Welfare policies Retention
137 138
-.18 -.34
home school
Television Mobility
effectiveness of one over the other. It is likely teachers teach in a similar way regardless of the distribution of age range in the class. The effect of student choice and control over learning is somewhat higher on motivation outcomes than on subsequent student learning. Too often, classroom architecture may be open, but that is no guarantee that the principles of open teaching are present. Students performed slightly better on achievement tests in traditional compared to open teaching, but did worse on tests of creativity and had slightly less positive attitudes and self-concepts. Students lost some achievement gains over the summer, and negative effects were slightly larger in mathematics than in reading and language. Retention has a negative effect on academic achievement in language arts, reading, mathematics, work-study skills, social studies, social studies, and GPA. There are also negative equity effects- it is four times more likely students of color will be retained. Also, the threat of non-promotion is not a motivating force for students; retention does not generally improve achievement or adjustment for developmentally immature students, and increases the risk of dropping out of school twofold. The effect of student mobility between schools is quite marked. The effects on reading and mathematics are negative. The most important reason for these declines relates to peer effects. Whenever there is a major transition in schools, the key success factor is whether a child makes a friend in the first month. It is incumbent for schools to attend to student friendships and ensure the class makes newcomers welcomed.
Compiled by Instructional Consultants/Brenda Hatfield Sorensen
Page 16