The survey asked teachers about student behavior, their own training in CHARACTER COUNTS! and their frequency of program use. It found that teachers believed student behavior had improved in every area except adherence to school rules among grades 7-12. In addition, instructors who used it more often reported better results. The effect of teachers' training on their assessments was ambivalent.
Student Behavior
The questions on student behavior began with the phrase, “Compared to before we started using Character Counts!, my students ...” They therefore assess student change over the entire course of the program. For every statement, teacher agreement suggested that CHARACTER COUNTS! had improved behavior in the area.
1. Students’ behavior toward each other.
Teachers of grades 1-6 felt students:
Agree Unsure Disagree
Fight less often
1998 28% 50% 15%
1999 36% 40% 19%
2000 41% 48% 11%
Help each other more often
1998 57% 28% 8%
1999 58% 23% 8%
2000 63% 29% 8%
(Note that most of the improvement here occurred in the first year.)
Call each other names less
1998 37% 38% 17%
1999 43% 33% 18%
2000 50% 39% 11%
Teachers of grades 7-12 felt that students:
Agree Unsure Disagree
Fight less often
1998 18% 60% 16%
1999 13% 74% 13%
2000 30% 63% 7%
Treat each other better
1998 40% 34% 22%
1999 39% 48% 13%
2000 52% 41% 7%
Help each other more often
1998 34% 46% 14%
1999 38% 57% 5%
2000 51% 44% 5%
The latter three questions show the value of a multi-year program, and a multi-year study. Grades 7-12 showed little or no improvement from the first year to the second, but marked gains from the first to the third.
2. Students’ behavior toward authority.
Teachers of grades 1-6 felt students:
Agree Unsure Disagree
Are less disruptive in class
1998 31.5% 40% 21%
1999 40% 35% 21%
2000 37% 45% 18%
Are less destructive of property
1998 32% 46.5% 12.5%
1999 40% 45% 11%
2000 54% 39% 7%
Treat me with more respect
1998 41% 38% 13%
1999 46% 33% 17%
2000 51% 38% 11%
Teachers of grades 7-12 felt students:
Agree Unsure Disagree
Are less disruptive in class
1998 26% 44% 24%
1999 40% 35% 21%
2000 37% 45% 18%
Have more respect for property
1998 28% 45% 23%
1999 27% 52% 22%
2000 35% 53% 12%
Treat me with more respect
1998 28% 46% 20%
1999 37% 48% 15%
2000 44% 45% 11%
3. Students’ adherence to school rules.
Teachers of grades 1-6 felt students:
Agree Unsure Disagree
Play by the rules more often
1998 43% 37% 12%
1999 46% 36% 12%
2000 56% 35% 9%
Have better recess behavior
1998 37% 36% 17%
1999 39% 30% 26%
2000 44% 45% 11%
Have better lunch manners
1998 13% 65% 14%
1999 22% 60% 17%
2000 26% 61% 13%
Get homework done more often
1998 15% 50% 22%
1999 24% 53% 19%
2000 28% 58% 14%
Cheat less
1998 26% 53% 11%
1999 29% 54% 15%
2000 35% 56% 9%
For 1998, the statements received mixed support, and “disagrees” outnumbered “agrees” in the third and fourth questions, “have better lunch manners” and “get homework done more often.” But time wrought improvements. By 1999 the “agrees” exceeded "disagrees" in every category, and by 2000 they had grown further. In that year, in the third and fourth questions, the “agrees” were twice the “disagrees.”
Teachers of grades 7-12 felt students:
Agree Unsure Disagree
Are less likely to get detention
1998 12% 60% 23%
1999 18% 67% 15%
2000 23% 66% 11%
Get their homework done more often
1998 14% 50% 31%
1999 13% 61% 27%
2000 14% 64% 22%
Skip classes less often
1998 18% 57% 22%
1999 17% 65% 18%
2000 19% 69% 12%
Are late for classes less often
1998 24% 48% 27%
1999 20% 57% 24%
2000 22% 60% 18%
Are less likely to cheat
1998 14% 53% 32%
1999 10% 61% 29%
2000 15% 66% 19%
In 1998, teachers felt CHARACTER COUNTS! had little effect on adherence to school rules among grade 7-12 students. In every case, the “disagrees” outnumbered the “agrees.” But by 2000, “agrees” outnumbered “disagrees” in response to the first, third, and fourth questions. And with the fifth, the gap had narrowed from 14-32 to 15-19. Only the second remained highly weighted to "disagree." Throughout, however, the improvement almost always comes through a decline in “disagrees” and a corresponding rise in “not sure” — and not from an increase in “agrees.” The exception is the first, “less likely to get detention,” where the “agrees” jump from 12 to 23 percent.
Impact of Frequency of Exposure
For the figures below, “times” are times per month. Significance levels apply only to the 2000 figures.
Among teachers of grades 7-12, the match-ups were:
Agree Unsure Disagree
Treat each other better
1998
0-1 time 19% 48% 31%
2-4 times 45% 32% 23%
5+ times 56% 31% 13%
2000
0-1 time 40% 46% 14%
2-4 times 67% 33% 0%
5+ times 60% 40% 0%
Significance: 0.009
Less likely to skip class
1998
0-1 time 4% 57% 39%
2-4 times 15% 65% 20%
5+ times 31% 44% 25%
2000
0-1 time 15% 65% 21%
2-4 times 22% 66% 12%
5+ times 33% 67% 0%
Significance: 0.06
Get their work done more
1998
0-1 time 5% 61% 34%
2-4 times 15% 52% 33%
5+ times 38% 37% 25%
2000
0-1 time 9% 54% 37%
2-4 times 15% 65% 20%
5+ times 24% 66% 10%
Significance: 0.14
Less likely to get suspended
1998
0-1 time 4% 52% 44%
2-4 times 11% 67% 22%
5+ times 25% 62% 13%
2000
no reported data
Treat me with more respect
1998
0-1 time 5% 65% 30%
2-4 times 33% 45% 22%
5+ times 44% 44% 12%
2000
no reported data
Fight less
1998
0-1 time 4% 70% 25%
2-4 times 41% 42% 17%
5+ times 63% 31% 6%
2000
0-1 time 28% 58% 14%
2-4 times 33% 62% 5%
5+ times 33% 63% 3%
Significance: 0.06
Overall, the greater exposure to CHARACTER COUNTS!, the better teachers felt students did. Researchers offered two possible explanations for the finding. Either teachers who used the program more often were more disposed to report that it was working, or greater use of the program actually did work.
Among teachers of grades 1-6, the match-ups were:
Agree Unsure Disagree
Treat me with more respect
1998
0-1 time 30% 54% 16%
2-4 times 48% 39% 13%
5+ times 53% 44% 3%
2000
0-1 time 32% 59% 9%
2-4 times 59% 32% 9%
5+ times 65% 30% 5%
Significance: 0.003
Have better recess behavior
1998
0-1 time 33% 43% 24%
2-4 times 40% 42% 18%
5+ times 47% 41% 12%
2000
0-1 time 26% 68% 6%
2-4 times 51% 38% 12%
5+ times 55% 45% 0%
Significance: 0.0004
Call each other names less
1998
0-1 time 21% 52% 27%
2-4 times 48% 38% 14%
5+ times 56% 25% 19%
2000
0-1 time 32% 56% 12%
2-4 times 58% 35% 8%
5+ times 55% 45% 0%
Significance: 0.003
The 2000 survey also reported strong relationships for “fight less often” (0.004), “are less destructive of property” (0.002), and “are less disruptive in class” (0.007). However, the first-year report does not provide corresponding statistics.
The frequency effect was stronger with elementary school students than with upper-level students, which may indicate that CHARACTER COUNTS! has a greater influence on younger children than on teens.
Impact of Teacher Training
The researchers also asked teachers whether or not they had had training in CHARACTER COUNTS!, and compared the answers to teacher assessments of student behavior. For teachers of grades 7-12, the figures are:
Agree Unsure Disagree
Treat each other better
1998
training 44% 48% 7%
no training 38% 30% 30%
2000
training 61% 31% 8%
no training 48% 45% 6%
Significance: 0.08
Skip class less often
1998
training 20% 72% 8%
no training 12% 52% 36%
2000
“little relation,” no reported data
Get work done more often
1998
training 19% 66% 15%
no training 13% 45% 41%
2000
training 16% 64% 21%
no training 12% 65% 24%
Significance: 0.02
Less likely to get suspended
1998
training 13% 76% 10%
no training 11% 56% 32%
2000
“little relation,” no reported data
Late to class less often
1998
training 15% 72% 13%
no training 21% 41% 38%
2000
no reported data
Fight less often
1998
training 25% 72% 3%
no training 16% 57% 27%
2000
“little relation,” no reported data
In 1998 each relationship was statistically significantly at the .01 level, meaning there was less than a 1 percent likelihood that the association between training and reports occurred by chance. The evaluators suggested two possible explanations for this relationship. Either the trained teachers view the program more favorably and hence are more apt to see it as having an impact, or trained teachers actually deliver the program more effectively.
However, by 2000 a leveling had occurred, and the trained and untrained were reporting similarly. The cause of this consensus is hard to discern.
For teachers of grades 1-6, the figures are:
Agree Unsure Disagree
Call each other names less
1998
training 50% 36% 14%
no training 34% 43% 23%
2000
training 70% 25% 5%
no training 41% 47% 11%
Significance: 0.0002
Help each other more often
1998
training 67% 25% 8%
no training 58% 35% 8%
2000
training 81% 16% 2%
no training 56% 36% 8%
Significance: 0.02
Have better recess behavior
1998
training 43% 41% 16%
no training 34% 43% 23%
2000
training 56% 37% 7%
no training 39% 51% 10%
Significance: 0.0005
Treat me with more respect
1998
training 50% 37% 13%
no training 40% 46% 14%
2000
training 60% 35% 5%
no training 48% 40% 11%
Significance: 0.0009
Elementary school teachers were closer to agreement in 1998, yet by 2000 the gap had widened and trained teachers were perceiving more improvement. Furthermore, in many categories the statistical significance is extremely strong. Levels like 0.0002 virtually rule out chance. Conceivably a smaller sample size enhances the teacher training effect, since over time the number of grade 7-12 teachers has almost doubled, while the grade 1-6 teacher pool has shrunk to less than half. But if sample size matters, it is hard to see how.