No Child Left Behind Act

DETERMINING EVIDENCE OF SCIENTIFICALLY BASED RESEARCH

The No Child Left Behind (NCLB) Act of 2001 calls for educational activities and programs to be supported by scientifically-based research. Scientifically-based research involves the application of rigorous, systematic and objective procedures to obtain a reliable and valid assessment of educational activities and programs. Since 1997 researchers at South Dakota State University have been studying the effectiveness of CHARACTER COUNTS! in schools throughout the state. The following information applies to this research.

SYSTEMATIC AND EMPIRICAL METHODS

  • Does the research have a solid theoretical foundation? YES
  • Were methodology, subject, and researcher clearly identified? YES
  • Was the study conducted in a consistent, disciplined, and methodical manner? YES
  • Was the data obtained using observation or experiment? YES
  • Was the research grounded in data that are factual rather than option-based? YES
  • Are the research findings supported by tangible, measurable evidence? YES

RIGOROUS DATA ANALYSIS

  • Did the research test the stated hypotheses and justify the general conclusions drawn? YES
  • Did the methods correspond to the nature and structure of the data? YES
  • Did the research minimize alternative explanations for observed effects? YES
  • Did the research findings present convincing documentation that the observed results were caused by the intervention? YES

RELIABLE AND VALID DATA COLLECTION

  • Did the data result from a study involving multiple investigations in a number of locations? YES
  • Were research biases minimized? YES
  • Was the data measured consistently? YES
  • Did repeated measurements on subjects taken under similar circumstances produce similar results? YES

STRONG RESEARCH DESIGN

  • Do the controls allow for the evaluation of the condition(s) of interest? YES
  • Was the study designed to optimize the investigator’s ability to answer the research question? YES
  • Does the design describe a random assignment experiment in which subject are assigned to different conditions with appropriate controls? NO
    Note: There was a control group in the initial research design, but the control group schools asked to be part of the CHARACTER COUNTS! initiative. And failure to treat is unethical. More studies are in process and will be forthcoming.

DETAILED RESULTS THAT ALLOW FOR REPLICATION

  • Are the findings clearly described and reported? YES
  • Are the results of the research sufficiently detailed so that replication of the design is possible? YES
  • Can the findings be enhanced with additional research? YES

RESULTS SUBJECTED TO SCRUTINY

  • Has the research been accepted by a peer-reviewed journal or approved by a panel of independent experts? PENDING: The research is currently under review.
  • Have unbiased experts who were not a part of the research study reviewed the research? YES
  • Have reviewers applied strict standards of scholarship and provided quality controls for the research the reviewed? YES
  • Has the research been subjected to external verification? YES