Thelen Memorial Library Find A-Z eResource List Databases Get Help Chat "How Do I..." Library Tutorials LibGuides Library Handbook Services How to Reserve a Study Room My Account/Interlibrary Loan Requests Writing Center About the Writing Center About APA Academic Writer Access APA Academic Writer About Tutor.com About Turnitin Originality About Biography of George and Sue Thelen Vision & Mission Contact Us Directions Collections and Resources Hours Library Log-In Divine Mercy UniversityLibGuidesOther GuidesExploring Program EvaluationOther Relevant Issues Search this GuideSearch Exploring Program Evaluation: Other Relevant Issues IntroductionEvaluation TypesEvaluation DesignsMeasurementOther Relevant IssuesProposals and Reports Ethical Issues If evaluation is for improving a program’s processes and operations only, IRB approval is not needed. However, if it is conducted for broadening knowledge, IRB approval is needed. Ethical principles and guidelines should still be followed regarding, for example, cultural sensitivity, research with special populations, etc. Sometimes control needs to be given up to communities but still adhere to IRB guidelines, especially when it comes to the ownership of data, dissemination of findings, breaching of confidentiality, imbalance of rigor with community norms, who can speak for the community, etc. Political Issues and Feelings of Threat Treatment fidelity is if the intervention is conducted accurately, conforming to the originally designed protocol. Lack of fidelity can lead to wrong conclusions. Three dimensions make up good treatment fidelity: whether the service provider adheres to the specified procedures, the providers’ level of skill or knowledge in delivering the intervention, and the treatment being examined should be different than the routine practice. Adequate training and supervision is important in the administering of the treatment. Importance of Treatment Fidelity Evaluations can be used for political purposes to bring about changes in programs and personnel and may be seen as a political activity. Feelings of threat may result, and evaluators need to be mindful of this, to maintain independence, to negotiate a contract, attempt to obtain evaluative information from as many sources as possible, and to explain and communicate the purpose and methodology to stakeholders. References Mertens, D. M. & Wilson, A. T. (2019). Program evaluation theory and practice: A comprehensive guide (2nd ed.). The Guilford Press. Royse, D., Thyer, B. A., & Padgett, D. K. (2016). Program evaluation: An Introduction to an evidence-based approach (6th ed.). Cengage. << Previous: MeasurementNext: Proposals and Reports >>
Ethical Issues
If evaluation is for improving a program’s processes and operations only, IRB approval is not needed. However, if it is conducted for broadening knowledge, IRB approval is needed.
Ethical principles and guidelines should still be followed regarding, for example, cultural sensitivity, research with special populations, etc.
Sometimes control needs to be given up to communities but still adhere to IRB guidelines, especially when it comes to the ownership of data, dissemination of findings, breaching of confidentiality, imbalance of rigor with community norms, who can speak for the community, etc.
Political Issues and Feelings of Threat
Treatment fidelity is if the intervention is conducted accurately, conforming to the originally designed protocol. Lack of fidelity can lead to wrong conclusions. Three dimensions make up good treatment fidelity: whether the service provider adheres to the specified procedures, the providers’ level of skill or knowledge in delivering the intervention, and the treatment being examined should be different than the routine practice. Adequate training and supervision is important in the administering of the treatment.
Importance of Treatment Fidelity
Evaluations can be used for political purposes to bring about changes in programs and personnel and may be seen as a political activity. Feelings of threat may result, and evaluators need to be mindful of this, to maintain independence, to negotiate a contract, attempt to obtain evaluative information from as many sources as possible, and to explain and communicate the purpose and methodology to stakeholders.
References
Mertens, D. M. & Wilson, A. T. (2019). Program evaluation theory and practice: A comprehensive guide (2nd ed.). The Guilford Press.
Royse, D., Thyer, B. A., & Padgett, D. K. (2016). Program evaluation: An Introduction to an evidence-based approach (6th ed.). Cengage.