Skip to Main Content
DMU logo

Hours Today:

Access to resources is available 24 hours a day, 7 days a week

Exploring Program Evaluation: Other Relevant Issues

Ethical Issues

If evaluation is for improving a program’s processes and operations only, IRB approval is not needed. However, if it is conducted for broadening knowledge, IRB approval is needed.

Ethical principles and guidelines should still be followed regarding, for example, cultural sensitivity, research with special populations, etc.

Sometimes control needs to be given up to communities but still adhere to IRB guidelines, especially when it comes to the ownership of data, dissemination of findings, breaching of confidentiality, imbalance of rigor with community norms, who can speak for the community, etc.

Political Issues and Feelings of Threat

Treatment fidelity is if the intervention is conducted accurately, conforming to the originally designed protocol. Lack of fidelity can lead to wrong conclusions. Three dimensions make up good treatment fidelity: whether the service provider adheres to the specified procedures, the providers’ level of skill or knowledge in delivering the intervention, and the treatment being examined should be different than the routine practice. Adequate training and supervision is important in the administering of the treatment.

Importance of Treatment Fidelity

Evaluations can be used for political purposes to bring about changes in programs and personnel and may be seen as a political activity. Feelings of threat may result, and evaluators need to be mindful of this, to maintain independence, to negotiate a contract, attempt to obtain evaluative information from as many sources as possible, and to explain and communicate the purpose and methodology to stakeholders.

References

Mertens, D. M. & Wilson, A. T. (2019). Program evaluation theory and practice: A comprehensive guide (2nd ed.). The Guilford Press.

Royse, D., Thyer, B. A., & Padgett, D. K. (2016). Program evaluation: An Introduction to an evidence-based approach (6th ed.). Cengage.